[Docs] Fix syntax highlighting of shell commands (#19870)
Signed-off-by: Lukas Geiger <lukas.geiger94@gmail.com>
This commit is contained in:
@@ -9,7 +9,7 @@ Compared to other quantization methods, BitsAndBytes eliminates the need for cal
|
||||
|
||||
Below are the steps to utilize BitsAndBytes with vLLM.
|
||||
|
||||
```console
|
||||
```bash
|
||||
pip install bitsandbytes>=0.45.3
|
||||
```
|
||||
|
||||
@@ -54,6 +54,6 @@ llm = LLM(
|
||||
|
||||
Append the following to your model arguments for 4bit inflight quantization:
|
||||
|
||||
```console
|
||||
```bash
|
||||
--quantization bitsandbytes
|
||||
```
|
||||
|
||||
Reference in New Issue
Block a user