[Misc] Upgrade BNB version (#15183)

2025-03-24 13:51:42 +08:00
parent d20e261199
commit 3892e58ad7
4 changed files with 10 additions and 10 deletions
--- a/docs/source/features/quantization/bnb.md
+++ b/docs/source/features/quantization/bnb.md
@@ -9,7 +9,7 @@ Compared to other quantization methods, BitsAndBytes eliminates the need for cal
 Below are the steps to utilize BitsAndBytes with vLLM.

 ```console
-pip install bitsandbytes>=0.45.0
+pip install bitsandbytes>=0.45.3
 ```

 vLLM reads the model's config file and supports both in-flight quantization and pre-quantized checkpoint.