[[Misc]Upgrade bitsandbytes to the latest version 0.45.0 (#11201)

2024-12-15 11:03:06 +08:00
parent 886936837c
commit 15859f2357
5 changed files with 8 additions and 8 deletions
--- a/docs/source/quantization/bnb.rst
+++ b/docs/source/quantization/bnb.rst
@@ -11,7 +11,7 @@ Below are the steps to utilize BitsAndBytes with vLLM.

 .. code-block:: console

-    $ pip install bitsandbytes>=0.44.0
+    $ pip install bitsandbytes>=0.45.0

 vLLM reads the model's config file and supports both in-flight quantization and pre-quantized checkpoint.