[[Misc]Upgrade bitsandbytes to the latest version 0.44.0 (#8768)

2024-09-25 08:08:55 +08:00
parent 1e7d5c01f5
commit 13f9f7a3d0
7 changed files with 44 additions and 34 deletions
--- a/docs/source/quantization/bnb.rst
+++ b/docs/source/quantization/bnb.rst
@@ -11,7 +11,7 @@ Below are the steps to utilize BitsAndBytes with vLLM.

 .. code-block:: console

-    $ pip install bitsandbytes>=0.42.0
+    $ pip install bitsandbytes>=0.44.0

 vLLM reads the model's config file and supports both in-flight quantization and pre-quantized checkpoint.