[Doc] Update documentation on Tensorizer (#5471)

This commit is contained in:
Sanger Steel
2024-06-14 14:27:57 -04:00
committed by GitHub
parent cdab68dcdb
commit 6e2527a7cb
3 changed files with 14 additions and 1 deletions

View File

@@ -230,7 +230,7 @@ class EngineArgs:
'* "dummy" will initialize the weights with random values, '
'which is mainly for profiling.\n'
'* "tensorizer" will load the weights using tensorizer from '
'CoreWeave. See the Tensorize vLLM Model script in the Examples'
'CoreWeave. See the Tensorize vLLM Model script in the Examples '
'section for more information.\n'
'* "bitsandbytes" will load the weights using bitsandbytes '
'quantization.\n')