dongmao zhang 87525fab92 [bitsandbytes]: support read bnb pre-quantized model (#5753) ...

Co-authored-by: Michael Goin <michael@neuralmagic.com>

2024-07-23 23:45:09 +00:00

..

_templates/sections

[Doc] Guide for adding multi-modal plugins (#6205)

2024-07-10 14:55:34 +08:00

assets

[Doc] add visualization for multi-stage dockerfile (#4456)

2024-04-30 17:41:59 +00:00

automatic_prefix_caching

[Doc] Add an automatic prefix caching section in vllm documentation (#5324)

2024-06-11 10:24:59 -07:00

community

[Docs] Add Google Cloud to sponsor list (#6450)

2024-07-15 11:58:10 -07:00

dev

[Frontend] Refactor prompt processing (#4028)

2024-07-22 10:13:53 -07:00

getting_started

[Bugfix][CI/Build][Hardware][AMD] Fix AMD tests, add HF cache, update CK FA, add partially supported model notes (#6543)

2024-07-20 09:39:07 -07:00

models

[Docs] Announce llama3.1 support (#6688)

2024-07-23 08:18:15 -07:00

quantization

[bitsandbytes]: support read bnb pre-quantized model (#5753)

2024-07-23 23:45:09 +00:00

serving

[doc][distributed] fix doc argument order (#6691)

2024-07-23 08:55:33 -07:00

conf.py

[Docs] Fix readthedocs for tag build (#6158)

2024-07-05 12:44:40 -07:00

generate_examples.py

Add example scripts to documentation (#4225)

2024-04-22 16:36:54 +00:00

index.rst

[bitsandbytes]: support read bnb pre-quantized model (#5753)

2024-07-23 23:45:09 +00:00