youkaichao cbc2ef5529 [misc] hide best_of from engine (#9261) ...

Co-authored-by: Brendan Wong <bjwpokemon@gmail.com>

2024-10-10 21:30:44 -07:00

..

fused_moe

[Kernel] Zero point support in fused MarlinMoE kernel + AWQ Fused MoE (#8973)

2024-10-04 12:34:44 -06:00

mamba

[Kernel][Model] Varlen prefill + Prefill chunking support for mamba kernels and Jamba model (#8533)

2024-09-29 17:35:58 -04:00

quantization

[Hardware][CPU] Support AWQ for CPU backend (#7515)

2024-10-09 10:28:08 -06:00

__init__.py

Change the name to vLLM (#150)

2023-06-17 03:07:40 -07:00

activation.py

[Hardware][intel GPU] bump up ipex version to 2.3 (#8365)

2024-09-13 16:54:34 -07:00

layernorm.py

[Model] Support NVLM-D and fix QK Norm in InternViT (#9045)

2024-10-07 11:55:12 +00:00

linear.py

[Hardware][CPU] Support AWQ for CPU backend (#7515)

2024-10-09 10:28:08 -06:00

logits_processor.py

[Bugfix] Fix weight loading for Chameleon when TP>1 (#7410)

2024-08-13 05:33:41 +00:00

pooler.py

[Model] Support Qwen2.5-Math-RM-72B (#8896)

2024-09-28 21:19:39 -07:00

rejection_sampler.py

[SpecDec][Misc] Cleanup, remove bonus token logic. (#8701)

2024-09-22 12:34:14 -07:00

resampler.py

[MODEL] Qwen Multimodal Support (Qwen-VL / Qwen-VL-Chat) (#8029)

2024-09-05 12:48:10 +00:00

rotary_embedding.py

[Misc] Use RoPE cache for MRoPE (#8396)

2024-09-11 23:13:14 -07:00

sampler.py

[misc] hide best_of from engine (#9261)

2024-10-10 21:30:44 -07:00

spec_decode_base_sampler.py

[SpecDec][Misc] Cleanup, remove bonus token logic. (#8701)

2024-09-22 12:34:14 -07:00

typical_acceptance_sampler.py

Fix typical acceptance sampler with correct recovered token ids (#8562)

2024-09-23 12:32:27 -07:00

vocab_parallel_embedding.py

[Bugfix] Fix lm_head weights tying with lora for llama (#9227)

2024-10-10 21:11:56 +08:00