roikoren755 bf184a6621 Enable quantized attention in NemotronH models (#31898) ...

Signed-off-by: Roi Koren <roik@nvidia.com>

2026-01-07 17:37:19 +00:00

..

__init__.py

Default model load/config/tokenizer to mistral format if relevant files exist (#28659)

2025-11-21 13:58:59 -08:00

base_loader.py

[Chore] Clean up pytorch helper functions in vllm.utils (#26908)

2025-10-18 09:48:22 -07:00

bitsandbytes_loader.py

[Chore] Remove unused noqas (#31263)

2025-12-24 05:38:46 -08:00

default_loader.py

[Refactor][TPU] Remove torch_xla path and use tpu-inference (#30808)

2026-01-07 16:07:16 +08:00

dummy_loader.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00

gguf_loader.py

[Model][Quantization] Restore MoE + GGUF models support (incl. Qwen3 MoE) by allowing Sideload Parameters (#30116)

2025-12-09 05:30:05 +00:00

online_quantization.py

Move online quantization to model.load_weights (#26327)

2025-11-18 16:52:41 -08:00

runai_streamer_loader.py

[Chore] Remove unused noqas (#31263)

2025-12-24 05:38:46 -08:00

sharded_state_loader.py

[log] add weights loading time log to sharded_state loader (#28628)

2025-11-21 21:06:09 +00:00

tensorizer_loader.py

[Chore] Clean up pytorch helper functions in vllm.utils (#26908)

2025-10-18 09:48:22 -07:00

tensorizer.py

[V0 deprecation] Remove VLLM_USE_V1 usage in most modules (#27955)

2025-11-04 20:51:16 -08:00

utils.py

[BugFix] skip language model in Encoder (#30242)

2025-12-22 05:25:59 -08:00

weight_utils.py

Enable quantized attention in NemotronH models (#31898)

2026-01-07 17:37:19 +00:00