Jonas M. Kübler 98e7f223b9 enable skipping of SW attention layers when using FP8 KV cache (#33695) ...

Signed-off-by: Jonas Kuebler <kuebj@amazon.com>

2026-03-27 07:25:02 -06:00

..

__init__.py

Change the name to vLLM (#150)

2023-06-17 03:07:40 -07:00

arg_utils.py

enable skipping of SW attention layers when using FP8 KV cache (#33695)

2026-03-27 07:25:02 -06:00

async_llm_engine.py

[Docs] Reduce time spent generating API docs (#34255)

2026-02-11 02:56:02 -08:00

llm_engine.py

[Docs] Reduce time spent generating API docs (#34255)

2026-02-11 02:56:02 -08:00

protocol.py

[Misc] Reorganize inputs (#35182)

2026-03-25 10:22:54 -07:00