vllm/docs/assets/design at 5719a4e4e601fb91274294d25370b7aad656d629 - vllm

Files

Michael Goin c39ee9ee2b [Docs] Add sections on process architecture and minimum CPU resources (#33940 )

It seems users can be confused about vLLM's performance when running
with very small amounts of CPU cores available. We are missing a clear
overview of what vLLM's process architecture is, so I added this along with
some diagrams in arch_overview.md, and included a section on CPU resource
recommendations in optimization.md

Signed-off-by: mgoin <mgoin64@gmail.com>

2026-02-06 15:26:43 +00:00

arch_overview

[Docs] Add sections on process architecture and minimum CPU resources (#33940 )

2026-02-06 15:26:43 +00:00

cuda_graphs

[Docs] add docs for cuda graph v1 (#24374 )

2025-10-07 05:25:05 -07:00

debug_vllm_compile

[Docs] Add guide to debugging vLLM-torch.compile integration (#28094 )

2025-11-05 21:31:46 +00:00

fused_moe_modular_kernel

[Doc] Add FusedMoE Modular Kernel Documentation (#21623 )