Xin Yang f1740006e4 [Perf] Enable dual stream execution of input projection for Qwen3 (#36795) ...

Signed-off-by: Xin Yang <xyangx@amazon.com>

2026-03-18 11:13:27 +08:00

..

__init__.py

[Refactor] Use data parser for matching data items to multi-modal UUIDs (#32955)

2026-01-26 15:00:28 +08:00

argparse_utils.py

Enforce that model is the first positional arg when --served-model-name is used (#34973)

2026-02-23 08:38:05 -08:00

async_utils.py

[Frontend] Use new Renderer for Completions and Tokenize API (#32863)

2026-01-31 04:51:15 -08:00

cache.py

[Docs] Mock all imports for docs (#27873)

2025-11-01 10:02:23 +00:00

collection_utils.py

[Plugin] Simplify IO Processor Plugin interface (#34236)

2026-02-10 19:47:39 -08:00

counter.py

[Misc] Separate out utils.counter and move utils.Device to engine (#27588)

2025-10-28 12:20:46 +00:00

deep_gemm.py

[Feat] Add CUDA torch fallbacks for fp8_mqa_logits/fp8_paged_mqa_logits_torch function (#35271)

2026-02-28 10:12:00 +00:00

flashinfer.py

[Kernel] Add FlashInfer MoE A2A Kernel (#36022)

2026-03-15 23:45:32 -07:00

func_utils.py

[Misc] Move utils to avoid conflicts with stdlib, and move tests (#27169)

2025-10-19 05:20:55 -07:00

gc_utils.py

[Doc]: fixing typos in multiple files. (#29685)

2025-11-28 08:41:41 -08:00

hashing.py

[Core] Add xxHash as a high-performance hash option for accelerating prefix caching (#29163)

2025-12-03 16:06:57 +00:00

import_utils.py

[2/N] Elastic EP Milestone 2: Integrating NIXL-EP (#35627)

2026-03-13 09:25:33 -04:00

jsontree.py

[mypy] Pass type checking for vllm/utils and vllm/v1/pool (#29666)

2025-11-28 20:40:47 +08:00

math_utils.py

[BUGFIX][Mamba][Qwen3.5] Zero freed SSM cache blocks on GPU (#35219)

2026-03-10 03:32:20 -07:00

mem_constants.py

[Chore] Separate out vllm.utils.mem_utils (#27143)

2025-10-18 10:06:59 +00:00

mem_utils.py

[Hardware] Replace memory related torch.cuda APIs (#37031)

2026-03-16 10:24:48 +00:00

mistral.py

[Feature] Lazy import for the "mistral" tokenizer module. (#34651)

2026-02-23 00:43:01 -08:00

multi_stream_utils.py

[Perf] Enable dual stream execution of input projection for Qwen3 (#36795)

2026-03-18 11:13:27 +08:00

nccl.py

[mypy] Pass type checking for vllm/utils and vllm/v1/pool (#29666)

2025-11-28 20:40:47 +08:00

network_utils.py

[2/N] Elastic EP Milestone 2: Integrating NIXL-EP (#35627)

2026-03-13 09:25:33 -04:00

nvtx_pytorch_hooks.py

[Feature] Add Layer-wise NVTX Support (#29990)

2025-12-05 11:20:07 +00:00

platform_utils.py

[Platform] Add current_platform.num_compute_units interface (#35042)

2026-02-24 22:22:49 -08:00

print_utils.py

[Examples][1/n] Resettle basic examples. (#35579)

2026-03-08 20:22:53 -07:00

profiling.py

[Chore] Separate out profiling utilities from vllm.utils (#27150)

2025-10-18 19:12:01 +00:00

registry.py

[mypy] Pass type checking for vllm/utils and vllm/v1/pool (#29666)

2025-11-28 20:40:47 +08:00

serial_utils.py

[Refactor] Clean up pooling serial utils (#33665)

2026-02-03 10:29:18 +00:00

system_utils.py

[BugFix] Fix multiple/duplicate stdout prefixes (#36822)

2026-03-12 12:23:21 +08:00

tensor_schema.py

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)

2025-10-12 09:51:31 -07:00

torch_utils.py

[Hardware] Replace torch.cuda.device_count/current_device/set_device API (#36145)

2026-03-12 07:57:47 -07:00

tqdm_utils.py

[Renderer] Move InputPreprocessor into Renderer (2/2) (#34560)

2026-02-17 05:29:01 -08:00