wliao2 4dfad17ed1 replace cuda_device_count_stateless() to current_platform.device_count() (#37841) ...

Signed-off-by: Liao, Wei <wei.liao@intel.com>
Signed-off-by: wliao2 <wei.liao@intel.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>

2026-03-31 22:32:54 +08:00

..

attention

[WIP][CI][Bugfix] Fix test_run_eagle_dp (#38584)

2026-03-31 12:30:25 +02:00

core

[Core][KV Connector] Remove use of num_cached_tokens in error handling (#38096)

2026-03-25 18:20:48 +00:00

engine

[Refactor] Unify engine process monitoring in engine manager and add Ray backend support (#35862)

2026-03-30 10:16:09 -07:00

executor

replace cuda_device_count_stateless() to current_platform.device_count() (#37841)

2026-03-31 22:32:54 +08:00

kv_offload

[kv_offload+HMA] Fix num_blocks with different per-layer page sizes and improve assert message (#38554)

2026-03-31 06:00:40 +00:00

metrics

[Metrics] Some small refactoring for better maintainability (#33898)

2026-03-20 16:11:34 +00:00

pool

[Perf] Remove redundant device copies for CPU-only pooling token IDs, 48.9% E2E throughput improvement (#38139)

2026-03-29 18:12:50 +00:00

sample

[Feature] limit thinking tokens (hard limit) (#20859)

2026-03-24 09:53:07 -07:00

spec_decode

[Feat][Spec Decode] DFlash (#36847)

2026-03-30 15:03:15 -04:00

structured_output

[Bugfix] Add missing f-string prefix in xgrammar choices error message (#38162)

2026-03-26 21:43:03 +00:00

worker

[Bugfix] Use null block (0) for padded block table entries (#35431)

2026-03-30 14:02:51 -07:00

__init__.py

[V1] AsyncLLM Implementation (#9826)

2024-11-11 23:05:38 +00:00

cudagraph_dispatcher.py

[Mypy] Fix mypy for vllm/config (#37808)

2026-03-23 14:33:59 +00:00

kv_cache_interface.py

[BUGFIX][Mamba][Qwen3.5] Zero freed SSM cache blocks on GPU (#35219)

2026-03-10 03:32:20 -07:00

outputs.py

[KVConnector] Remove redundant method KVConnectorOutput::merge() (#38546)

2026-03-31 07:11:02 +03:00

request.py

[Refactor] Rename WAITING_FOR_FSM to WAITING_FOR_STRUCTURED_OUTPUT_GRAMMAR (#38048)

2026-03-25 11:41:44 -04:00

serial_utils.py

Add tensor IPC transfer mechanism for multimodal data (#32104)

2026-03-21 20:10:20 +00:00

utils.py

[Refactor] Unify engine process monitoring in engine manager and add Ray backend support (#35862)

2026-03-30 10:16:09 -07:00