Terry Gao 82580b10ac [Perf] Disable inductor runtime asserts by default for serving perfor… (#37485) ...

Signed-off-by: tianrengao <terrygao87@gmail.com>
Co-authored-by: Tianren Gao <tianren@fb.com>

2026-03-24 19:37:51 -04:00

..

__init__.py

[Feature] limit thinking tokens (hard limit) (#20859)

2026-03-24 09:53:07 -07:00

attention.py

[Mypy] Fix mypy for vllm/config (#37808)

2026-03-23 14:33:59 +00:00

cache.py

[Deprecation] Deprecate --calculate-kv-scales option (#37201)

2026-03-17 19:57:24 +00:00

compilation.py

[Perf] Disable inductor runtime asserts by default for serving perfor… (#37485)

2026-03-24 19:37:51 -04:00

device.py

[Mypy] Fix mypy for vllm/config (#37808)

2026-03-23 14:33:59 +00:00

ec_transfer.py

[Misc] Introduce ec_both role EC (encoder cache) connector (#34182)

2026-02-10 18:55:35 +00:00

kernel.py

[Mypy] Fix mypy for vllm/config (#37808)

2026-03-23 14:33:59 +00:00

kv_events.py

[Mypy] Fix mypy for vllm/config (#37808)

2026-03-23 14:33:59 +00:00

kv_transfer.py

[Misc] Set default kv_buffer_device in a better way (#36862)

2026-03-13 19:07:33 +00:00

load.py

[Performance] Add prefetch for checkpoints to OS page cache (#36012)

2026-03-16 11:32:02 +00:00

lora.py

[Mypy] Fix mypy for vllm/config (#37808)

2026-03-23 14:33:59 +00:00

model_arch.py

[Core] Parse vLLM engine required fields from hf_config to model_arch_config (#28454)

2026-01-02 15:13:15 -08:00

model.py

[Bugfix] Pass hf_token through config loading paths for gated model support (#37920)

2026-03-24 15:22:05 -04:00

multimodal.py

Add tensor IPC transfer mechanism for multimodal data (#32104)

2026-03-21 20:10:20 +00:00

observability.py

[Bugfix][CI] fix typos (#34934)

2026-03-05 17:05:46 +00:00

offload.py

[offloader] v2: Hide weight onloading latency via prefetching (#29941)

2026-02-25 17:20:59 -08:00

parallel.py

[Bugfix] Register VLLM_BATCH_INVARIANT in envs.py to fix spurious unknown env var warning (#35007)

2026-03-23 18:31:14 -04:00

pooler.py

[Deprecate] Deprecate pooling multi task support. (#37956)

2026-03-24 14:07:47 +00:00

profiler.py

[UX] Enable torch_profiler_with_stack (#37571)

2026-03-20 11:17:26 +00:00

reasoning.py

[Feature] limit thinking tokens (hard limit) (#20859)

2026-03-24 09:53:07 -07:00

scheduler.py

[Core] add option to schedule requests based on full ISL (#37307)

2026-03-24 13:01:12 -04:00

speculative.py

[Mypy] Fix mypy for vllm/config (#37808)

2026-03-23 14:33:59 +00:00

speech_to_text.py

[MM] Allow audio chunking for offline LLM (#34628)

2026-02-23 21:04:28 -08:00

structured_outputs.py

Remove unused disable_fallback field (#36546)

2026-03-09 20:56:54 -07:00

utils.py

[Mypy] Fix mypy for vllm/config (#37808)

2026-03-23 14:33:59 +00:00

vllm.py

[Feature] limit thinking tokens (hard limit) (#20859)

2026-03-24 09:53:07 -07:00

weight_transfer.py

[Feat][RL][2/2] Native Weight Syncing API: IPC (#34171)

2026-02-27 13:45:21 -07:00