Roy Wang faa80947f5 [Performance] Add --enable-ep-weight-filter CLI option (#37351) ...

Signed-off-by: esmeetu <jasonailu87@gmail.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
(cherry picked from commit 761e0aa7a0)

2026-03-18 01:41:25 -07:00

..

__init__.py

[offloader] v2: Hide weight onloading latency via prefetching (#29941)

2026-02-25 17:20:59 -08:00

attention.py

[Attention] Use FA4 for MLA prefill (#34732)

2026-03-12 12:10:17 -04:00

cache.py

[Misc] Add float16 to CacheDType (#37199)

2026-03-16 13:24:48 -07:00

compilation.py

[MRV2] Extensible CG dispatch rework (#35959)

2026-03-09 13:58:45 -07:00

device.py

Turn @config into a dataclass_transform (#31541)

2026-02-03 17:40:59 +00:00

ec_transfer.py

[Misc] Introduce ec_both role EC (encoder cache) connector (#34182)

2026-02-10 18:55:35 +00:00

kernel.py

[UX] Add --moe-backend arg for explicit kernel selection (#33807)

2026-02-25 17:44:44 -08:00

kv_events.py

Turn @config into a dataclass_transform (#31541)

2026-02-03 17:40:59 +00:00

kv_transfer.py

[Misc] Set default kv_buffer_device in a better way (#36862)

2026-03-13 19:07:33 +00:00

load.py

[Performance] Add prefetch for checkpoints to OS page cache (#36012)

2026-03-16 11:32:02 +00:00

lora.py

Turn @config into a dataclass_transform (#31541)

2026-02-03 17:40:59 +00:00

model_arch.py

[Core] Parse vLLM engine required fields from hf_config to model_arch_config (#28454)

2026-01-02 15:13:15 -08:00

model.py

[Bugfix] Add safety check and fallback for null scaling factor (#36106)

2026-03-16 14:27:29 +00:00

multimodal.py

[Refactor] Simplify dummy data generation (#35025)

2026-02-22 20:55:27 -08:00

observability.py

[Bugfix][CI] fix typos (#34934)

2026-03-05 17:05:46 +00:00

offload.py

[offloader] v2: Hide weight onloading latency via prefetching (#29941)

2026-02-25 17:20:59 -08:00

parallel.py

[Performance] Add --enable-ep-weight-filter CLI option (#37351)

2026-03-18 01:41:25 -07:00

pooler.py

[Refactor] Pass Renderer to Input Processor (#34329)

2026-02-11 19:38:11 -08:00

profiler.py

Add PyTorch profiler schedule support with warmup/active iterations (#35240)

2026-03-04 12:53:38 -08:00

scheduler.py

[Bug] Refactor max_num_batched_tokens to account for drafting (#34898)

2026-02-22 11:18:46 -05:00

speculative.py

[Model Runner V2] Some code simplification (#36929)

2026-03-13 00:59:23 +00:00

speech_to_text.py

[MM] Allow audio chunking for offline LLM (#34628)

2026-02-23 21:04:28 -08:00

structured_outputs.py

Remove unused disable_fallback field (#36546)

2026-03-09 20:56:54 -07:00

utils.py

[Misc] Add deprecated environment variable utilities (#33677)

2026-02-19 21:33:25 -08:00

vllm.py

[Feature] Add Azure Blob Storage support for RunAI Model Streamer (#34614)

2026-03-15 19:38:21 +08:00

weight_transfer.py

[Feat][RL][2/2] Native Weight Syncing API: IPC (#34171)

2026-02-27 13:45:21 -07:00