Giancarlo Delfin c77181e534 [Model Runner V2] Add probabilistic rejection sampling for spec decoding (#35461) ...

Signed-off-by: Giancarlo Delfin <gdelfin@inferact.ai>

2026-03-11 14:04:32 -07:00

..

__init__.py

[offloader] v2: Hide weight onloading latency via prefetching (#29941)

2026-02-25 17:20:59 -08:00

attention.py

[Misc] Add --attention-backend auto option (#35738)

2026-03-04 15:12:27 +00:00

cache.py

Reapply [Attention] Refactor check_and_update_config (#35122)

2026-03-09 07:17:14 -07:00

compilation.py

[MRV2] Extensible CG dispatch rework (#35959)

2026-03-09 13:58:45 -07:00

device.py

Turn @config into a dataclass_transform (#31541)

2026-02-03 17:40:59 +00:00

ec_transfer.py

[Misc] Introduce ec_both role EC (encoder cache) connector (#34182)

2026-02-10 18:55:35 +00:00

kernel.py

[UX] Add --moe-backend arg for explicit kernel selection (#33807)

2026-02-25 17:44:44 -08:00

kv_events.py

Turn @config into a dataclass_transform (#31541)

2026-02-03 17:40:59 +00:00

kv_transfer.py

[Hardware][NIXL] set default kv buffer type for different platform (#36438)

2026-03-11 05:19:28 +00:00

load.py

Turn @config into a dataclass_transform (#31541)

2026-02-03 17:40:59 +00:00

lora.py

Turn @config into a dataclass_transform (#31541)

2026-02-03 17:40:59 +00:00

model_arch.py

[Core] Parse vLLM engine required fields from hf_config to model_arch_config (#28454)

2026-01-02 15:13:15 -08:00

model.py

[BugFix]: add bagel to MM_PREFIX_LM_MODELS (#36316)

2026-03-11 19:55:59 +00:00

multimodal.py

[Refactor] Simplify dummy data generation (#35025)

2026-02-22 20:55:27 -08:00

observability.py

[Bugfix][CI] fix typos (#34934)

2026-03-05 17:05:46 +00:00

offload.py

[offloader] v2: Hide weight onloading latency via prefetching (#29941)

2026-02-25 17:20:59 -08:00

parallel.py

[Feature] Add --distributed-timeout-seconds CLI option (#36047)

2026-03-05 20:57:51 -08:00

pooler.py

[Refactor] Pass Renderer to Input Processor (#34329)

2026-02-11 19:38:11 -08:00

profiler.py

Add PyTorch profiler schedule support with warmup/active iterations (#35240)

2026-03-04 12:53:38 -08:00

scheduler.py

[Bug] Refactor max_num_batched_tokens to account for drafting (#34898)

2026-02-22 11:18:46 -05:00

speculative.py

[Model Runner V2] Add probabilistic rejection sampling for spec decoding (#35461)

2026-03-11 14:04:32 -07:00

speech_to_text.py

[MM] Allow audio chunking for offline LLM (#34628)

2026-02-23 21:04:28 -08:00

structured_outputs.py

Remove unused disable_fallback field (#36546)

2026-03-09 20:56:54 -07:00

utils.py

[Misc] Add deprecated environment variable utilities (#33677)

2026-02-19 21:33:25 -08:00

vllm.py

[Frontend][Core] Revert "Add shutdown timeout" (#34730 and #36270) (#36628)

2026-03-10 06:20:41 -07:00

weight_transfer.py

[Feat][RL][2/2] Native Weight Syncing API: IPC (#34171)

2026-02-27 13:45:21 -07:00