PatchyTIS a6be75dbd2 [Core] NGram GPU Implementation compatible with Async Scheduler (#29184)

2026-03-07 13:51:37 -08:00

..

__init__.py

[offloader] v2: Hide weight onloading latency via prefetching (#29941)

2026-02-25 17:20:59 -08:00

attention.py

[Misc] Add --attention-backend auto option (#35738)

2026-03-04 15:12:27 +00:00

cache.py

[V0 Deprecation] Remove unused swap_space parameter (#36216)

2026-03-07 22:09:55 +08:00

compilation.py

[docs][torch.compile] Add fusions.md — kernel/operator fusion reference page (#35538)

2026-03-06 23:55:06 +00:00

device.py

Turn @config into a dataclass_transform (#31541)

2026-02-03 17:40:59 +00:00

ec_transfer.py

[Misc] Introduce ec_both role EC (encoder cache) connector (#34182)

2026-02-10 18:55:35 +00:00

kernel.py

[UX] Add --moe-backend arg for explicit kernel selection (#33807)

2026-02-25 17:44:44 -08:00

kv_events.py

Turn @config into a dataclass_transform (#31541)

2026-02-03 17:40:59 +00:00

kv_transfer.py

[PD] Change kv_load_failure_policy Default from "recompute" to "fail" (#34896)

2026-02-21 01:34:57 -08:00

load.py

Turn @config into a dataclass_transform (#31541)

2026-02-03 17:40:59 +00:00

lora.py

Turn @config into a dataclass_transform (#31541)

2026-02-03 17:40:59 +00:00

model_arch.py

[Core] Parse vLLM engine required fields from hf_config to model_arch_config (#28454)

2026-01-02 15:13:15 -08:00

model.py

[Bugfix] Fix Qwen-VL tokenizer implementation (#36140)

2026-03-05 08:07:19 -08:00

multimodal.py

[Refactor] Simplify dummy data generation (#35025)

2026-02-22 20:55:27 -08:00

observability.py

[Bugfix][CI] fix typos (#34934)

2026-03-05 17:05:46 +00:00

offload.py

[offloader] v2: Hide weight onloading latency via prefetching (#29941)

2026-02-25 17:20:59 -08:00

parallel.py

[Feature] Add --distributed-timeout-seconds CLI option (#36047)

2026-03-05 20:57:51 -08:00

pooler.py

[Refactor] Pass Renderer to Input Processor (#34329)

2026-02-11 19:38:11 -08:00

profiler.py

Add PyTorch profiler schedule support with warmup/active iterations (#35240)

2026-03-04 12:53:38 -08:00

scheduler.py

[Bug] Refactor max_num_batched_tokens to account for drafting (#34898)

2026-02-22 11:18:46 -05:00

speculative.py

[Core] NGram GPU Implementation compatible with Async Scheduler (#29184)

2026-03-07 13:51:37 -08:00

speech_to_text.py

[MM] Allow audio chunking for offline LLM (#34628)

2026-02-23 21:04:28 -08:00

structured_outputs.py

Turn @config into a dataclass_transform (#31541)

2026-02-03 17:40:59 +00:00

utils.py

[Misc] Add deprecated environment variable utilities (#33677)

2026-02-19 21:33:25 -08:00

vllm.py

[Core] NGram GPU Implementation compatible with Async Scheduler (#29184)

2026-03-07 13:51:37 -08:00

weight_transfer.py

[Feat][RL][2/2] Native Weight Syncing API: IPC (#34171)

2026-02-27 13:45:21 -07:00