Seiji Eicher e2b31243c0 [Docs] Update CacheConfig block_size docstring to remove inaccurate limit when using CUDA (#35632) ...

Signed-off-by: Seiji Eicher <seiji@anyscale.com>

2026-03-05 06:24:08 +00:00

..

__init__.py

[offloader] v2: Hide weight onloading latency via prefetching (#29941)

2026-02-25 17:20:59 -08:00

attention.py

[Misc] Add --attention-backend auto option (#35738)

2026-03-04 15:12:27 +00:00

cache.py

[Docs] Update CacheConfig block_size docstring to remove inaccurate limit when using CUDA (#35632)

2026-03-05 06:24:08 +00:00

compilation.py

[Misc] Remove deprecated items that are due for removal (#36006)

2026-03-05 06:14:50 +00:00

device.py

Turn @config into a dataclass_transform (#31541)

2026-02-03 17:40:59 +00:00

ec_transfer.py

[Misc] Introduce ec_both role EC (encoder cache) connector (#34182)

2026-02-10 18:55:35 +00:00

kernel.py

[UX] Add --moe-backend arg for explicit kernel selection (#33807)

2026-02-25 17:44:44 -08:00

kv_events.py

Turn @config into a dataclass_transform (#31541)

2026-02-03 17:40:59 +00:00

kv_transfer.py

[PD] Change kv_load_failure_policy Default from "recompute" to "fail" (#34896)

2026-02-21 01:34:57 -08:00

load.py

Turn @config into a dataclass_transform (#31541)

2026-02-03 17:40:59 +00:00

lora.py

Turn @config into a dataclass_transform (#31541)

2026-02-03 17:40:59 +00:00

model_arch.py

[Core] Parse vLLM engine required fields from hf_config to model_arch_config (#28454)

2026-01-02 15:13:15 -08:00

model.py

[Misc] Cleanup useless current_platform import (#35715)

2026-03-02 09:36:54 +00:00

multimodal.py

[Refactor] Simplify dummy data generation (#35025)

2026-02-22 20:55:27 -08:00

observability.py

[Feature] OTEL tracing during loading (#31162)

2026-02-05 16:59:28 -08:00

offload.py

[offloader] v2: Hide weight onloading latency via prefetching (#29941)

2026-02-25 17:20:59 -08:00

parallel.py

[CI] Bump mypy version (#34950)

2026-03-04 20:55:11 +00:00

pooler.py

[Refactor] Pass Renderer to Input Processor (#34329)

2026-02-11 19:38:11 -08:00

profiler.py

Add PyTorch profiler schedule support with warmup/active iterations (#35240)

2026-03-04 12:53:38 -08:00

scheduler.py

[Bug] Refactor max_num_batched_tokens to account for drafting (#34898)

2026-02-22 11:18:46 -05:00

speculative.py

[Spec Decode] Add hidden states extraction system (#33736)

2026-03-02 14:29:09 -05:00

speech_to_text.py

[MM] Allow audio chunking for offline LLM (#34628)

2026-02-23 21:04:28 -08:00

structured_outputs.py

Turn @config into a dataclass_transform (#31541)

2026-02-03 17:40:59 +00:00

utils.py

[Misc] Add deprecated environment variable utilities (#33677)

2026-02-19 21:33:25 -08:00

vllm.py

[Core] Add All-to-All communication backend for DCP (#34883)

2026-03-04 10:01:57 -05:00

weight_transfer.py

[Feat][RL][2/2] Native Weight Syncing API: IPC (#34171)

2026-02-27 13:45:21 -07:00