Isotr0py b952f4d3c3 [v1] Add PrefixLM support to FlexAttention backend (#27938) ...

Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>

2025-12-07 15:51:36 +00:00

..

__init__.py

Revert "[Renderer] Separate out RendererConfig from ModelConfig (#30145)" (#30199)

2025-12-07 00:00:22 -08:00

attention.py

[Attention][UX][1/N] Add AttentionConfig and change attention env vars to CLI arguments (#26315)

2025-12-05 09:48:43 -08:00

cache.py

[Frontend][Model] Add 'float16' to possible mamba cache dtype values, override mamba SSM cache dtype value for NemotronH (#29978)

2025-12-05 00:34:33 -08:00

compilation.py

[Perf] Enable cuda graph for deepepHT, 5.3% throughput improvement, 4.4% TTFT improvement (#29558)

2025-12-07 04:44:50 +00:00

device.py

[Misc] Add backup hash algorithm for FIPS constrained environments (#28795)

2025-11-26 00:50:22 +00:00

ec_transfer.py

[Core] Encoder separation for Encode-Prefill-Decode Disaggregation (#25233)

2025-11-11 18:58:33 -08:00

kv_events.py

[Feature] publisher default set zmq in kv_event config (#26915)

2025-10-22 19:19:33 +00:00

kv_transfer.py

[Misc] Add backup hash algorithm for FIPS constrained environments (#28795)

2025-11-26 00:50:22 +00:00

load.py

[Misc] Add backup hash algorithm for FIPS constrained environments (#28795)

2025-11-26 00:50:22 +00:00

lora.py

[Misc] Add backup hash algorithm for FIPS constrained environments (#28795)

2025-11-26 00:50:22 +00:00

model.py

[v1] Add PrefixLM support to FlexAttention backend (#27938)

2025-12-07 15:51:36 +00:00

multimodal.py

Revert "[Renderer] Separate out RendererConfig from ModelConfig (#30145)" (#30199)

2025-12-07 00:00:22 -08:00

observability.py

[Feature] Add Layer-wise NVTX Support (#29990)

2025-12-05 11:20:07 +00:00

parallel.py

Better error when world size is larger than node and distributed_executor_backend is not set (#30140)

2025-12-05 20:53:52 -08:00

pooler.py

Improve enable chunked_prefill & prefix_caching logic. (#26623)

2025-11-27 22:05:48 -08:00

scheduler.py

Remove default values from InitVars so that they're not stored (#29859)

2025-12-02 12:16:37 +00:00

speculative.py

Revert "[Renderer] Separate out RendererConfig from ModelConfig (#30145)" (#30199)

2025-12-07 00:00:22 -08:00

speech_to_text.py

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)

2025-10-12 09:51:31 -07:00

structured_outputs.py

Reduce validation to a warning (#28749)

2025-12-05 14:02:49 +00:00

utils.py

[Compile] Conditional compilation. Introduce compile_ranges (#24252)

2025-12-05 18:17:32 +00:00

vllm.py

Revert "[Renderer] Separate out RendererConfig from ModelConfig (#30145)" (#30199)

2025-12-07 00:00:22 -08:00