Benjamin Chislett f7008ce1c4 [Perf] Async Scheduling + Speculative Decoding + Structured Outputs (#29821) ...

Signed-off-by: Benjamin Chislett <bchislett@nvidia.com>
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>

2026-01-06 18:50:37 +00:00

..

__init__.py

[V1] Implement Cascade Attention (#11635)

2025-01-01 21:56:46 +09:00

test_async_scheduling.py

[Perf] Async Scheduling + Speculative Decoding + Structured Outputs (#29821)

2026-01-06 18:50:37 +00:00

test_async_spec_decode.py

[Attention] Make seq_lens_cpu optional in CommonAttentionMetadata to enable true async spec-decode (#29624)

2025-12-09 17:18:10 -08:00

test_cascade_attention.py

[Attention] Update tests to remove deprecated env vars (#30563)

2025-12-17 09:49:59 -08:00

test_context_length.py

[Bugfix] Fix validate model input for decoder models (#27099)

2025-11-13 10:18:47 -08:00

test_correctness_sliding_window.py

[CI][ROCm] Fix test_correctness_sliding_window (#29243)

2025-12-02 04:53:27 +00:00

test_kv_sharing_fast_prefill.py

[CI][ROCm][tests/v1/e2e] Fix multiprocessing launch for the test (#29123)

2025-12-02 20:46:10 +00:00

test_lora_with_spec_decode.py

[Misc] remove useless v1 env (#29164)

2025-11-21 01:41:20 -08:00

test_min_tokens.py

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)

2025-10-12 09:51:31 -07:00

test_pooling_chunked_prefill.py

Add tests for chunked prefill and prefix cache with causal pooling models (#26526)

2025-10-14 07:45:04 +08:00

test_spec_decode.py

[Attention] Update tests to remove deprecated env vars (#30563)

2025-12-17 09:49:59 -08:00