triangleXIV 7c94ae16c6 [BugFix] --max-model-len=-1 causes over-limit requests to hang and starve the entire service (#39102) ...

Signed-off-by: triangle14 <y1019026570@gmail.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: mgoin <mgoin64@gmail.com>

2026-04-08 14:03:17 -07:00

..

general

[BugFix] --max-model-len=-1 causes over-limit requests to hang and starve the entire service (#39102)

2026-04-08 14:03:17 -07:00

spec_decode

tests/v1/e2e/spec_decode: assert async scheduling is used (#39206)

2026-04-08 20:30:03 +00:00

__init__.py

[V1] Implement Cascade Attention (#11635)

2025-01-01 21:56:46 +09:00

test_hybrid_chunked_prefill.py

[ROCm][CI] Enable hybrid chunked prefill test (#38317)

2026-03-30 10:30:26 +08:00