Chen Zhang 3a5f0afcd2 [V1] Implement sliding window attention in kv_cache_manager (#14097) ...

Signed-off-by: Chen Zhang <zhangch99@outlook.com>

2025-04-01 00:33:17 -07:00

..

attention

[Kernel][TPU][ragged-paged-attn] vLLM code change for PR#8896 (#15659)

2025-03-28 21:13:15 -07:00

core

[V1] Implement sliding window attention in kv_cache_manager (#14097)

2025-04-01 00:33:17 -07:00

engine

[V1] Implement sliding window attention in kv_cache_manager (#14097)

2025-04-01 00:33:17 -07:00

executor

[V1] AsyncLLM data parallel (#13923)

2025-03-27 16:14:41 -07:00

metrics

[V1] AsyncLLM data parallel (#13923)

2025-03-27 16:14:41 -07:00

sample

[V1][Minor] Simplify rejection sampler's parse_output (#15741)

2025-03-29 09:25:17 -07:00

spec_decode

[V1][Spec Decode] Enable spec decode for top-p & top-k sampling (#15063)

2025-03-24 17:16:46 -07:00

stats

Update deprecated Python 3.8 typing (#13971)

2025-03-02 17:34:51 -08:00

structured_output

[Bugfix] Fix Mistral guided generation using xgrammar (#15704)

2025-03-29 20:20:19 -07:00

worker

[V1] Implement sliding window attention in kv_cache_manager (#14097)

2025-04-01 00:33:17 -07:00

__init__.py

[V1] AsyncLLM Implementation (#9826)

2024-11-11 23:05:38 +00:00

kv_cache_interface.py

[V1] Implement sliding window attention in kv_cache_manager (#14097)

2025-04-01 00:33:17 -07:00

outputs.py

[V1] Aggregate chunked prompt logprobs in model runner (#14875)

2025-03-24 12:27:57 -04:00

request.py

[V1][Scheduler] Avoid calling _try_schedule_encoder_inputs for every request (#15778)

2025-03-30 14:10:42 -07:00

serial_utils.py

[V1] [Feature] Collective RPC (#15444)

2025-03-29 03:39:14 -07:00

utils.py

[V1] AsyncLLM data parallel (#13923)

2025-03-27 16:14:41 -07:00