Nicolò Lucchesi 9d43afcc53 [Feature] [Spec decode]: Combine chunked prefill with speculative decoding (#9291) ...

Signed-off-by: NickLucche <nlucches@redhat.com>

2024-11-07 08:15:14 -08:00

..

__init__.py

[Speculative decoding 6/9] Integrate speculative decoding with LLMEngine (#3894)

2024-04-16 13:09:21 -07:00

interfaces.py

[Bugfix] Fix incorrect updates to num_computed_tokens in multi-step scheduling (#9038)

2024-10-06 12:48:11 -07:00

multi_step.py

[Feature] [Spec decode]: Combine chunked prefill with speculative decoding (#9291)

2024-11-07 08:15:14 -08:00

single_step.py

[core] simplify seq group code (#9569)

2024-10-24 00:16:44 -07:00

stop_checker.py

[CI/Build] mypy: Resolve some errors from checking vllm/engine (#9267)

2024-10-16 22:55:59 +00:00

util.py

[CI/Build] mypy: Resolve some errors from checking vllm/engine (#9267)

2024-10-16 22:55:59 +00:00