Antoni Baum 22de45235c Push logprob generation to LLMEngine (#3065) ...

Co-authored-by: Avnish Narayan <avnish@anyscale.com>

2024-03-04 19:54:06 +00:00

..

__init__.py

[Speculative decoding 2/9] Multi-step worker for draft model (#2424)

2024-01-21 16:31:47 -08:00

test_multi_step_worker.py

[Speculative decoding 2/9] Multi-step worker for draft model (#2424)

2024-01-21 16:31:47 -08:00

utils.py

Push logprob generation to LLMEngine (#3065)

2024-03-04 19:54:06 +00:00