Cody Yu f942efb5a3 [Dynamic Spec Decoding] Auto-disable by the running queue size (#4592) ...

Co-authored-by: Cade Daniel <edacih@gmail.com>

2024-05-08 21:44:00 +00:00

..

test_beam_search.py

[Test] Make model tests run again and remove --forked from pytest (#3631)

2024-03-28 21:06:40 -07:00

test_ignore_eos.py

[Test] Add ignore_eos test (#4519)

2024-05-01 08:45:42 -04:00

test_logits_processor.py

[Bugfix] Fix logits processor when prompt_logprobs is not None (#3899)

2024-04-10 00:09:36 -07:00

test_logprobs.py

[Core] Refactoring sampler and support prompt logprob for chunked prefill (#4309)

2024-04-26 13:02:02 +00:00

test_ranks.py

hotfix isort on logprobs ranks pr (#3622)

2024-03-25 11:55:46 -07:00

test_rejection_sampler.py

[Dynamic Spec Decoding] Auto-disable by the running queue size (#4592)

2024-05-08 21:44:00 +00:00

test_sampler.py

[Core][Model runner refactoring 1/N] Refactor attn metadata term (#4518)

2024-05-03 10:20:12 -07:00

test_seeded_generate.py

[Test] Make model tests run again and remove --forked from pytest (#3631)

2024-03-28 21:06:40 -07:00