This website requires JavaScript.
Explore
Help
Register
Sign In
biondizzle
/
vllm
Watch
1
Star
0
Fork
0
You've already forked vllm
Code
Issues
Pull Requests
Actions
2
Packages
Projects
Releases
Wiki
Activity
Files
8437bae6ef47a690d18c72f0da02c7e5abe83866
vllm
/
vllm
/
spec_decode
History
Cade Daniel
8437bae6ef
[Speculative decoding 3/9] Worker which speculates, scores, and applies rejection sampling (
#3103
)
2024-03-08 23:32:46 -08:00
..
batch_expansion.py
[Speculative decoding 3/9] Worker which speculates, scores, and applies rejection sampling (
#3103
)
2024-03-08 23:32:46 -08:00
interfaces.py
[Speculative decoding 3/9] Worker which speculates, scores, and applies rejection sampling (
#3103
)
2024-03-08 23:32:46 -08:00
metrics.py
[Speculative decoding 3/9] Worker which speculates, scores, and applies rejection sampling (
#3103
)
2024-03-08 23:32:46 -08:00
multi_step_worker.py
[Speculative decoding 3/9] Worker which speculates, scores, and applies rejection sampling (
#3103
)
2024-03-08 23:32:46 -08:00
spec_decode_worker.py
[Speculative decoding 3/9] Worker which speculates, scores, and applies rejection sampling (
#3103
)
2024-03-08 23:32:46 -08:00
util.py
[Speculative decoding 3/9] Worker which speculates, scores, and applies rejection sampling (
#3103
)
2024-03-08 23:32:46 -08:00
