Woosuk Kwon 189ae23133 Use dtype from model config & Add Dolly V2 (#63)

2023-05-04 03:05:37 -07:00

..

block_manager.py

Support various block sizes & Change default block size to 16 (#38)

2023-04-15 09:03:24 -07:00

policy.py

Implement preemption via recomputation & Refactor scheduling logic (#12)

2023-03-30 14:51:46 -07:00

scheduler.py

Support various block sizes & Change default block size to 16 (#38)

2023-04-15 09:03:24 -07:00

server.py

Use dtype from model config & Add Dolly V2 (#63)

2023-05-04 03:05:37 -07:00

simple_frontend.py

Collect system stats in scheduler & Add scripts for experiments (#30)

2023-04-12 15:03:49 -07:00