Stephen Krider 1356df53bd [Kernel] Use flash-attn for decoding (#3648) ...

Co-authored-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
Co-authored-by: LiuXiaoxuanPKU <lilyliupku@gmail.com>

2024-05-13 15:50:33 -07:00

7.1 KiB

Raw Blame History

View Raw