zhaoyang-star 9090bf02e7 Support FP8-E5M2 KV Cache (#2279) ...

Co-authored-by: zhaoyang <zhao.yang16@zte.com.cn>
Co-authored-by: Zhuohan Li <zhuohan123@gmail.com>

2024-01-28 16:43:54 -08:00

19 KiB

Raw Blame History

View Raw