Zhuohan Li db09d4ad83 [FIX] Fix Alibi implementation in PagedAttention kernel (#945) ...

* [FIX] Fix Alibi implementation in PagedAttention kernel

* Fix test_attention

* Fix

---------

Co-authored-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
Co-authored-by: Oliver-ss <yuansongwx@outlook.com>

2023-09-07 15:53:14 -07:00

9.1 KiB

Raw Blame History

View Raw