biondizzle/vllm
1
0
Fork 0
Code Issues Pull Requests Actions 2 Packages Projects Releases Wiki Activity
4,866 Commits 2 Branches 140 Tags
e7bd944e08c97b43b9f7a9b837c4e18e30f33c7e
Commit Graph

1 Commits

Author SHA1 Message Date
Lingfan Yu
33170081f1 [Neuron][Kernel] Vectorize KV cache load in FlashPagedAttention to maximize DMA bandwidth (#13245) 
Signed-off-by: Lingfan Yu <lingfany@amazon.com>
 2025-02-20 17:45:45 -08:00