biondizzle/vllm
1
0
Fork 0
Code Issues Pull Requests Actions 2 Packages Projects Releases Wiki Activity
4,791 Commits 2 Branches 140 Tags
2f42a4888cacc979bc542b77b43b8c1a7ea4e76e
Commit Graph

1 Commits

Author SHA1 Message Date
Lingfan Yu
33170081f1 [Neuron][Kernel] Vectorize KV cache load in FlashPagedAttention to maximize DMA bandwidth (#13245) 
Signed-off-by: Lingfan Yu <lingfany@amazon.com>
 2025-02-20 17:45:45 -08:00