biondizzle/vllm
1
0
Fork 0
Code Issues Pull Requests Actions 2 Packages Projects Releases Wiki Activity
4,885 Commits 2 Branches 140 Tags
cf069aa8aa38a9003c254f8434a29ec6a3070b08
Commit Graph

1 Commits

Author SHA1 Message Date
Lingfan Yu
33170081f1 [Neuron][Kernel] Vectorize KV cache load in FlashPagedAttention to maximize DMA bandwidth (#13245) 
Signed-off-by: Lingfan Yu <lingfany@amazon.com>
 2025-02-20 17:45:45 -08:00