biondizzle/vllm
1
0
Fork 0
Code Issues Pull Requests Actions 2 Packages Projects Releases Wiki Activity
6,768 Commits 2 Branches 140 Tags
6881107948c00a8564bc2fa85308f6fc2f065d64
Commit Graph

2 Commits

Author SHA1 Message Date
DefTruth
e82ee40de3 [Bugfix][Kernel] fix potential cuda graph broken for merge_attn_states kernel (#16693) 
Signed-off-by: DefTruth <qiustudent_r@163.com>
 2025-04-16 03:31:39 -07:00
DefTruth
e9528f6dc6 [Kernel] support merge_attn_states CUDA kernel, 3x speedup (#16173) 
Signed-off-by: DefTruth <qiustudent_r@163.com>
 2025-04-11 06:50:50 -06:00