biondizzle/vllm
1
0
Fork 0
Code Issues Pull Requests Actions 2 Packages Projects Releases Wiki Activity
927 Commits 2 Branches 140 Tags
865732342b4e3b8a4ef38f28a2a5bdb87cf3f970
Commit Graph

2 Commits

Author SHA1 Message Date
youkaichao
8fe8386591 [Kernel] change benchmark script so that result can be directly used; tune moe kernel in A100/H100 with tp=2,4,8 (#3389) 2024-03-14 08:11:48 +00:00
Philipp Moritz
cfc15a1031 Optimize Triton MoE Kernel (#2979) 
Co-authored-by: Cade Daniel <edacih@gmail.com>
 2024-02-26 13:48:56 -08:00