Roberto L. Castro 580864d81e [Attention][Perf][Kernel] Replace torch.cat with vectorized CUDA kernel MLA query concat - DeepSeek-V3.2 (#34917) ...

Signed-off-by: LopezCastroRoberto <rocastro@redhat.com>
Signed-off-by: Roberto L. Castro <38211239+LopezCastroRoberto@users.noreply.github.com>

2026-03-09 09:50:36 -07:00

..

cpu

[Misc] Replace deprecated interface seed_everything (#33474)

2026-01-31 05:38:39 -08:00

deepgemm

[Hardware] Replace torch.cuda.synchronize() api with torch.accelerator.synchronize (#36085)

2026-03-05 10:36:39 +00:00

bench_concat_mla_q.py

[Attention][Perf][Kernel] Replace torch.cat with vectorized CUDA kernel MLA query concat - DeepSeek-V3.2 (#34917)

2026-03-09 09:50:36 -07:00

bench_cp_gather_fp8.py

[Attention][Perf] Optimize cp_gather_and_upconvert_fp8_kv_cache - DeepSeek-v3.2 (#35290)

2026-03-09 09:46:57 -07:00

benchmark_2d_silu_mul_fp8_quant.py

[Bugfix][CI] fix typos (#34934)

2026-03-05 17:05:46 +00:00

benchmark_activation.py

[Bugfix] Fix kernel benchmark (#33752)

2026-02-22 21:18:08 -08:00

benchmark_block_fp8_gemm.py

[Bugfix] Fix kernel benchmark (#33752)

2026-02-22 21:18:08 -08:00

benchmark_cutlass_moe_fp8.py

[Hardware] Replace torch.cuda.synchronize() api with torch.accelerator.synchronize (#36085)

2026-03-05 10:36:39 +00:00

benchmark_cutlass_moe_nvfp4.py

[Hardware] Replace torch.cuda.synchronize() api with torch.accelerator.synchronize (#36085)

2026-03-05 10:36:39 +00:00

benchmark_device_communicators.py

[Hardware] Replace torch.cuda.synchronize() api with torch.accelerator.synchronize (#36085)

2026-03-05 10:36:39 +00:00

benchmark_fp8_gemm.py

[Bugfix] Fix kernel benchmark (#33752)

2026-02-22 21:18:08 -08:00

benchmark_fused_collective.py

[Hardware] Replace torch.cuda.synchronize() api with torch.accelerator.synchronize (#36085)

2026-03-05 10:36:39 +00:00

benchmark_fused_topk.py

[Kernel] Add topk_sigmoid kernel (#31246)

2026-01-21 22:49:51 +00:00

benchmark_grouped_gemm_cutlass.py

[Hardware] Replace torch.cuda.synchronize() api with torch.accelerator.synchronize (#36085)

2026-03-05 10:36:39 +00:00

benchmark_int8_gemm.py

[Bugfix] Fix kernel benchmark (#33752)

2026-02-22 21:18:08 -08:00

benchmark_layernorm.py

[Hardware] Replace torch.cuda.synchronize() api with torch.accelerator.synchronize (#36085)

2026-03-05 10:36:39 +00:00

benchmark_lora.py

[Hardware] Replace torch.cuda.synchronize() api with torch.accelerator.synchronize (#36085)

2026-03-05 10:36:39 +00:00

benchmark_machete.py

[Refactor] Rename gptq_marlin to marlin to match MoE (#32952)

2026-01-23 16:48:12 -05:00

benchmark_marlin.py

[Quantization][Deprecation] Remove Marlin 24 (#32688)

2026-01-28 15:54:59 +00:00

benchmark_mla_k_concat.py

[Hardware] Replace torch.cuda.synchronize() api with torch.accelerator.synchronize (#36085)

2026-03-05 10:36:39 +00:00

benchmark_moe_align_block_size.py

[Kernel][MoE] optimize moe_align_block_size (#29642)

2025-12-07 01:58:47 -08:00

benchmark_moe_defaults.py

[Hardware] Replace torch.cuda.synchronize() api with torch.accelerator.synchronize (#36085)

2026-03-05 10:36:39 +00:00

benchmark_moe_permute_unpermute.py

[Hardware] Replace torch.cuda.synchronize() api with torch.accelerator.synchronize (#36085)

2026-03-05 10:36:39 +00:00

benchmark_moe.py

[Hardware] Replace torch.cuda.synchronize() api with torch.accelerator.synchronize (#36085)

2026-03-05 10:36:39 +00:00

benchmark_mrope.py

[Hardware] Replace torch.cuda.synchronize() api with torch.accelerator.synchronize (#36085)

2026-03-05 10:36:39 +00:00

benchmark_mxfp4_qutlass.py

[Bugfix] Fix kernel benchmark (#33752)

2026-02-22 21:18:08 -08:00

benchmark_nvfp4_gemm.py

[Bugfix] Fix kernel benchmark (#33752)

2026-02-22 21:18:08 -08:00

benchmark_nvfp4_quant.py

[Bugfix] Fix kernel benchmark (#33752)

2026-02-22 21:18:08 -08:00

benchmark_nvfp4_qutlass.py

[Bugfix] Fix kernel benchmark (#33752)

2026-02-22 21:18:08 -08:00

benchmark_paged_attention.py

[Hardware] Replace torch.cuda.synchronize() api with torch.accelerator.synchronize (#36085)

2026-03-05 10:36:39 +00:00

benchmark_per_token_group_quant.py

[Hardware] Replace torch.cuda.synchronize() api with torch.accelerator.synchronize (#36085)

2026-03-05 10:36:39 +00:00

benchmark_per_token_quant_fp8.py

[Bugfix] Fix kernel benchmark (#33752)

2026-02-22 21:18:08 -08:00

benchmark_quant.py

[Hardware] Replace torch.cuda.synchronize() api with torch.accelerator.synchronize (#36085)

2026-03-05 10:36:39 +00:00

benchmark_reshape_and_cache_flash.py

[Hardware] Replace torch.cuda.synchronize() api with torch.accelerator.synchronize (#36085)

2026-03-05 10:36:39 +00:00

benchmark_reshape_and_cache.py

[Hardware] Replace torch.cuda.synchronize() api with torch.accelerator.synchronize (#36085)

2026-03-05 10:36:39 +00:00

benchmark_rmsnorm.py

…

benchmark_rope.py

[Bugfix] Fix kernel benchmark (#33752)

2026-02-22 21:18:08 -08:00

benchmark_shapes.py

…

benchmark_silu_mul_fp8_quant.py

[Hardware] Replace torch.cuda.synchronize() api with torch.accelerator.synchronize (#36085)

2026-03-05 10:36:39 +00:00

benchmark_trtllm_decode_attention.py

[Hardware] Replace torch.cuda.synchronize() api with torch.accelerator.synchronize (#36085)

2026-03-05 10:36:39 +00:00

benchmark_trtllm_prefill_attention.py

[Hardware] Replace torch.cuda.synchronize() api with torch.accelerator.synchronize (#36085)

2026-03-05 10:36:39 +00:00

benchmark_w8a8_block_fp8.py

[Hardware] Replace torch.cuda.synchronize() api with torch.accelerator.synchronize (#36085)

2026-03-05 10:36:39 +00:00

graph_machete_bench.py

…

requirements.txt

…

utils.py

…

weight_shapes.py

…