Collin McCarthy 1031c84c36 Fix ambiguous num_blocks for hybrid attn mamba (#37236) ...

Signed-off-by: Collin McCarthy <cmccarthy@nvidia.com>
Signed-off-by: Netanel Haber <58652339+netanel-haber@users.noreply.github.com>
Co-authored-by: Netanel Haber <58652339+netanel-haber@users.noreply.github.com>

2026-03-30 11:09:45 +00:00

..

__init__.py

[V1] Adding min tokens/repetition/presence/frequence penalties to V1 sampler (#10681)

2024-12-26 19:02:58 +09:00

test_gpu_input_batch.py

[Perf] Remove redundant device copies for CPU-only pooling token IDs, 48.9% E2E throughput improvement (#38139)

2026-03-29 18:12:50 +00:00

test_gpu_model_runner_v2_eplb.py

[Feature] EPLB Support for GPU Model Runner v2 (#37488)

2026-03-25 08:16:39 -07:00

test_gpu_model_runner.py

Fix ambiguous num_blocks for hybrid attn mamba (#37236)

2026-03-30 11:09:45 +00:00

test_gpu_profiler.py

Support custom URI schemes and trace handlers for profiler (#32393)

2026-01-22 09:45:40 -08:00

test_late_interaction_runner.py

[Perf] Optimize compute maxsim using batched version, 3.2% E2E throughput improvement (#36710)

2026-03-12 08:37:01 +08:00

test_mamba_utils.py

[Hybrid] calling get_mamba_groups() once at MambaCopyBuffers.create() (#37318)

2026-03-21 09:29:43 +00:00

test_utils.py

[V0 Deprecation] Refactor kv cache from list to element (#37487)

2026-03-23 20:10:11 -07:00

test_worker_memory_snapshot.py

[Hardware] Replace torch.cuda.device_count/current_device/set_device API (#36145)

2026-03-12 07:57:47 -07:00