Wentao Ye 995dea1354 [Perf] Remove redundant device copies for CPU-only pooling token IDs, 48.9% E2E throughput improvement (#38139) ...

Signed-off-by: yewentao256 <zhyanwentao@126.com>

2026-03-29 18:12:50 +00:00

..

__init__.py

[V1] Adding min tokens/repetition/presence/frequence penalties to V1 sampler (#10681)

2024-12-26 19:02:58 +09:00

test_gpu_input_batch.py

[Perf] Remove redundant device copies for CPU-only pooling token IDs, 48.9% E2E throughput improvement (#38139)

2026-03-29 18:12:50 +00:00

test_gpu_model_runner_v2_eplb.py

[Feature] EPLB Support for GPU Model Runner v2 (#37488)

2026-03-25 08:16:39 -07:00

test_gpu_model_runner.py

[V0 Deprecation] Refactor kv cache from list to element (#37487)

2026-03-23 20:10:11 -07:00

test_gpu_profiler.py

Support custom URI schemes and trace handlers for profiler (#32393)

2026-01-22 09:45:40 -08:00

test_late_interaction_runner.py

[Perf] Optimize compute maxsim using batched version, 3.2% E2E throughput improvement (#36710)

2026-03-12 08:37:01 +08:00

test_mamba_utils.py

[Hybrid] calling get_mamba_groups() once at MambaCopyBuffers.create() (#37318)

2026-03-21 09:29:43 +00:00

test_utils.py

[V0 Deprecation] Refactor kv cache from list to element (#37487)

2026-03-23 20:10:11 -07:00

test_worker_memory_snapshot.py

[Hardware] Replace torch.cuda.device_count/current_device/set_device API (#36145)

2026-03-12 07:57:47 -07:00