Or Ozeri 525f2eeb0b [kv_offload+HMA][6/N]: Split offloading_connector.py (#37405) ...

Signed-off-by: Or Ozeri <oro@il.ibm.com>

2026-03-18 14:42:46 +01:00

..

__init__.py

[P/D] NIXL Integration (#17751)

2025-05-12 09:46:16 -07:00

test_backwards_compatibility.py

[1/N][Attention] Restructure attention: move files (#31916)

2026-01-09 13:10:24 -08:00

test_cache_pollution_prevention.py

[P/D] KV Load Failure Recovery/Abort Configuration (#26813)

2025-12-10 11:00:52 -08:00

test_config.py

[UX] Use kv_offloading_backend=native by default (#32421)

2026-01-15 18:55:11 +00:00

test_decode_bench_connector.py

[Refactor] Simplify BOS/EOS token handling (#34435)

2026-02-12 18:18:24 -08:00

test_error_propagation.py

[Perf] Optimize scheduler overhead for PD disaggregation, around 5% E2E perf improvement (#35781)

2026-03-10 21:25:30 -07:00

test_example_connector.py

[Hardware] Replace torch.cuda.device_count/current_device/set_device API (#36145)

2026-03-12 07:57:47 -07:00

test_flexkv_connector.py

[KV Connector] Support using FlexKV as KV Cache Offloading option. (#34328)

2026-03-12 00:46:20 -07:00

test_invalid_blocks_correctness.py

[Perf] Optimize scheduler overhead for PD disaggregation, around 5% E2E perf improvement (#35781)

2026-03-10 21:25:30 -07:00

test_kv_cache_layout.py

[Bugfix] Disable cross-layer KV cache for MLA attention backends (#37090)

2026-03-16 19:03:10 +02:00

test_kv_connector_lifecycle.py

[Bugfix][CI] fix typos (#34934)

2026-03-05 17:05:46 +00:00

test_kv_load_failure_recovery.py

[Perf] Optimize scheduler overhead for PD disaggregation, around 5% E2E perf improvement (#35781)

2026-03-10 21:25:30 -07:00

test_lmcache_connector.py

[Prefix Cache] Include lora_name in BlockStored event for deterministic KV-cache reconstruction (#27577)

2025-12-30 00:17:16 +00:00

test_lmcache_integration.py

[Refactor] Simplify BOS/EOS token handling (#34435)

2026-02-12 18:18:24 -08:00

test_moriio_connector.py

[CI][BugFix][MORI][AMD] Add transfer_id to kv transfer params for test (#37213)

2026-03-16 13:22:57 -07:00

test_multi_connector.py

[kv_offload+HMA][0/N]: Support block-level preemption handling (#34805)

2026-03-18 08:49:53 +02:00

test_nixl_connector_hma.py

[PD][Nixl] Add support for hybrid SSM-FA models (#36687)

2026-03-16 19:58:06 +01:00

test_nixl_connector.py

[NIXL][Bugfix] metrics & testing minor bug (#36051)

2026-03-18 14:39:14 +01:00

test_offloading_connector.py

[kv_offload+HMA][6/N]: Split offloading_connector.py (#37405)

2026-03-18 14:42:46 +01:00

test_output_aggregator.py

[Core] Simplify async KV output aggregation (#28327)

2025-11-09 09:44:13 -08:00

test_remote_decode_lifecycle.py

[Core][KVConnector] Support HMA+NixlConnector (#35758)

2026-03-06 08:51:21 +01:00

test_remote_prefill_lifecycle.py

[Perf] Optimize scheduler overhead for PD disaggregation, around 5% E2E perf improvement (#35781)

2026-03-10 21:25:30 -07:00

test_scheduler_kv_connector_override.py

Make KV connector metadata build overridable via plugin (#37336)

2026-03-17 21:29:06 +00:00

utils.py

[BugFix][kv_offload] Fix offloading decodes with async scheduling (#33881)

2026-03-11 20:43:40 +00:00