Nicolò Lucchesi f5c081d432 [PD][Nixl] Add support for hybrid SSM-FA models (#36687)

2026-03-16 19:58:06 +01:00

..

__init__.py

[P/D] NIXL Integration (#17751)

2025-05-12 09:46:16 -07:00

test_backwards_compatibility.py

[1/N][Attention] Restructure attention: move files (#31916)

2026-01-09 13:10:24 -08:00

test_cache_pollution_prevention.py

[P/D] KV Load Failure Recovery/Abort Configuration (#26813)

2025-12-10 11:00:52 -08:00

test_config.py

[UX] Use kv_offloading_backend=native by default (#32421)

2026-01-15 18:55:11 +00:00

test_decode_bench_connector.py

[Refactor] Simplify BOS/EOS token handling (#34435)

2026-02-12 18:18:24 -08:00

test_error_propagation.py

[Perf] Optimize scheduler overhead for PD disaggregation, around 5% E2E perf improvement (#35781)

2026-03-10 21:25:30 -07:00

test_example_connector.py

[Hardware] Replace torch.cuda.device_count/current_device/set_device API (#36145)

2026-03-12 07:57:47 -07:00

test_flexkv_connector.py

[KV Connector] Support using FlexKV as KV Cache Offloading option. (#34328)

2026-03-12 00:46:20 -07:00

test_invalid_blocks_correctness.py

[Perf] Optimize scheduler overhead for PD disaggregation, around 5% E2E perf improvement (#35781)

2026-03-10 21:25:30 -07:00

test_kv_cache_layout.py

[Bugfix] Disable cross-layer KV cache for MLA attention backends (#37090)

2026-03-16 19:03:10 +02:00

test_kv_connector_lifecycle.py

[Bugfix][CI] fix typos (#34934)

2026-03-05 17:05:46 +00:00

test_kv_load_failure_recovery.py

[Perf] Optimize scheduler overhead for PD disaggregation, around 5% E2E perf improvement (#35781)

2026-03-10 21:25:30 -07:00

test_lmcache_connector.py

[Prefix Cache] Include lora_name in BlockStored event for deterministic KV-cache reconstruction (#27577)

2025-12-30 00:17:16 +00:00

test_lmcache_integration.py

[Refactor] Simplify BOS/EOS token handling (#34435)

2026-02-12 18:18:24 -08:00

test_moriio_connector.py

[V0 Deprecation] Remove unused swap_space parameter (#36216)

2026-03-07 22:09:55 +08:00

test_multi_connector.py

[KVConnector] Support worker -> scheduler metadata (#31964)

2026-03-11 17:36:37 +00:00

test_nixl_connector_hma.py

[PD][Nixl] Add support for hybrid SSM-FA models (#36687)

2026-03-16 19:58:06 +01:00

test_nixl_connector.py

[PD][Nixl] Add support for hybrid SSM-FA models (#36687)

2026-03-16 19:58:06 +01:00

test_offloading_connector.py

[kv_offload+HMA][1/N]: Support multiple KV groups in OffloadingSpec (#36610)

2026-03-13 08:04:21 +00:00

test_output_aggregator.py

[Core] Simplify async KV output aggregation (#28327)

2025-11-09 09:44:13 -08:00

test_remote_decode_lifecycle.py

[Core][KVConnector] Support HMA+NixlConnector (#35758)

2026-03-06 08:51:21 +01:00

test_remote_prefill_lifecycle.py

[Perf] Optimize scheduler overhead for PD disaggregation, around 5% E2E perf improvement (#35781)

2026-03-10 21:25:30 -07:00

utils.py

[BugFix][kv_offload] Fix offloading decodes with async scheduling (#33881)

2026-03-11 20:43:40 +00:00