[NIXL][HeteroTP] Enable KV transfer from HND prefill to NHD decode (#26556)

Signed-off-by: Chendi Xue <chendi.xue@intel.com>
This commit is contained in:
Chendi.Xue
2025-10-14 04:46:05 -05:00
committed by GitHub
parent 74704d4553
commit 7e6edb1469
6 changed files with 150 additions and 5 deletions

View File

@@ -61,6 +61,9 @@ class KVTransferConfig:
"""The Python module path to dynamically load the KV connector from.
Only supported in V1."""
enable_permute_local_kv: bool = False
"""Experiment feature flag to enable HND to NHD KV Transfer"""
def compute_hash(self) -> str:
"""
WARNING: Whenever a new field is added to this config,