[compile] Remove runner type from ignored caching factor list. (#33712)

Signed-off-by: zhxchen17 <zhxchen17@fb.com>
This commit is contained in:
Zhengxu Chen
2026-02-04 05:56:45 -05:00
committed by GitHub
parent bcd2f74c0d
commit a208439537

View File

@@ -105,8 +105,8 @@ class ModelConfig:
content for `model_name` tag in metrics output when `served_model_name` is
not specified."""
model_weights: str = ""
"""Original model weights path. Used when the model is pulled from object
storage (e.g., RunAI) to preserve the original URI while `model` points to
"""Original model weights path. Used when the model is pulled from object
storage (e.g., RunAI) to preserve the original URI while `model` points to
the local directory."""
runner: RunnerOption = "auto"
"""The type of model runner to use. Each vLLM instance only supports one
@@ -324,7 +324,6 @@ class ModelConfig:
the final hidden states.
"""
ignored_factors = {
"runner",
"convert",
"tokenizer",
"tokenizer_mode",