[Doc][Neuron] Update documentation for Neuron (#18868)

Signed-off-by: Elaine Zhao <elaineyz@amazon.com>
This commit is contained in:
aws-elaineyz
2025-05-28 19:44:01 -07:00
committed by GitHub
parent 8e882ffdc0
commit 1661a9c28f
4 changed files with 102 additions and 97 deletions

View File

@@ -380,7 +380,7 @@ class ModelConfig:
"""Initialize non-default neuron config or override default neuron config
that are specific to Neuron devices, this argument will be used to
configure the neuron config that can not be gathered from the vllm
arguments. e.g. `{"cast_logits_dtype": "bloat16"}`."""
arguments. e.g. `{"cast_logits_dtype": "bfloat16"}`."""
pooler_config: Optional["PoolerConfig"] = field(init=False)
"""Pooler config which controls the behaviour of output pooling in pooling
models."""