[Misc] Set default value of seed to None (#14274)

Signed-off-by: மனோஜ்குமார் பழனிச்சாமி <smartmanoj42857@gmail.com>
This commit is contained in:
மனோஜ்குமார் பழனிச்சாமி
2025-03-07 16:10:01 +05:30
committed by GitHub
parent 05fb6718f0
commit cc10281498
9 changed files with 15 additions and 7 deletions

View File

@@ -25,7 +25,8 @@ llm = LLM(model="facebook/opt-125m",
tensor_parallel_size=2,
distributed_executor_backend="external_launcher",
gpu_memory_utilization=random.uniform(0.7, 0.9),
swap_space=random.randint(1, 4))
swap_space=random.randint(1, 4),
seed=0)
outputs = llm.generate(prompts, sampling_params)