Flex Wang 18445edd0f [Misc] Change buckets of histogram_iteration_tokens to [1, 8, 16, 32, 64, 128, 256, 512, 1024, 2048, 4096, 8096] to represent number of tokens (#17033) ...

Signed-off-by: sfc-gh-zhwang <flex.wang@snowflake.com>

2025-04-27 12:30:53 +00:00

..

multiprocessing

Simplify TokenizerGroup (#16790)

2025-04-24 04:43:56 -07:00

output_processor

[Bugfix] fix error due to an uninitialized tokenizer when using skip_tokenizer_init with num_scheduler_steps (#9276)

2025-04-26 11:51:17 -04:00

__init__.py

Change the name to vLLM (#150)

2023-06-17 03:07:40 -07:00

arg_utils.py

[AMD][FP8][BugFix] Remove V1 check in arg_utils.py for FP8 since it is not necessary (#17215)

2025-04-25 19:55:05 -07:00

async_llm_engine.py

Add collective_rpc to llm engine (#16999)

2025-04-24 20:16:52 +00:00

async_timeout.py

[Misc] Add SPDX-License-Identifier headers to python source files (#12628)

2025-02-02 11:58:18 -08:00

llm_engine.py

Simplify TokenizerGroup (#16790)

2025-04-24 04:43:56 -07:00

metrics_types.py

[V1][Metrics] Support vllm:cache_config_info (#13299)

2025-02-22 00:20:00 -08:00

metrics.py

[Misc] Change buckets of histogram_iteration_tokens to [1, 8, 16, 32, 64, 128, 256, 512, 1024, 2048, 4096, 8096] to represent number of tokens (#17033)

2025-04-27 12:30:53 +00:00

protocol.py

Add "/server_info" endpoint in api_server to retrieve the vllm_config.  (#16572)

2025-04-15 11:50:38 +00:00