Michael Goin 8ee90c83f8 Add --max-model-len auto to auto-fit context to available memory (#29431) ...

Signed-off-by: mgoin <mgoin64@gmail.com>

2025-12-23 21:37:14 -08:00

..

attention

Revert "[SM100] Enable fp8 compute for prefill MLA (#30746)" (#31197)

2025-12-22 18:15:33 -08:00

core

Add --max-model-len auto to auto-fit context to available memory (#29431)

2025-12-23 21:37:14 -08:00

cudagraph

Remove all2all backend envvar (#30363)

2025-12-18 19:46:28 +00:00

determinism

[Attention] Update tests to remove deprecated env vars (#30563)

2025-12-17 09:49:59 -08:00

distributed

[CI/Build][AMD] Skip tests in test_fusions_e2e and test_dbo_dp_ep_gsm8k that require non-existing imports for ROCm (#30417)

2025-12-12 00:24:20 +00:00

e2e

[ROCm][CI] Reduce Flakiness For test_async_scheduling Using ROCM_ATTN With FP32 (#30811)

2025-12-18 10:27:37 +08:00

ec_connector

[Misc] Introduce encode_*_url utility function (#31208)

2025-12-23 13:45:21 +00:00

engine

[Core] Add a random suffix to frontend-provided request IDs (#27987)

2025-12-23 13:05:39 -08:00

entrypoints

[Misc] Introduce encode_*_url utility function (#31208)

2025-12-23 13:45:21 +00:00

executor

[Core] Simplify async KV output aggregation (#28327)

2025-11-09 09:44:13 -08:00

kv_connector

[Core] Add a random suffix to frontend-provided request IDs (#27987)

2025-12-23 13:05:39 -08:00

kv_offload

[Attention] Update tests to remove deprecated env vars (#30563)

2025-12-17 09:49:59 -08:00

logits_processors

[ROCm][CI] Fix v1/logits_processors failure on ROCm (#29927)

2025-12-04 01:17:07 +08:00

metrics

[Metrics] Model FLOPs Utilization estimation (#30738)

2025-12-18 01:40:51 +00:00

sample

[BugFix] Fix logprobs with spec decode and modified logits (#30846)

2025-12-18 19:58:28 -08:00

shutdown

[Chore] Clean up pytorch helper functions in vllm.utils (#26908)

2025-10-18 09:48:22 -07:00

spec_decode

[SpecDecode] Simplified alternative padded-speculation acceptance rate fix (#29845)

2025-12-22 13:06:10 -08:00

structured_output

fix: Update json features supported by xGrammar (#30390)

2025-12-14 02:16:06 -08:00

tpu

[Misc] Introduce encode_*_url utility function (#31208)

2025-12-23 13:45:21 +00:00

tracing

Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)

2025-10-12 09:51:31 -07:00

worker

[Fix] uniform decode batch check (#30747)

2025-12-17 19:58:43 +08:00

__init__.py

[V1] AsyncLLM Implementation (#9826)

2024-11-11 23:05:38 +00:00

test_oracle.py

[V0 deprecation]clean up is_v1_supported_oracle (#28116)

2025-11-06 16:05:32 +08:00

test_outputs.py

[BugFix] Fix spec decoding max_tokens scheduling perf issue (#29542)

2025-11-28 20:52:23 +08:00

test_request.py

[Misc] Add SPDX-FileCopyrightText (#20428)

2025-07-04 07:40:42 +00:00

test_serial_utils.py

[Model] Move multimodal_cpu_fields definition to field config (#30181)

2025-12-06 13:40:02 +00:00

utils.py

Convert formatting to use ruff instead of yapf + isort (#26247)

2025-10-05 07:06:22 -07:00