Isotr0py b8089195b4 [v1] Add fp32 support to v1 engine through flex attn (#19319) ...

Signed-off-by: Isotr0py <2037008807@qq.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>

2025-06-09 22:10:44 +08:00

..

core

[v1] Hybrid Memory Allocator (#17996)

2025-06-05 20:47:09 -07:00

e2e

[v1] Hybrid Memory Allocator (#17996)

2025-06-05 20:47:09 -07:00

engine

[Bugfix][Core] Update cancellation logic in generate() to handle Generator exits (#19225)

2025-06-06 20:17:54 +00:00

entrypoints

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

kv_connector

[BugFix] Fix MultiConnector test after HMA changes (#19291)

2025-06-06 20:16:24 +00:00

metrics

Fix ValueError: Missing value for tag key(s): model_name,engine. (#19113)

2025-06-04 17:10:45 +08:00

sample

[BugFix][V1] Fix memory profiling bug (#18974)

2025-06-07 10:34:51 -07:00

shutdown

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

spec_decode

[Bugfix] Fix EAGLE vocab embedding construction for Llama 70B (#19033)

2025-06-05 19:10:08 -07:00

structured_output

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

tpu

[BugFix] Fix tpu_model_runner block_id concatenation (#19228)

2025-06-06 16:28:17 -07:00

worker

[v1] Add fp32 support to v1 engine through flex attn (#19319)

2025-06-09 22:10:44 +08:00

__init__.py

[V1] AsyncLLM Implementation (#9826)

2024-11-11 23:05:38 +00:00

test_async_llm_dp.py

[Core] Raise when non-multi-instance DP clients target a DP rank (#19227)

2025-06-06 19:03:01 +08:00

test_metrics_reader.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

test_oracle.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

test_serial_utils.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00

test_utils.py

[Misc] Add SPDX-FileCopyrightText (#19100)

2025-06-03 11:20:17 -07:00