biondizzle/vllm
1
0
Fork 0
Code Issues Pull Requests Actions 2 Packages Projects Releases Wiki Activity
Files
579d2e5458b19c442f48e0cba0ba71c5d4abf6ea
vllm/vllm
History
Tyler Michael Smith 579d2e5458 [WideEP][P/D] Add usage stats for DP+EP and KV Connector (#26836) 
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
2025-10-14 23:51:54 +00:00
..
assets
Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)
2025-10-12 09:51:31 -07:00
attention
remove attn output view kernel (#26680)
2025-10-14 22:53:10 +00:00
benchmarks
Add support for the /rerank endpoint in vllm bench serve (#26602)
2025-10-14 04:25:43 +00:00
compilation
[compile] Enable sequence parallelism for full cuda graph without specifying compile sizes (#26681)
2025-10-13 18:15:34 -07:00
config
use combo kernel to fuse qk-norm and qk-rope (#26682)
2025-10-14 09:40:59 -04:00
device_allocator
Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)
2025-10-12 09:51:31 -07:00
distributed
[NIXL][HeteroTP] Enable KV transfer from HND prefill to NHD decode (#26556)
2025-10-14 09:46:05 +00:00
engine
[Chore] Remove SupportsV0Only interface and update supported models docs (#26783)
2025-10-14 04:55:10 -07:00
entrypoints
[frontend][gptoss] Add per turn stats into Harmony Context (#25061)
2025-10-14 16:48:13 -07:00
executor
Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)
2025-10-12 09:51:31 -07:00
inputs
Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)
2025-10-12 09:51:31 -07:00
logging_utils
Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)
2025-10-12 09:51:31 -07:00
lora
Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)
2025-10-12 09:51:31 -07:00
model_executor
[CI Failure] Fix torchao dep failure for Quantization Test (#26824)
2025-10-14 16:41:43 -07:00
multimodal
[Model] Use merge_by_field_config for MM models (M-N) (#26710)
2025-10-14 01:27:01 +08:00
platforms
[Plugin] Make plugin group clear (#26757)
2025-10-14 07:49:59 +00:00
plugins
[Plugin] Make plugin group clear (#26757)
2025-10-14 07:49:59 +00:00
profiler
Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)
2025-10-12 09:51:31 -07:00
ray
Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)
2025-10-12 09:51:31 -07:00
reasoning
[Model] Add reasoning_parser and tool_parser for Ernie45 thinking (#25027)
2025-10-13 15:55:20 +08:00
third_party
fix some typos (#24071)
2025-09-02 20:44:50 -07:00
transformers_utils
[Model][0/N] Improve all pooling task | clean up (#25817)
2025-10-13 16:44:50 +08:00
triton_utils
Convert formatting to use ruff instead of yapf + isort (#26247)
2025-10-05 07:06:22 -07:00
usage
Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)
2025-10-12 09:51:31 -07:00
utils
[Log] Optimize Startup Log (#26601)
2025-10-14 02:06:57 +08:00
v1
[WideEP][P/D] Add usage stats for DP+EP and KV Connector (#26836)
2025-10-14 23:51:54 +00:00
vllm_flash_attn
[BugFix] Fix vllm_flash_attn install issues (#17267)
2025-04-27 17:27:56 -07:00
__init__.py
Convert formatting to use ruff instead of yapf + isort (#26247)
2025-10-05 07:06:22 -07:00
_bc_linter.py
Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)
2025-10-12 09:51:31 -07:00
_custom_ops.py
Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)
2025-10-12 09:51:31 -07:00
_ipex_ops.py
Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)
2025-10-12 09:51:31 -07:00
beam_search.py
Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)
2025-10-12 09:51:31 -07:00
collect_env.py
Convert formatting to use ruff instead of yapf + isort (#26247)
2025-10-05 07:06:22 -07:00
connections.py
Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)
2025-10-12 09:51:31 -07:00
env_override.py
Convert formatting to use ruff instead of yapf + isort (#26247)
2025-10-05 07:06:22 -07:00
envs.py
[Perf] Cache vllm.env.__getattr__ result to avoid recomputation (#26146)
2025-10-14 17:03:21 -04:00
forward_context.py
Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)
2025-10-12 09:51:31 -07:00
logger.py
Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)
2025-10-12 09:51:31 -07:00
logits_process.py
Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)
2025-10-12 09:51:31 -07:00
logprobs.py
Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)
2025-10-12 09:51:31 -07:00
outputs.py
Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)
2025-10-12 09:51:31 -07:00
pooling_params.py
Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)
2025-10-12 09:51:31 -07:00
py.typed
Add py.typed so consumers of vLLM can get type checking (#1509)
2023-10-30 14:50:47 -07:00
sampling_params.py
Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)
2025-10-12 09:51:31 -07:00
scalar_type.py
Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)
2025-10-12 09:51:31 -07:00
scripts.py
Convert formatting to use ruff instead of yapf + isort (#26247)
2025-10-05 07:06:22 -07:00
sequence.py
Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)
2025-10-12 09:51:31 -07:00
tasks.py
[V1] Get supported tasks from model runner instead of model config (#21585)
2025-07-25 05:36:45 -07:00
test_utils.py
Remove V0 Encoder-Decoder Support (#24907)
2025-09-15 21:17:14 -07:00
tracing.py
Update Optional[x] -> x | None and Union[x, y] to x | y (#26633)
2025-10-12 09:51:31 -07:00
version.py
Convert formatting to use ruff instead of yapf + isort (#26247)
2025-10-05 07:06:22 -07:00