biondizzle/vllm
1
0
Fork 0
Code Issues Pull Requests Actions 2 Packages Projects Releases Wiki Activity
Files
1b86bd8e183138236415cc798f1beb3357e4f5eb
vllm/vllm
History
Benjamin Chislett 3d1f67616d [Spec Decode] Enable efficient speculative decoding with FlashInfer-MLA (#25984) 
Signed-off-by: Benjamin Chislett <bchislett@nvidia.com>
2025-10-07 16:05:59 -04:00
..
assets
Convert formatting to use ruff instead of yapf + isort (#26247)
2025-10-05 07:06:22 -07:00
attention
[ROCm] Split AITER unified attention into its own backend (#25507)
2025-10-06 22:49:23 +00:00
benchmarks
[Benchmark] Enable MM Embedding benchmarks (#26310)
2025-10-06 19:51:58 +00:00
compilation
[Frontend] CompilationConfig overhaul (#20283): deprecate use_inductor in favor of backend, simplify custom_ops (#26113)
2025-10-07 12:53:43 -07:00
config
[Frontend] CompilationConfig overhaul (#20283): deprecate use_inductor in favor of backend, simplify custom_ops (#26113)
2025-10-07 12:53:43 -07:00
device_allocator
Convert formatting to use ruff instead of yapf + isort (#26247)
2025-10-05 07:06:22 -07:00
distributed
Fix per file ruff ignores related to line length (#26262)
2025-10-06 05:12:40 +00:00
engine
[Core] Simplify the Dp padding/should ubatch coordination logic (#25768)
2025-10-07 01:57:49 +00:00
entrypoints
Optimize KV cache distribution for asymmetric pipeline parallelism (#25164)
2025-10-07 09:20:30 +00:00
executor
Fix per file ruff ignores related to simplification (#26259)
2025-10-05 20:31:53 +00:00
inputs
[Frontend] Consolidate tokenizer init code (#26276)
2025-10-06 09:34:52 +00:00
logging_utils
Convert formatting to use ruff instead of yapf + isort (#26247)
2025-10-05 07:06:22 -07:00
lora
[Misc] Move LRUCache into its own file (#26342)
2025-10-07 15:08:40 +00:00
model_executor
[Frontend] CompilationConfig overhaul (#20283): deprecate use_inductor in favor of backend, simplify custom_ops (#26113)
2025-10-07 12:53:43 -07:00
multimodal
[Misc] Move LRUCache into its own file (#26342)
2025-10-07 15:08:40 +00:00
platforms
[Frontend] CompilationConfig overhaul (#20283): deprecate use_inductor in favor of backend, simplify custom_ops (#26113)
2025-10-07 12:53:43 -07:00
plugins
Fix per file ruff ignores related to typing (#26254)
2025-10-05 16:37:55 +00:00
profiler
Convert formatting to use ruff instead of yapf + isort (#26247)
2025-10-05 07:06:22 -07:00
ray
Convert formatting to use ruff instead of yapf + isort (#26247)
2025-10-05 07:06:22 -07:00
reasoning
Convert formatting to use ruff instead of yapf + isort (#26247)
2025-10-05 07:06:22 -07:00
third_party
fix some typos (#24071)
2025-09-02 20:44:50 -07:00
transformers_utils
[Model] Lfm2Moe (#26344)
2025-10-07 16:03:05 +00:00
triton_utils
Convert formatting to use ruff instead of yapf + isort (#26247)
2025-10-05 07:06:22 -07:00
usage
Convert formatting to use ruff instead of yapf + isort (#26247)
2025-10-05 07:06:22 -07:00
utils
[Misc] Move LRUCache into its own file (#26342)
2025-10-07 15:08:40 +00:00
v1
[Spec Decode] Enable efficient speculative decoding with FlashInfer-MLA (#25984)
2025-10-07 16:05:59 -04:00
vllm_flash_attn
[BugFix] Fix vllm_flash_attn install issues (#17267)
2025-04-27 17:27:56 -07:00
__init__.py
Convert formatting to use ruff instead of yapf + isort (#26247)
2025-10-05 07:06:22 -07:00
_bc_linter.py
Convert formatting to use ruff instead of yapf + isort (#26247)
2025-10-05 07:06:22 -07:00
_custom_ops.py
Fix per file ruff ignores related to simplification (#26259)
2025-10-05 20:31:53 +00:00
_ipex_ops.py
Convert formatting to use ruff instead of yapf + isort (#26247)
2025-10-05 07:06:22 -07:00
beam_search.py
Convert formatting to use ruff instead of yapf + isort (#26247)
2025-10-05 07:06:22 -07:00
collect_env.py
Convert formatting to use ruff instead of yapf + isort (#26247)
2025-10-05 07:06:22 -07:00
connections.py
Convert formatting to use ruff instead of yapf + isort (#26247)
2025-10-05 07:06:22 -07:00
env_override.py
Convert formatting to use ruff instead of yapf + isort (#26247)
2025-10-05 07:06:22 -07:00
envs.py
[Core] Simplify the Dp padding/should ubatch coordination logic (#25768)
2025-10-07 01:57:49 +00:00
forward_context.py
[Core] Simplify the Dp padding/should ubatch coordination logic (#25768)
2025-10-07 01:57:49 +00:00
logger.py
Convert formatting to use ruff instead of yapf + isort (#26247)
2025-10-05 07:06:22 -07:00
logits_process.py
Convert formatting to use ruff instead of yapf + isort (#26247)
2025-10-05 07:06:22 -07:00
logprobs.py
Convert formatting to use ruff instead of yapf + isort (#26247)
2025-10-05 07:06:22 -07:00
outputs.py
Convert formatting to use ruff instead of yapf + isort (#26247)
2025-10-05 07:06:22 -07:00
pooling_params.py
Convert formatting to use ruff instead of yapf + isort (#26247)
2025-10-05 07:06:22 -07:00
py.typed
Add py.typed so consumers of vLLM can get type checking (#1509)
2023-10-30 14:50:47 -07:00
sampling_params.py
Convert formatting to use ruff instead of yapf + isort (#26247)
2025-10-05 07:06:22 -07:00
scalar_type.py
[Feature][OCP MX] Support mxfp6 and mixed mxfp6-mxfp4 (#21166)
2025-10-07 09:35:26 -04:00
scripts.py
Convert formatting to use ruff instead of yapf + isort (#26247)
2025-10-05 07:06:22 -07:00
sequence.py
Convert formatting to use ruff instead of yapf + isort (#26247)
2025-10-05 07:06:22 -07:00
tasks.py
[V1] Get supported tasks from model runner instead of model config (#21585)
2025-07-25 05:36:45 -07:00
test_utils.py
Remove V0 Encoder-Decoder Support (#24907)
2025-09-15 21:17:14 -07:00
tracing.py
Convert formatting to use ruff instead of yapf + isort (#26247)
2025-10-05 07:06:22 -07:00
version.py
Convert formatting to use ruff instead of yapf + isort (#26247)
2025-10-05 07:06:22 -07:00