biondizzle/vllm
1
0
Fork 0
Code Issues Pull Requests Actions 2 Packages Projects Releases Wiki Activity
Files
4069db3f2e3fad65251ca5ed659c83ba48894ef2
vllm/vllm
History
roikoren755 4069db3f2e [Bugfix] Enable padded FP4 quantization (#25947) 
Signed-off-by: Roi Koren <roik@nvidia.com>
2025-10-09 10:59:41 -07:00
..
assets
Convert formatting to use ruff instead of yapf + isort (#26247)
2025-10-05 07:06:22 -07:00
attention
[Bugfix] Move current_platform import to avoid python import cache. (#16601)
2025-10-09 10:46:19 +00:00
benchmarks
[Bugfix] Fix SHM cache initialization (#26427)
2025-10-09 02:48:04 -07:00
compilation
Revert #26113 "[Frontend] CompilationConfig overhaul (#20283): deprecate use_inductor in favor of backend, simplify custom_ops" (#26472)
2025-10-09 05:43:55 -07:00
config
Upgrade Pydantic to v2.12.0 and remove hack for Python 3.13 (#26481)
2025-10-09 06:02:40 -07:00
device_allocator
Convert formatting to use ruff instead of yapf + isort (#26247)
2025-10-05 07:06:22 -07:00
distributed
[Attention] Implement universal BACKEND_MAP (#25900)
2025-10-08 12:00:25 -07:00
engine
[Bugfix] Fix SHM cache initialization (#26427)
2025-10-09 02:48:04 -07:00
entrypoints
[Bugfix] Fix SHM cache initialization (#26427)
2025-10-09 02:48:04 -07:00
executor
Fix per file ruff ignores related to simplification (#26259)
2025-10-05 20:31:53 +00:00
inputs
[Bugfix] Fix SHM cache initialization (#26427)
2025-10-09 02:48:04 -07:00
logging_utils
Convert formatting to use ruff instead of yapf + isort (#26247)
2025-10-05 07:06:22 -07:00
lora
[V0 deprecation] Remove QKVCrossParallelLinear implementation (#26475)
2025-10-09 10:52:27 +00:00
model_executor
[Model] Apply shared experts overlap optimization to all models with shared experts (#26145)
2025-10-09 11:31:04 -04:00
multimodal
[Misc] Move LRUCache into its own file (#26342)
2025-10-07 15:08:40 +00:00
platforms
Revert #26113 "[Frontend] CompilationConfig overhaul (#20283): deprecate use_inductor in favor of backend, simplify custom_ops" (#26472)
2025-10-09 05:43:55 -07:00
plugins
Remove Python 3.9 support ahead of PyTorch 2.9 in v0.11.1 (#26416)
2025-10-08 10:40:42 -07:00
profiler
Convert formatting to use ruff instead of yapf + isort (#26247)
2025-10-05 07:06:22 -07:00
ray
Convert formatting to use ruff instead of yapf + isort (#26247)
2025-10-05 07:06:22 -07:00
reasoning
Convert formatting to use ruff instead of yapf + isort (#26247)
2025-10-05 07:06:22 -07:00
third_party
fix some typos (#24071)
2025-09-02 20:44:50 -07:00
transformers_utils
[Feature] Enable E8M0 by Default on Hopper for DeepGEMM, 5% E2E throughput improvement (#26197)
2025-10-08 15:33:56 +08:00
triton_utils
Convert formatting to use ruff instead of yapf + isort (#26247)
2025-10-05 07:06:22 -07:00
usage
Convert formatting to use ruff instead of yapf + isort (#26247)
2025-10-05 07:06:22 -07:00
utils
[Bugfix] Enable padded FP4 quantization (#25947)
2025-10-09 10:59:41 -07:00
v1
[Attention][DCP] Support DCP with query length > 1 (MTP) with FA3 (#25049)
2025-10-09 08:06:29 -07:00
vllm_flash_attn
[BugFix] Fix vllm_flash_attn install issues (#17267)
2025-04-27 17:27:56 -07:00
__init__.py
Convert formatting to use ruff instead of yapf + isort (#26247)
2025-10-05 07:06:22 -07:00
_bc_linter.py
Convert formatting to use ruff instead of yapf + isort (#26247)
2025-10-05 07:06:22 -07:00
_custom_ops.py
[Bugfix] Enable padded FP4 quantization (#25947)
2025-10-09 10:59:41 -07:00
_ipex_ops.py
Convert formatting to use ruff instead of yapf + isort (#26247)
2025-10-05 07:06:22 -07:00
beam_search.py
Convert formatting to use ruff instead of yapf + isort (#26247)
2025-10-05 07:06:22 -07:00
collect_env.py
Convert formatting to use ruff instead of yapf + isort (#26247)
2025-10-05 07:06:22 -07:00
connections.py
Convert formatting to use ruff instead of yapf + isort (#26247)
2025-10-05 07:06:22 -07:00
env_override.py
Convert formatting to use ruff instead of yapf + isort (#26247)
2025-10-05 07:06:22 -07:00
envs.py
[Feature] Enable E8M0 by Default on Hopper for DeepGEMM, 5% E2E throughput improvement (#26197)
2025-10-08 15:33:56 +08:00
forward_context.py
[BUGFIX] Add cu_tokens_across_sp to DPMetadata (#26457)
2025-10-09 17:13:56 +00:00
logger.py
Convert formatting to use ruff instead of yapf + isort (#26247)
2025-10-05 07:06:22 -07:00
logits_process.py
Convert formatting to use ruff instead of yapf + isort (#26247)
2025-10-05 07:06:22 -07:00
logprobs.py
Convert formatting to use ruff instead of yapf + isort (#26247)
2025-10-05 07:06:22 -07:00
outputs.py
Convert formatting to use ruff instead of yapf + isort (#26247)
2025-10-05 07:06:22 -07:00
pooling_params.py
Convert formatting to use ruff instead of yapf + isort (#26247)
2025-10-05 07:06:22 -07:00
py.typed
Add py.typed so consumers of vLLM can get type checking (#1509)
2023-10-30 14:50:47 -07:00
sampling_params.py
Convert formatting to use ruff instead of yapf + isort (#26247)
2025-10-05 07:06:22 -07:00
scalar_type.py
[Feature][OCP MX] Support mxfp6 and mixed mxfp6-mxfp4 (#21166)
2025-10-07 09:35:26 -04:00
scripts.py
Convert formatting to use ruff instead of yapf + isort (#26247)
2025-10-05 07:06:22 -07:00
sequence.py
Convert formatting to use ruff instead of yapf + isort (#26247)
2025-10-05 07:06:22 -07:00
tasks.py
[V1] Get supported tasks from model runner instead of model config (#21585)
2025-07-25 05:36:45 -07:00
test_utils.py
Remove V0 Encoder-Decoder Support (#24907)
2025-09-15 21:17:14 -07:00
tracing.py
Convert formatting to use ruff instead of yapf + isort (#26247)
2025-10-05 07:06:22 -07:00
version.py
Convert formatting to use ruff instead of yapf + isort (#26247)
2025-10-05 07:06:22 -07:00