biondizzle/vllm
1
0
Fork 0
Code Issues Pull Requests Actions 2 Packages Projects Releases Wiki Activity
Files
4bdf7ac59338e00f2899fd72541d80d09a59e03c
vllm/vllm
History
Cyrus Leung 4bdf7ac593 [Bugfix] Fix SHM cache initialization (#26427) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
2025-10-09 02:48:04 -07:00
..
assets
Convert formatting to use ruff instead of yapf + isort (#26247)
2025-10-05 07:06:22 -07:00
attention
[Hybrid]: Decouple Kernel Block Size from KV Page Size (#24486)
2025-10-08 23:43:39 -07:00
benchmarks
[Bugfix] Fix SHM cache initialization (#26427)
2025-10-09 02:48:04 -07:00
compilation
[Frontend] CompilationConfig overhaul (#20283): deprecate use_inductor in favor of backend, simplify custom_ops (#26113)
2025-10-07 12:53:43 -07:00
config
[Feature] Use pydantic validation in lora.py and load.py configs (#26413)
2025-10-09 02:38:33 -07:00
device_allocator
Convert formatting to use ruff instead of yapf + isort (#26247)
2025-10-05 07:06:22 -07:00
distributed
[Attention] Implement universal BACKEND_MAP (#25900)
2025-10-08 12:00:25 -07:00
engine
[Bugfix] Fix SHM cache initialization (#26427)
2025-10-09 02:48:04 -07:00
entrypoints
[Bugfix] Fix SHM cache initialization (#26427)
2025-10-09 02:48:04 -07:00
executor
Fix per file ruff ignores related to simplification (#26259)
2025-10-05 20:31:53 +00:00
inputs
[Bugfix] Fix SHM cache initialization (#26427)
2025-10-09 02:48:04 -07:00
logging_utils
Convert formatting to use ruff instead of yapf + isort (#26247)
2025-10-05 07:06:22 -07:00
lora
[Misc] Move LRUCache into its own file (#26342)
2025-10-07 15:08:40 +00:00
model_executor
[torchao] Add support for ModuleFqnToConfig using regex (#26001)
2025-10-09 08:32:32 +00:00
multimodal
[Misc] Move LRUCache into its own file (#26342)
2025-10-07 15:08:40 +00:00
platforms
[Hybrid]: Decouple Kernel Block Size from KV Page Size (#24486)
2025-10-08 23:43:39 -07:00
plugins
Remove Python 3.9 support ahead of PyTorch 2.9 in v0.11.1 (#26416)
2025-10-08 10:40:42 -07:00
profiler
Convert formatting to use ruff instead of yapf + isort (#26247)
2025-10-05 07:06:22 -07:00
ray
Convert formatting to use ruff instead of yapf + isort (#26247)
2025-10-05 07:06:22 -07:00
reasoning
Convert formatting to use ruff instead of yapf + isort (#26247)
2025-10-05 07:06:22 -07:00
third_party
fix some typos (#24071)
2025-09-02 20:44:50 -07:00
transformers_utils
[Feature] Enable E8M0 by Default on Hopper for DeepGEMM, 5% E2E throughput improvement (#26197)
2025-10-08 15:33:56 +08:00
triton_utils
Convert formatting to use ruff instead of yapf + isort (#26247)
2025-10-05 07:06:22 -07:00
usage
Convert formatting to use ruff instead of yapf + isort (#26247)
2025-10-05 07:06:22 -07:00
utils
[Misc] Upgrade more code to Python 3.10 (#26463)
2025-10-09 10:43:53 +01:00
v1
[Bugfix] Fix SHM cache initialization (#26427)
2025-10-09 02:48:04 -07:00
vllm_flash_attn
[BugFix] Fix vllm_flash_attn install issues (#17267)
2025-04-27 17:27:56 -07:00
__init__.py
Convert formatting to use ruff instead of yapf + isort (#26247)
2025-10-05 07:06:22 -07:00
_bc_linter.py
Convert formatting to use ruff instead of yapf + isort (#26247)
2025-10-05 07:06:22 -07:00
_custom_ops.py
[Kernel] Centralize platform kernel import in current_platform.import_kernels (#26286)
2025-10-08 20:25:31 +00:00
_ipex_ops.py
Convert formatting to use ruff instead of yapf + isort (#26247)
2025-10-05 07:06:22 -07:00
beam_search.py
Convert formatting to use ruff instead of yapf + isort (#26247)
2025-10-05 07:06:22 -07:00
collect_env.py
Convert formatting to use ruff instead of yapf + isort (#26247)
2025-10-05 07:06:22 -07:00
connections.py
Convert formatting to use ruff instead of yapf + isort (#26247)
2025-10-05 07:06:22 -07:00
env_override.py
Convert formatting to use ruff instead of yapf + isort (#26247)
2025-10-05 07:06:22 -07:00
envs.py
[Feature] Enable E8M0 by Default on Hopper for DeepGEMM, 5% E2E throughput improvement (#26197)
2025-10-08 15:33:56 +08:00
forward_context.py
[Core] Simplify the Dp padding/should ubatch coordination logic (#25768)
2025-10-07 01:57:49 +00:00
logger.py
Convert formatting to use ruff instead of yapf + isort (#26247)
2025-10-05 07:06:22 -07:00
logits_process.py
Convert formatting to use ruff instead of yapf + isort (#26247)
2025-10-05 07:06:22 -07:00
logprobs.py
Convert formatting to use ruff instead of yapf + isort (#26247)
2025-10-05 07:06:22 -07:00
outputs.py
Convert formatting to use ruff instead of yapf + isort (#26247)
2025-10-05 07:06:22 -07:00
pooling_params.py
Convert formatting to use ruff instead of yapf + isort (#26247)
2025-10-05 07:06:22 -07:00
py.typed
Add py.typed so consumers of vLLM can get type checking (#1509)
2023-10-30 14:50:47 -07:00
sampling_params.py
Convert formatting to use ruff instead of yapf + isort (#26247)
2025-10-05 07:06:22 -07:00
scalar_type.py
[Feature][OCP MX] Support mxfp6 and mixed mxfp6-mxfp4 (#21166)
2025-10-07 09:35:26 -04:00
scripts.py
Convert formatting to use ruff instead of yapf + isort (#26247)
2025-10-05 07:06:22 -07:00
sequence.py
Convert formatting to use ruff instead of yapf + isort (#26247)
2025-10-05 07:06:22 -07:00
tasks.py
[V1] Get supported tasks from model runner instead of model config (#21585)
2025-07-25 05:36:45 -07:00
test_utils.py
Remove V0 Encoder-Decoder Support (#24907)
2025-09-15 21:17:14 -07:00
tracing.py
Convert formatting to use ruff instead of yapf + isort (#26247)
2025-10-05 07:06:22 -07:00
version.py
Convert formatting to use ruff instead of yapf + isort (#26247)
2025-10-05 07:06:22 -07:00