biondizzle/vllm
1
0
Fork 0
Code Issues Pull Requests Actions 2 Packages Projects Releases Wiki Activity
Files
09b95e36abbce747b52b9c3e7ae4cceaf40076ad
vllm/vllm
History
youkaichao 09b95e36ab [torch.compile] PyTorch 2.6 and nightly compatibility (#12393) 
Signed-off-by: youkaichao <youkaichao@gmail.com>
2025-02-07 01:09:07 +08:00
..
adapter_commons
[Misc] Add SPDX-License-Identifier headers to python source files (#12628)
2025-02-02 11:58:18 -08:00
assets
[Misc] Add SPDX-License-Identifier headers to python source files (#12628)
2025-02-02 11:58:18 -08:00
attention
[Kernel] Make rotary_embedding ops more flexible with input shape (#12777)
2025-02-06 08:46:13 -08:00
compilation
[torch.compile] PyTorch 2.6 and nightly compatibility (#12393)
2025-02-07 01:09:07 +08:00
core
[Core] Improve hash collision avoidance in prefix caching (#12621)
2025-02-03 16:28:20 -08:00
device_allocator
[Misc] Add SPDX-License-Identifier headers to python source files (#12628)
2025-02-02 11:58:18 -08:00
distributed
[Bugfix] Fix 'ModuleNotFoundError: No module named 'intel_extension_for_pytorch'' for --tensor-parallel-size more than 1 (#12546)
2025-02-04 23:11:02 -08:00
engine
[Model]: Add transformers backend support (#11330)
2025-02-03 21:30:38 +08:00
entrypoints
[VLM] Qwen2.5-VL
2025-02-05 13:31:38 -08:00
executor
[core][distributed] exact ray placement control (#12732)
2025-02-06 02:03:19 +08:00
inputs
[Misc] Remove unnecessary decode call (#12833)
2025-02-06 08:45:44 -08:00
logging_utils
[Misc] Add SPDX-License-Identifier headers to python source files (#12628)
2025-02-02 11:58:18 -08:00
lora
[Misc] Add SPDX-License-Identifier headers to python source files (#12628)
2025-02-02 11:58:18 -08:00
model_executor
[Kernel] Make rotary_embedding ops more flexible with input shape (#12777)
2025-02-06 08:46:13 -08:00
multimodal
[VLM] Update compatibility with transformers 4.49
2025-02-05 19:09:45 -08:00
platforms
[Misc] Improve error message for incorrect pynvml (#12809)
2025-02-06 15:23:50 +08:00
plugins
[Misc] Add SPDX-License-Identifier headers to python source files (#12628)
2025-02-02 11:58:18 -08:00
profiler
[Misc] Add SPDX-License-Identifier headers to python source files (#12628)
2025-02-02 11:58:18 -08:00
prompt_adapter
[Misc] Add SPDX-License-Identifier headers to python source files (#12628)
2025-02-02 11:58:18 -08:00
spec_decode
[Misc] Add SPDX-License-Identifier headers to python source files (#12628)
2025-02-02 11:58:18 -08:00
transformers_utils
[misc] Reduce number of config file requests to HuggingFace (#12797)
2025-02-06 14:59:18 +00:00
triton_utils
[Misc] Add SPDX-License-Identifier headers to python source files (#12628)
2025-02-02 11:58:18 -08:00
usage
[Misc] Add SPDX-License-Identifier headers to python source files (#12628)
2025-02-02 11:58:18 -08:00
v1
[Attention] Use FA3 for MLA on Hopper (#12807)
2025-02-06 11:43:12 +00:00
vllm_flash_attn
[ci][build] fix vllm-flash-attn (#8699)
2024-09-21 23:24:58 -07:00
worker
[VLM] Qwen2.5-VL
2025-02-05 13:31:38 -08:00
__init__.py
[Misc] Add SPDX-License-Identifier headers to python source files (#12628)
2025-02-02 11:58:18 -08:00
_custom_ops.py
[Perf] Mem align KV caches for CUDA devices (MLA perf improvement) (#12676)
2025-02-04 18:22:24 -08:00
_ipex_ops.py
[Misc] Add SPDX-License-Identifier headers to python source files (#12628)
2025-02-02 11:58:18 -08:00
beam_search.py
[Misc] Add SPDX-License-Identifier headers to python source files (#12628)
2025-02-02 11:58:18 -08:00
config.py
[torch.compile] PyTorch 2.6 and nightly compatibility (#12393)
2025-02-07 01:09:07 +08:00
connections.py
[Misc] Add SPDX-License-Identifier headers to python source files (#12628)
2025-02-02 11:58:18 -08:00
envs.py
[core][distributed] exact ray placement control (#12732)
2025-02-06 02:03:19 +08:00
forward_context.py
[Misc] Add SPDX-License-Identifier headers to python source files (#12628)
2025-02-02 11:58:18 -08:00
logger.py
[Misc] Add SPDX-License-Identifier headers to python source files (#12628)
2025-02-02 11:58:18 -08:00
logits_process.py
[Misc] Add SPDX-License-Identifier headers to python source files (#12628)
2025-02-02 11:58:18 -08:00
outputs.py
[Misc] Add SPDX-License-Identifier headers to python source files (#12628)
2025-02-02 11:58:18 -08:00
pooling_params.py
[Misc] Add SPDX-License-Identifier headers to python source files (#12628)
2025-02-02 11:58:18 -08:00
py.typed
Add py.typed so consumers of vLLM can get type checking (#1509)
2023-10-30 14:50:47 -07:00
sampling_params.py
[Misc] Add SPDX-License-Identifier headers to python source files (#12628)
2025-02-02 11:58:18 -08:00
scalar_type.py
[Misc] Add SPDX-License-Identifier headers to python source files (#12628)
2025-02-02 11:58:18 -08:00
scripts.py
[Misc] Add SPDX-License-Identifier headers to python source files (#12628)
2025-02-02 11:58:18 -08:00
sequence.py
[Misc] Add SPDX-License-Identifier headers to python source files (#12628)
2025-02-02 11:58:18 -08:00
tracing.py
[Misc] Add SPDX-License-Identifier headers to python source files (#12628)
2025-02-02 11:58:18 -08:00
utils.py
[Perf] Mem align KV caches for CUDA devices (MLA perf improvement) (#12676)
2025-02-04 18:22:24 -08:00
version.py
[Misc] Add SPDX-License-Identifier headers to python source files (#12628)
2025-02-02 11:58:18 -08:00