biondizzle/vllm
1
0
Fork 0
Code Issues Pull Requests Actions 2 Packages Projects Releases Wiki Activity
Files
3ee56e26be4cfddc17f7d2e5f38f15ab74ede1c2
vllm/vllm
History
Jee Jee Li 8fe7fc8634 [Quantization] Improve BitsAndBytesModelLoader (#20242) 
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
2025-06-30 18:22:09 +08:00
..
adapter_commons
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
assets
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
attention
Quick Fix by adding conditional import for flash_attn_varlen_func in flash_attn (#20143)
2025-06-27 05:48:13 +00:00
benchmarks
[Benchmark][Bug] Fix multiple bugs in bench and add args to spec_decode offline (#20083)
2025-06-25 22:06:27 -07:00
compilation
use .dev for version comparison with pytorch nightly release (#20031)
2025-06-24 21:52:16 +00:00
core
[Core] add remove_seq_from_computed_blocks_tracker to BlockSpaceManager (#19686)
2025-06-17 04:40:58 +00:00
device_allocator
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
distributed
[Refactor] Create a function util and cache the results for has_deepgemm, has_deepep, has_pplx (#20187)
2025-06-28 22:06:38 +00:00
engine
[Misc] Add type assertion of request_id for LLMEngine.add_request (#19700)
2025-06-27 22:47:36 -07:00
entrypoints
[Frontend] Generalize v1/audio/transcriptions endpoint (#20179)
2025-06-28 08:15:26 -07:00
executor
[Hardware][Intel GPU] Add v1 Intel GPU support with Flash attention backend. (#19560)
2025-06-26 09:27:18 -07:00
inputs
[Bugfix] Fix processor initialization in transformers 4.53.0 (#20244)
2025-06-30 10:16:16 +00:00
logging_utils
[BugFix] Don't catch BaseException when dumping execute_model errors (#19626)
2025-06-16 11:01:08 +00:00
lora
[CI] change spell checker from codespell to typos (#18711)
2025-06-11 19:57:10 -07:00
model_executor
[Quantization] Improve BitsAndBytesModelLoader (#20242)
2025-06-30 18:22:09 +08:00
multimodal
Move to a faster base64 implementation (#19984)
2025-06-24 20:33:51 -07:00
platforms
[Hardware][Intel GPU] Add v1 Intel GPU support with Flash attention backend. (#19560)
2025-06-26 09:27:18 -07:00
plugins
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
profiler
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
prompt_adapter
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
reasoning
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
spec_decode
[Core] Cast multimodal input in hf processor (#18862)
2025-06-03 20:24:56 -07:00
third_party
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
transformers_utils
[CI] change spell checker from codespell to typos (#18711)
2025-06-11 19:57:10 -07:00
triton_utils
[Chore] dedup logs (#19955)
2025-06-22 19:43:07 +00:00
usage
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
v1
[Misc] Fix import (#20233)
2025-06-29 20:34:54 -07:00
vllm_flash_attn
[BugFix] Fix vllm_flash_attn install issues (#17267)
2025-04-27 17:27:56 -07:00
worker
[Misc] add vllm_config in __init__ (#19866)
2025-06-21 23:10:46 -04:00
__init__.py
[Perf][CLI] Improve overall startup time (#19941)
2025-06-22 23:11:22 +00:00
_custom_ops.py
Fix num_token_padding support for static per-tensor scaled_fp8_quant (#20188)
2025-06-27 22:48:13 -07:00
_ipex_ops.py
[Hardware][Intel GPU] Add v1 Intel GPU support with Flash attention backend. (#19560)
2025-06-26 09:27:18 -07:00
beam_search.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
collect_env.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
config.py
[BugFix] Fix the incorrect func name in the comments. (config.py) (#20185)
2025-06-27 22:51:16 -07:00
connections.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
env_override.py
[Misc] Reduce warning message introduced in env_override (#19476)
2025-06-11 17:29:54 +08:00
envs.py
[Feature] add quick all reduce (#19744)
2025-06-26 20:54:24 -07:00
forward_context.py
[CUDA] Enable full cudagraph for FlashMLA (#18581)
2025-06-13 18:12:26 +00:00
jsontree.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
logger.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
logits_process.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
outputs.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
pooling_params.py
Support embedding models in V1 (#16188)
2025-06-18 21:36:33 -07:00
py.typed
Add py.typed so consumers of vLLM can get type checking (#1509)
2023-10-30 14:50:47 -07:00
sampling_params.py
[Frontend] Expose custom args in OpenAI APIs (#16862)
2025-06-18 17:41:11 -07:00
scalar_type.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
scripts.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
sequence.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
test_utils.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
tracing.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
utils.py
[Refactor] Create a function util and cache the results for has_deepgemm, has_deepep, has_pplx (#20187)
2025-06-28 22:06:38 +00:00
version.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00