biondizzle/vllm
1
0
Fork 0
Code Issues Pull Requests Actions 2 Packages Projects Releases Wiki Activity
Files
2e3e3c86dc5d14d0ee8f782f5caedc9b999a63c7
vllm/vllm
History
Vlad Tiberiu Mihailescu 2e3e3c86dc Export NaNs in logits to scheduler_stats if output is corrupted (#18777) 
Signed-off-by: Vlad Mihailescu <vtmihailescu@gmail.com>
2025-06-20 22:47:16 +08:00
..
adapter_commons
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
assets
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
attention
[Kernel] correct cpu worker function parameter type (#19745)
2025-06-20 10:50:13 +00:00
benchmarks
[Benchmark] Fix Value of type "SampleRequest" is not indexable (#18032)
2025-06-19 21:28:55 -07:00
compilation
[BugFix] Fix use_cudagraph=False (#19612)
2025-06-19 08:23:12 +08:00
core
[Core] add remove_seq_from_computed_blocks_tracker to BlockSpaceManager (#19686)
2025-06-17 04:40:58 +00:00
device_allocator
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
distributed
[V1][P/D] An native implementation of xPyD based on P2P NCCL (#18242)
2025-06-18 06:32:36 +00:00
engine
[Core][Bugfix] Fix Online MM Beam Search (#19688)
2025-06-19 17:18:07 +00:00
entrypoints
[Fix] import regex instead of re (#19875)
2025-06-20 11:16:48 +00:00
executor
[Bugfix] fix RAY_CGRAPH_get_timeout is not set successfully (#19725)
2025-06-18 10:26:16 -07:00
inputs
[Bugfix] Fix auto dtype casting for BatchFeature (#19316)
2025-06-14 15:13:08 +00:00
logging_utils
[BugFix] Don't catch BaseException when dumping execute_model errors (#19626)
2025-06-16 11:01:08 +00:00
lora
[CI] change spell checker from codespell to typos (#18711)
2025-06-11 19:57:10 -07:00
model_executor
[custom_op][vllm-plugin] update custom_op class to use op_registry (#19164)
2025-06-20 07:44:56 -07:00
multimodal
[Core] Do not copy array during hashing (#19484)
2025-06-18 15:36:55 -07:00
platforms
[Bugfix][Ray] Set the cuda context eagerly in the ray worker (#19583)
2025-06-19 22:01:16 -07:00
plugins
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
profiler
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
prompt_adapter
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
reasoning
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
spec_decode
[Core] Cast multimodal input in hf processor (#18862)
2025-06-03 20:24:56 -07:00
third_party
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
transformers_utils
[CI] change spell checker from codespell to typos (#18711)
2025-06-11 19:57:10 -07:00
triton_utils
[CI][CPU] Improve dummy Triton interfaces and fix the CPU CI (#19838)
2025-06-19 15:46:09 +00:00
usage
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
v1
Export NaNs in logits to scheduler_stats if output is corrupted (#18777)
2025-06-20 22:47:16 +08:00
vllm_flash_attn
[BugFix] Fix vllm_flash_attn install issues (#17267)
2025-04-27 17:27:56 -07:00
worker
[Kernel] correct cpu worker function parameter type (#19745)
2025-06-20 10:50:13 +00:00
__init__.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
_custom_ops.py
[Perf] Optimize moe_align_block_size CUDA kernel (#19572)
2025-06-17 11:49:26 -07:00
_ipex_ops.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
beam_search.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
collect_env.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
config.py
Support embedding models in V1 (#16188)
2025-06-18 21:36:33 -07:00
connections.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
env_override.py
[Misc] Reduce warning message introduced in env_override (#19476)
2025-06-11 17:29:54 +08:00
envs.py
Export NaNs in logits to scheduler_stats if output is corrupted (#18777)
2025-06-20 22:47:16 +08:00
forward_context.py
[CUDA] Enable full cudagraph for FlashMLA (#18581)
2025-06-13 18:12:26 +00:00
jsontree.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
logger.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
logits_process.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
outputs.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
pooling_params.py
Support embedding models in V1 (#16188)
2025-06-18 21:36:33 -07:00
py.typed
Add py.typed so consumers of vLLM can get type checking (#1509)
2023-10-30 14:50:47 -07:00
sampling_params.py
[Frontend] Expose custom args in OpenAI APIs (#16862)
2025-06-18 17:41:11 -07:00
scalar_type.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
scripts.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
sequence.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
test_utils.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
tracing.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
utils.py
[Bugfix] Fix auto dtype casting for BatchFeature (#19316)
2025-06-14 15:13:08 +00:00
version.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00