biondizzle/vllm
1
0
Fork 0
Code Issues Pull Requests Actions 2 Packages Projects Releases Wiki Activity
Files
5039ec2336b865db5d9eed252adf46bdff8d5fc0
vllm/vllm
History
Junhao Li 2d40665fe8 Add fused MOE config for Qwen3 30B A3B on B200 (#19455) 
Signed-off-by: Junhao Li <junhao@ubicloud.com>
2025-06-11 13:43:46 +08:00
..
adapter_commons
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
assets
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
attention
[CPU] V1 support for the CPU backend (#16441)
2025-06-03 18:43:01 -07:00
benchmarks
[Misc] Add packages for benchmark as extra dependency (#19089)
2025-06-04 04:18:48 -07:00
compilation
[Bugfix] Re-enable use_cudagraph in vLLM v1 (#19299)
2025-06-08 08:56:12 +08:00
core
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
device_allocator
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
distributed
[Misc] Fixes and Optimizations for DeepEP + DeepGEMM combination. (#19298)
2025-06-09 10:50:39 -04:00
engine
[ROCm][V1] Adding ROCm to the list of plaforms using V1 by default (#19440)
2025-06-10 22:06:15 +00:00
entrypoints
[Frontend] Add tqdm_leave_pbar to control progress bar visibility (#19357)
2025-06-10 04:55:09 +00:00
executor
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
inputs
[Core] Cast multimodal input in hf processor (#18862)
2025-06-03 20:24:56 -07:00
logging_utils
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
lora
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
model_executor
Add fused MOE config for Qwen3 30B A3B on B200 (#19455)
2025-06-11 13:43:46 +08:00
multimodal
[Misc] Remove unused MultiModalHasher.hash_prompt_mm_data (#19422)
2025-06-11 05:18:57 +00:00
platforms
Revert "[v1] Add fp32 support to v1 engine through flex attn" (#19404)
2025-06-10 01:30:20 -07:00
plugins
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
profiler
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
prompt_adapter
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
reasoning
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
spec_decode
[Core] Cast multimodal input in hf processor (#18862)
2025-06-03 20:24:56 -07:00
third_party
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
transformers_utils
[Bugfix] Fix modelscope token passed in (#19389)
2025-06-10 13:39:37 +08:00
triton_utils
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
usage
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
v1
[BugFix][FlashInfer] Fix attention backend interface mismatch with unexpected keyword use_irope (#19134)
2025-06-10 16:48:51 +08:00
vllm_flash_attn
[BugFix] Fix vllm_flash_attn install issues (#17267)
2025-04-27 17:27:56 -07:00
worker
Automatically bind CPU OMP Threads of a rank to CPU ids of a NUMA node. (#17930)
2025-06-10 06:22:05 +00:00
__init__.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
_custom_ops.py
[Kernel] Integrate CUTLASS MoE kernel with PPLX (#18762)
2025-06-06 18:26:11 -07:00
_ipex_ops.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
beam_search.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
collect_env.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
config.py
[BugFix] Allow use_cudagraph to work with dynamic VLLM_USE_V1 (#19390)
2025-06-11 07:54:41 +08:00
connections.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
env_override.py
[Misc] Do not override NCCL_CUMEM_ENABLE if set explicitly (#19105)
2025-06-05 11:14:32 +00:00
envs.py
Automatically bind CPU OMP Threads of a rank to CPU ids of a NUMA node. (#17930)
2025-06-10 06:22:05 +00:00
forward_context.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
jsontree.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
logger.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
logits_process.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
outputs.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
pooling_params.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
py.typed
Add py.typed so consumers of vLLM can get type checking (#1509)
2023-10-30 14:50:47 -07:00
sampling_params.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
scalar_type.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
scripts.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
sequence.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
test_utils.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
tracing.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00
utils.py
[V1] Reuse V0's memory_profiling util for gpu worker memory profiling (#19312)
2025-06-10 08:40:01 +08:00
version.py
[Misc] Add SPDX-FileCopyrightText (#19100)
2025-06-03 11:20:17 -07:00