Lucas Wilkinson ba0511fd80 [Misc] Add run one batch script that supports profiling (#32968) ...

Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>

2026-02-10 18:29:49 -08:00

..

basic

[UX] Use gguf repo_id:quant_type syntax for examples and docs (#33371)

2026-01-31 12:14:54 +08:00

disaggregated-prefill-v1

…

kv_load_failure_recovery

[Docs] Fix format error in KV load failure recovery doc (#34137)

2026-02-10 02:16:26 -08:00

logits_processor

…

new_weight_syncing

[Feat][RL][1/2] Native Weight Syncing API: NCCL (#31943)

2026-02-05 12:13:23 -05:00

openai_batch

[Docs] Improve documentation (#33799)

2026-02-06 12:57:09 +00:00

qwen2_5_omni

[Model] Use mm_position to compute mrope positions for Qwen2.5-Omni (#32772)

2026-01-25 20:15:53 +08:00

qwen3_omni

[Model] Use mm_position to compute mrope positions for Qwen3-Omni (#33010)

2026-01-26 13:48:07 +00:00

async_llm_streaming.py

…

audio_language.py

[Model][Multimodal] Add explicit MusicFlamingo adapter (#32696)

2026-01-30 11:01:29 +08:00

automatic_prefix_caching.py

Add flake8-implicit-str-concat rules to Ruff (#33191)

2026-01-28 04:56:10 +00:00

batch_llm_inference.py

…

chat_with_tools.py

…

context_extension.py

fix offline inference chat response prompt (#32088)

2026-01-11 14:01:18 +00:00

data_parallel.py

[CI] Fix "2 Node Tests (4 GPUs in total)" (#31090)

2025-12-22 10:32:40 +08:00

disaggregated_prefill.py

…

encoder_decoder_multimodal.py

[Deprecation] Remove deprecated task, seed and MM settings (#30397)

2025-12-10 19:59:39 -08:00

llm_engine_example.py

…

llm_engine_reset_kv.py

…

load_sharded_state.py

[Quantization][Deprecation] Remove DeepSpeedFp8 (#32679)

2026-01-21 09:32:12 -05:00

lora_with_quantization_inference.py

…

metrics.py

…

mistral-small.py

[Doc] Update usage of --limit-mm-per-prompt (#34148)

2026-02-09 21:12:13 -08:00

mlpspeculator.py

…

multilora_inference.py

fix LoRA-related examples (#29956)

2025-12-04 11:48:30 +08:00

pause_resume.py

[Feat][RL] Pause and Resume with keep requests for single engine (#32351)

2026-02-07 00:08:58 +00:00

prefix_caching.py

…

prompt_embed_inference.py

Explicitly set return_dict for apply_chat_template (#33372)

2026-01-30 07:27:04 +00:00

qwen_1m.py

…

reproducibility.py

…

rlhf_colocate.py

[CI][AMD] Skip 4 GPUs testgroup ray tests (#33305)

2026-01-29 21:39:53 -08:00

rlhf_online_quant.py

…

rlhf_utils.py

…

rlhf.py

…

run_one_batch.py

[Misc] Add run one batch script that supports profiling (#32968)

2026-02-10 18:29:49 -08:00

save_sharded_state.py

[Quantization][Deprecation] Remove DeepSpeedFp8 (#32679)

2026-01-21 09:32:12 -05:00

simple_profiling.py

[Cleanup] Refactor profiling env vars into a CLI config (#29912)

2025-12-09 13:29:33 -05:00

skip_loading_weights_in_engine_init.py

…

spec_decode.py

[Bugfix] Fix --trust-remote-code conflict (#34218)

2026-02-10 00:29:10 -08:00

structured_outputs.py

…

torchrun_dp_example.py

…

torchrun_example.py

…

vision_language_multi_image.py

[Model] Use mm_position to compute mrope positions for GLM-4.xV (#33039)

2026-02-02 16:55:48 +00:00

vision_language.py

[Models] Intern-S1-Pro (#33636)

2026-02-03 05:49:45 -08:00