Reid dc3529dbf6 [Misc] improve example mlpspeculator and llm_engine_example (#16175) ...

Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>

2025-04-07 11:53:52 +00:00

..

basic

[Misc] improve example script output (#15528)

2025-03-26 10:12:47 +00:00

openai

[CI/Build] Auto-fix Markdown files (#12941)

2025-02-08 04:25:15 -08:00

profiling_tpu

Update deprecated Python 3.8 typing (#13971)

2025-03-02 17:34:51 -08:00

audio_language.py

Revert "[V1] Scatter and gather placeholders in the model runner" (#16075)

2025-04-04 14:50:57 -07:00

chat_with_tools.py

[Misc] Add SPDX-License-Identifier headers to python source files (#12628)

2025-02-02 11:58:18 -08:00

cpu_offload_lmcache.py

[Feature] Support KV cache offloading and disagg prefill with LMCache connector. (#12953)

2025-02-25 00:38:42 -08:00

data_parallel.py

[V1] AsyncLLM data parallel (#13923)

2025-03-27 16:14:41 -07:00

disaggregated_prefill_lmcache.py

Correct capitalisation: VLLM -> vLLM (#14562)

2025-03-10 16:36:21 +00:00

disaggregated_prefill.py

[Bugfix] Offline example of disaggregated prefill (#13214)

2025-02-13 20:20:47 -08:00

distributed.py

Update deprecated Python 3.8 typing (#13971)

2025-03-02 17:34:51 -08:00

eagle.py

[Misc] refactor example eagle (#16100)

2025-04-06 09:42:48 +00:00

encoder_decoder_multimodal.py

[Misc] Add --seed option to offline multi-modal examples (#14934)

2025-03-17 03:00:17 -07:00

encoder_decoder.py

[Misc] format output for encoder_decoder.py (#16095)

2025-04-05 19:57:18 -07:00

llm_engine_example.py

[Misc] improve example mlpspeculator and llm_engine_example (#16175)

2025-04-07 11:53:52 +00:00

load_sharded_state.py

[Bugfix][V1] Fix bug from putting llm_engine.model_executor in a background process (#15367)

2025-04-03 07:32:10 +00:00

lora_with_quantization_inference.py

[Misc] Clean up the BitsAndBytes arguments (#15140)

2025-03-20 19:17:12 -07:00

mistral-small.py

[Misc] Update Mistral-3.1 example (#16147)

2025-04-07 03:57:37 +00:00

mlpspeculator.py

[Misc] improve example mlpspeculator and llm_engine_example (#16175)

2025-04-07 11:53:52 +00:00

multilora_inference.py

Update deprecated Python 3.8 typing (#13971)

2025-03-02 17:34:51 -08:00

neuron_int8_quantization.py

[Misc] Add SPDX-License-Identifier headers to python source files (#12628)

2025-02-02 11:58:18 -08:00

neuron.py

[Misc] Add SPDX-License-Identifier headers to python source files (#12628)

2025-02-02 11:58:18 -08:00

prefix_caching.py

[Misc] Add SPDX-License-Identifier headers to python source files (#12628)

2025-02-02 11:58:18 -08:00

prithvi_geospatial_mae.py

Update deprecated Python 3.8 typing (#13971)

2025-03-02 17:34:51 -08:00

profiling.py

Update deprecated Python 3.8 typing (#13971)

2025-03-02 17:34:51 -08:00

reproduciblity.py

Add an example for reproducibility (#15262)

2025-03-20 19:55:47 -07:00

rlhf_colocate.py

[RLHF] use worker_extension_cls for compatibility with V0 and V1 (#14185)

2025-03-07 00:32:46 +08:00

rlhf_utils.py

[RLHF] use worker_extension_cls for compatibility with V0 and V1 (#14185)

2025-03-07 00:32:46 +08:00

rlhf.py

[RLHF] use worker_extension_cls for compatibility with V0 and V1 (#14185)

2025-03-07 00:32:46 +08:00

save_sharded_state.py

[Bugfix][V1] Fix bug from putting llm_engine.model_executor in a background process (#15367)

2025-04-03 07:32:10 +00:00

simple_profiling.py

[Misc] Add SPDX-License-Identifier headers to python source files (#12628)

2025-02-02 11:58:18 -08:00

structured_outputs.py

[Misc] Add SPDX-License-Identifier headers to python source files (#12628)

2025-02-02 11:58:18 -08:00

torchrun_example.py

[bugfix] add seed in torchrun_example.py (#15980)

2025-04-03 12:25:01 +08:00

tpu.py

[TPU] [V1] fix cases when max_num_reqs is set smaller than MIN_NUM_SEQS (#15583)

2025-03-26 22:46:26 -07:00

vision_language_embedding.py

[Misc] Add --seed option to offline multi-modal examples (#14934)

2025-03-17 03:00:17 -07:00

vision_language_multi_image.py

[Model] Aya Vision (#15441)

2025-04-01 16:30:43 +00:00

vision_language.py

[Model] Aya Vision (#15441)

2025-04-01 16:30:43 +00:00