Or Ozeri 9cddbdba6d OffloadingConnector: Add cpu_bytes_to_use configuration (#24498) ...

Signed-off-by: Or Ozeri <oro@il.ibm.com>

2026-01-12 15:00:43 +00:00

..

__init__.py

[Misc] Fix Current vLLM config is not set. warnings, assert to avoid issues in the future (#31747)

2026-01-08 15:20:49 -08:00

attention.py

[1/N][Attention] Restructure attention: move files (#31916)

2026-01-09 13:10:24 -08:00

cache.py

[refactor] refactor memory constants usage (#31865)

2026-01-07 18:37:31 +00:00

compilation.py

make assume_32_bit_indexing configurable (#32044)

2026-01-10 23:15:46 -08:00

device.py

[Misc] Add backup hash algorithm for FIPS constrained environments (#28795)

2025-11-26 00:50:22 +00:00

ec_transfer.py

[Core] Encoder separation for Encode-Prefill-Decode Disaggregation (#25233)

2025-11-11 18:58:33 -08:00

kv_events.py

[Feature] publisher default set zmq in kv_event config (#26915)

2025-10-22 19:19:33 +00:00

kv_transfer.py

[P/D] KV Load Failure Recovery/Abort Configuration (#26813)

2025-12-10 11:00:52 -08:00

load.py

[Misc] Add backup hash algorithm for FIPS constrained environments (#28795)

2025-11-26 00:50:22 +00:00

lora.py

[Misc] Improve error messages for unsupported types and parameters (#30593)

2026-01-07 09:00:16 +00:00

model_arch.py

[Core] Parse vLLM engine required fields from hf_config to model_arch_config (#28454)

2026-01-02 15:13:15 -08:00

model.py

[Feature] Support recording expert indices for rollout router replay (#28284)

2026-01-12 06:23:04 -08:00

multimodal.py

[1/N][Attention] Restructure attention: move files (#31916)

2026-01-09 13:10:24 -08:00

observability.py

[Feature] Add iteration level logging and enhance nvtx marker (#31193)

2026-01-09 00:13:39 +00:00

parallel.py

[EPLB] Optimize EPLB with numpy (#29499)

2026-01-07 15:21:35 -05:00

pooler.py

[Refactor] Separate sequence and token pooling types (#32026)

2026-01-10 04:53:24 +00:00

profiler.py

[Cleanup] Refactor profiling env vars into a CLI config (#29912)

2025-12-09 13:29:33 -05:00

scheduler.py

[Core] Enable async scheduling by default (#27614)

2025-12-29 13:20:55 -07:00

speculative.py

[Bugfix] Remove the num_hidden_layers override for glm4_moe (#31745)

2026-01-08 15:45:10 +08:00

speech_to_text.py

[Voxtral] Fix speech transcription api (#31388)

2026-01-08 18:34:19 +08:00

structured_outputs.py

Reduce validation to a warning (#28749)

2025-12-05 14:02:49 +00:00

utils.py

Use helper function instead of looping through attribute names (#29788)

2025-12-23 17:31:56 +00:00

vllm.py

OffloadingConnector: Add cpu_bytes_to_use configuration (#24498)

2026-01-12 15:00:43 +00:00