Roy Wang 761e0aa7a0 [Performance] Add --enable-ep-weight-filter CLI option (#37351) ...

Signed-off-by: esmeetu <jasonailu87@gmail.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>

2026-03-18 09:36:55 +08:00

..

reload

[Feat][RL][1/2] Native Weight Syncing API: NCCL (#31943)

2026-02-05 12:13:23 -05:00

__init__.py

[Feature] Add InstantTensor weight loader (#36139)

2026-03-14 18:05:23 +01:00

base_loader.py

[Hardware] Replace memory related torch.cuda APIs (#37031)

2026-03-16 10:24:48 +00:00

bitsandbytes_loader.py

[Hardware] Replace torch.cuda.empty_cache with torch.accelerator.empty_cache (#30681)

2026-03-04 09:49:47 +00:00

default_loader.py

[Performance] Add --enable-ep-weight-filter CLI option (#37351)

2026-03-18 09:36:55 +08:00

dummy_loader.py

fix memory for online fp8 quantization with streaming weight load (#31914)

2026-02-02 14:17:42 -05:00

ep_weight_filter.py

[Performance][Model Loader] Skip non-local expert weights during EP model loading (#37136)

2026-03-16 01:33:36 -07:00

gguf_loader.py

[Bugfix] Remove broken raw url GGUF model loading support (#34433)

2026-02-12 09:40:01 -08:00

runai_streamer_loader.py

[Feature] Add Azure Blob Storage support for RunAI Model Streamer (#34614)

2026-03-15 19:38:21 +08:00

sharded_state_loader.py

RayLLM Bugfix - Preserve obj store URL for multi engine_config creation (#30803)

2026-01-08 10:00:25 +00:00

tensorizer_loader.py

feat: spec decode with draft models (#24322)

2026-01-19 16:05:46 -05:00

tensorizer.py

[Hardware] Replace torch.cuda.device_count/current_device/set_device API (#36145)

2026-03-12 07:57:47 -07:00

utils.py

[Feature] Support CPU Offloading without Pytorch Pinned Memory that leads to doubled allocation (#32993)

2026-02-13 08:11:26 -08:00

weight_utils.py

[Performance] Add prefetch for checkpoints to OS page cache (#36012)

2026-03-16 11:32:02 +00:00