Aaron Hao 5f82706a21 [BUG] Exclude SKIP_TENSORS from get_layer_size() + new weight sync example for dpep (#37334) ...

Signed-off-by: ahao-anyscale <ahao@anyscale.com>

2026-03-19 00:45:10 +00:00

..

reload

[BUG] Exclude SKIP_TENSORS from get_layer_size() + new weight sync example for dpep (#37334)

2026-03-19 00:45:10 +00:00

__init__.py

[Feature] Add InstantTensor weight loader (#36139)

2026-03-14 18:05:23 +01:00

base_loader.py

[Hardware] Replace memory related torch.cuda APIs (#37031)

2026-03-16 10:24:48 +00:00

bitsandbytes_loader.py

[Hardware] Replace torch.cuda.empty_cache with torch.accelerator.empty_cache (#30681)

2026-03-04 09:49:47 +00:00

default_loader.py

[Bugfix] Fix EP weight filter breaking EPLB and NVFP4 accuracy (#37322)

2026-03-18 18:30:29 +08:00

dummy_loader.py

fix memory for online fp8 quantization with streaming weight load (#31914)

2026-02-02 14:17:42 -05:00

ep_weight_filter.py

[Bugfix] Fix EP weight filter breaking EPLB and NVFP4 accuracy (#37322)

2026-03-18 18:30:29 +08:00

gguf_loader.py

[Bugfix] Remove broken raw url GGUF model loading support (#34433)

2026-02-12 09:40:01 -08:00

runai_streamer_loader.py

[Feature] Add Azure Blob Storage support for RunAI Model Streamer (#34614)

2026-03-15 19:38:21 +08:00

sharded_state_loader.py

RayLLM Bugfix - Preserve obj store URL for multi engine_config creation (#30803)

2026-01-08 10:00:25 +00:00

tensorizer_loader.py

feat: spec decode with draft models (#24322)

2026-01-19 16:05:46 -05:00

tensorizer.py

[Hardware] Replace torch.cuda.device_count/current_device/set_device API (#36145)

2026-03-12 07:57:47 -07:00

utils.py

[Feature] Support CPU Offloading without Pytorch Pinned Memory that leads to doubled allocation (#32993)

2026-02-13 08:11:26 -08:00

weight_utils.py

[Performance] Add prefetch for checkpoints to OS page cache (#36012)

2026-03-16 11:32:02 +00:00