Kunshang Ji 53ec16a705 [Hardware] Replace torch.cuda.device_count/current_device/set_device API (#36145) ...

Signed-off-by: Kunshang Ji <jikunshang95@gmail.com>
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>

2026-03-12 07:57:47 -07:00

..

reload

[Feat][RL][1/2] Native Weight Syncing API: NCCL (#31943)

2026-02-05 12:13:23 -05:00

__init__.py

[Misc][Spec Decode] support different load config for draft model (#34022)

2026-02-10 14:52:43 -08:00

base_loader.py

[Feature] OTEL tracing during loading (#31162)

2026-02-05 16:59:28 -08:00

bitsandbytes_loader.py

[Hardware] Replace torch.cuda.empty_cache with torch.accelerator.empty_cache (#30681)

2026-03-04 09:49:47 +00:00

default_loader.py

Revert "[Misc] Enable weights loading tracking for quantized models" (#35309)

2026-02-25 09:20:15 -08:00

dummy_loader.py

fix memory for online fp8 quantization with streaming weight load (#31914)

2026-02-02 14:17:42 -05:00

gguf_loader.py

[Bugfix] Remove broken raw url GGUF model loading support (#34433)

2026-02-12 09:40:01 -08:00

runai_streamer_loader.py

RayLLM Bugfix - Preserve obj store URL for multi engine_config creation (#30803)

2026-01-08 10:00:25 +00:00

sharded_state_loader.py

RayLLM Bugfix - Preserve obj store URL for multi engine_config creation (#30803)

2026-01-08 10:00:25 +00:00

tensorizer_loader.py

feat: spec decode with draft models (#24322)

2026-01-19 16:05:46 -05:00

tensorizer.py

[Hardware] Replace torch.cuda.device_count/current_device/set_device API (#36145)

2026-03-12 07:57:47 -07:00

utils.py

[Feature] Support CPU Offloading without Pytorch Pinned Memory that leads to doubled allocation (#32993)

2026-02-13 08:11:26 -08:00

weight_utils.py

fix: Use iterator as not to store all the file loads in memory at once (#36149)

2026-03-08 20:25:21 -07:00