Vasiliy Kuznetsov 0130223bd9 fix memory for online fp8 quantization with streaming weight load (#31914) ...

Signed-off-by: vasiliy <vasiliy@fb.com>

2026-02-02 14:17:42 -05:00

..

reload

fix QERL attention import path (#33432)

2026-01-30 09:29:09 -08:00

__init__.py

feat: spec decode with draft models (#24322)

2026-01-19 16:05:46 -05:00

base_loader.py

fix memory for online fp8 quantization with streaming weight load (#31914)

2026-02-02 14:17:42 -05:00

bitsandbytes_loader.py

"refactor: refactor_repeated_interfaces" (#32486)

2026-01-18 22:07:01 +08:00

default_loader.py

[Refactor][TPU] Remove torch_xla path and use tpu-inference (#30808)

2026-01-07 16:07:16 +08:00

dummy_loader.py

fix memory for online fp8 quantization with streaming weight load (#31914)

2026-02-02 14:17:42 -05:00

gguf_loader.py

feat: spec decode with draft models (#24322)

2026-01-19 16:05:46 -05:00

runai_streamer_loader.py

RayLLM Bugfix - Preserve obj store URL for multi engine_config creation (#30803)

2026-01-08 10:00:25 +00:00

sharded_state_loader.py

RayLLM Bugfix - Preserve obj store URL for multi engine_config creation (#30803)

2026-01-08 10:00:25 +00:00

tensorizer_loader.py

feat: spec decode with draft models (#24322)

2026-01-19 16:05:46 -05:00

tensorizer.py

[Misc] Replace Optional[X] with X | None syntax (#33332)

2026-01-30 01:56:59 -08:00

utils.py

[QeRL] Layerwise Reloading (#32133)

2026-01-30 08:50:05 -07:00

weight_utils.py

fix memory for online fp8 quantization with streaming weight load (#31914)

2026-02-02 14:17:42 -05:00