Tao He 60f7624334 Implements dual-chunk-flash-attn backend for dual chunk attention with sparse attention support (#11844)

2025-05-12 19:52:47 -07:00

..

__init__.py

[Misc] Split model loader (#17712)

2025-05-07 12:42:26 +08:00

base_loader.py

[Misc] Split model loader (#17712)

2025-05-07 12:42:26 +08:00

bitsandbytes_loader.py

[Misc] Split model loader (#17712)

2025-05-07 12:42:26 +08:00

default_loader.py

[Misc] Split model loader (#17712)

2025-05-07 12:42:26 +08:00

dummy_loader.py

[Misc] Split model loader (#17712)

2025-05-07 12:42:26 +08:00

gguf_loader.py

[Misc] Split model loader (#17712)

2025-05-07 12:42:26 +08:00

neuron.py

Add NeuronxDistributedInference support, Speculative Decoding, Dynamic on-device sampling (#16357)

2025-05-07 00:07:30 -07:00

neuronx_distributed.py

Add NeuronxDistributedInference support, Speculative Decoding, Dynamic on-device sampling (#16357)

2025-05-07 00:07:30 -07:00

runai_streamer_loader.py

[Misc] Split model loader (#17712)

2025-05-07 12:42:26 +08:00

sharded_state_loader.py

[Misc] Split model loader (#17712)

2025-05-07 12:42:26 +08:00

tensorizer_loader.py

[Misc] Split model loader (#17712)

2025-05-07 12:42:26 +08:00

tensorizer.py

[Misc] Add SPDX-License-Identifier headers to python source files (#12628)

2025-02-02 11:58:18 -08:00

utils.py

[Quantization] Quark MXFP4 format loading (#16943)

2025-05-07 15:05:05 -04:00

weight_utils.py

Implements dual-chunk-flash-attn backend for dual chunk attention with sparse attention support (#11844)

2025-05-12 19:52:47 -07:00