Cyrus Leung c60e6137f0 [Optimization] Avoid repeated model architecture conversion for pooling models (#25261) ...

Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>

2025-09-20 13:30:22 +08:00

..

__init__.py

Move ModelConfig from config/__init__.py to config/model.py (#25252)

2025-09-19 16:22:33 +00:00

cache.py

Allow users to specify kv cache memory size (#21489)

2025-09-11 13:41:07 +00:00

compilation.py

[torch.compile] CUDAGraph Inductor partition integration (#24281)

2025-09-20 01:02:15 +00:00

kv_events.py

Move KVEventsConfig from config/__init__.py to config/kv_events.py (#24433)

2025-09-08 06:41:27 -07:00

kv_transfer.py

Move KVTransferConfig from config/__init__.py to config/kv_transfer.py (#24434)

2025-09-08 20:30:32 -07:00

load.py

Fix typing for safetensors_load_strategy (#24641)

2025-09-11 10:41:39 +00:00

lora.py

Move LoRAConfig from config/__init__.py to config/lora.py (#24644)

2025-09-11 11:01:38 +00:00

model.py

[Optimization] Avoid repeated model architecture conversion for pooling models (#25261)

2025-09-20 13:30:22 +08:00

multimodal.py

Move MultiModalConfig from config/__init__.py to config/multimodal.py (#24659)

2025-09-15 17:43:16 +00:00

parallel.py

[Frontend] Pass API server count to each process (#23717)

2025-09-20 01:15:19 +08:00

pooler.py

Move PoolerConfig from config/__init__.py to config/pooler.py (#25181)

2025-09-19 11:02:55 +00:00

scheduler.py

Move ModelConfig from config/__init__.py to config/model.py (#25252)

2025-09-19 16:22:33 +00:00

speculative.py

[spec decode] Fix MTP inference path for MiMo-7B model (#25136)

2025-09-18 09:12:19 -07:00

structured_outputs.py

Move StructuredOutputsConfig from config/__init__.py to config/structured_outputs.py (#25153)

2025-09-18 11:24:27 +00:00

utils.py

Move ModelConfig from config/__init__.py to config/model.py (#25252)

2025-09-19 16:22:33 +00:00