Patrick von Platen 6fc4e6e07a [Model] Add Mistral Tokenization to improve robustness and chat encoding (#7739)

2024-08-27 12:40:02 +00:00

..

configs

[Speculative Decoding] EAGLE Implementation with Top-1 proposer (#6830)

2024-08-22 02:42:24 -07:00

tokenizer_group

[mypy] Misc. typing improvements (#7417)

2024-08-13 09:20:20 +08:00

tokenizers

[Model] Add Mistral Tokenization to improve robustness and chat encoding (#7739)

2024-08-27 12:40:02 +00:00

__init__.py

[Tokenizer] Add an option to specify tokenizer (#284)

2023-06-28 09:46:58 -07:00

config.py

[Speculative Decoding] EAGLE Implementation with Top-1 proposer (#6830)

2024-08-22 02:42:24 -07:00

detokenizer.py

[Model] Add Mistral Tokenization to improve robustness and chat encoding (#7739)

2024-08-27 12:40:02 +00:00

image_processor.py

[Core] Dynamic image size support for VLMs (#5276)

2024-07-02 20:34:00 -07:00

tokenizer.py

[Model] Add Mistral Tokenization to improve robustness and chat encoding (#7739)

2024-08-27 12:40:02 +00:00