Cyrus Leung 6444824873 [Misc] Implement TokenizerLike.convert_tokens_to_ids (#31796) ...

Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>

2026-01-06 12:08:22 +00:00

..

__init__.py

[Chore][1/2] Drop v0.14 deprecations (#31285)

2025-12-24 09:54:01 -08:00

deepseek_v32_encoding.py

Add chat prefix completion feature to DeepSeek v3.2 (#31147)

2026-01-05 11:20:25 +08:00

deepseek_v32.py

[Misc] Implement TokenizerLike.convert_tokens_to_ids (#31796)

2026-01-06 12:08:22 +00:00

detokenizer_utils.py

[Chore] Move detokenizer_utils to vllm/tokenizers (#29727)

2025-11-29 06:25:17 -08:00

hf.py

[Refactor] TokenizerRegistry only uses lazy imports (#30609)

2025-12-13 23:16:22 +08:00

mistral.py

[Misc] Implement TokenizerLike.convert_tokens_to_ids (#31796)

2026-01-06 12:08:22 +00:00

protocol.py

[Misc] Implement TokenizerLike.convert_tokens_to_ids (#31796)

2026-01-06 12:08:22 +00:00

registry.py

[Chore][1/2] Drop v0.14 deprecations (#31285)

2025-12-24 09:54:01 -08:00