tokenizer.encode
tokenizer.decode
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk> (cherry picked from commit 68ffbca7e4)
68ffbca7e4
mistral