4 Commits

Author	SHA1	Message	Date
Tao He	294f8f6665	[BugFix] Pass tokenizer_config to local_tokenizer_group (#3754) ... Signed-off-by: Tao He <sighingnow@gmail.com>	2024-04-03 20:31:46 -07:00
SangBin Cho	01bfb22b41	[CI] Try introducing isort. (#3495)	2024-03-25 07:59:47 -07:00
Nick Hill	4ad521d8b5	[Core] Add generic typing to LRUCache (#3511)	2024-03-20 00:36:09 -07:00
Antoni Baum	fb96c1e98c	Asynchronous tokenization (#2879)	2024-03-15 23:37:01 +00:00