Update tokenizer_config.json
#1
by zhtmike - opened
According to https://huggingface.co/Tongyi-MAI/Z-Image-Turbo/blob/main/tokenizer/tokenizer_config.json, it should be additional_special_tokens ? otherwise it will leads to tokenization error.
According to https://huggingface.co/Tongyi-MAI/Z-Image-Turbo/blob/main/tokenizer/tokenizer_config.json, it should be additional_special_tokens ? otherwise it will leads to tokenization error.