Hugging Face's logo

flexitok
/
bpe_script_Slav_16000

Czech
tokenizer
bpe
flexitok
fineweb2
Model card Files
xet
 Community
bpe_script_Slav_16000 / script_1

Commit History

Upload script_1/flexitok--bpe_script_Slav_16000_overlap.json with huggingface_hub
d2cf827
verified

gsaltintas commited on

Upload script_1/flexitok--bpe_script_Slav_16000_super_mapping.json with huggingface_hub
b00d25d
verified

gsaltintas commited on

Upload script_1/flexitok--bpe_script_Slav_16000_overlap.json with huggingface_hub
81d04d5
verified

gsaltintas commited on

Upload script_1/participating_tokenizers.json with huggingface_hub
a1e1a14
verified

gsaltintas commited on

Upload script_1/flexitok--bpe_script_Slav_16000.yaml with huggingface_hub
c956e01
verified

gsaltintas commited on

Upload script_1/flexitok--bpe_script_Slav_16000_info.json with huggingface_hub
98d2f09
verified

gsaltintas commited on

Upload script_1/flexitok--bpe_script_Slav_16000_vocab.json with huggingface_hub
97eb56f
verified

gsaltintas commited on

Upload script_1/flexitok--bpe_script_Slav_16000_super_mapping.json with huggingface_hub
1675126
verified

gsaltintas commited on