Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
toksuite
/
mistralai-tekken
like
0
Follow
TokSuite
7
Text Generation
Transformers
Safetensors
5 languages
llama
toksuite
tokenization
tekken
multilingual
bpe
research
robustness
text-generation-inference
arxiv:
2512.20757
License:
mit
Model card
Files
Files and versions
xet
Community
Deploy
Use this model
main
mistralai-tekken
3.65 GB
2 contributors
History:
16 commits
gsaltintas
Update README.md
d27e681
verified
about 2 months ago
.gitattributes
1.64 kB
Upload model-performance-comparison.png
about 2 months ago
README.md
8.03 kB
Update README.md
about 2 months ago
config.json
610 Bytes
Upload config
5 months ago
generation_config.json
150 Bytes
Upload model files
5 months ago
mistralai--tekken.yaml
53 Bytes
Upload tokenizer file mistralai--tekken.yaml - Upload model files
5 months ago
mistralai--tekken_super_mapping.json
2.23 MB
Upload tokenizer file mistralai--tekken_super_mapping.json - Upload model files
5 months ago
model-performance-comparison.png
279 kB
xet
Upload model-performance-comparison.png
about 2 months ago
model.safetensors
3.64 GB
xet
Upload model files
5 months ago
tokenizer.json
3.09 MB
Upload tokenizer file mistralai--tekken_vocab.json - Upload model files
5 months ago
tokenizer_config.json
61 Bytes
Upload tokenizer file mistralai--tekken_info.json - Upload model files
5 months ago
toksuite-logo.png
1 MB
xet
Upload toksuite-logo.png
about 2 months ago
