Instructions to use naclbit/trin_tokenizer_v3 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use naclbit/trin_tokenizer_v3 with Transformers:
# pip install -U transformers accelerate # Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("naclbit/trin_tokenizer_v3", device_map="auto") - Notebooks
- Google Colab
- Kaggle
Download spiece.model from naclbit/trin_tokenizer_v3: direct link, hf CLI and curl.
- Browser
- Download file 1.19 MB
-
https://huggingface.co/naclbit/trin_tokenizer_v3/resolve/main/spiece.model
- Command line
-
hf download hf://naclbit/trin_tokenizer_v3/spiece.model
-
curl -L -o spiece.model https://huggingface.co/naclbit/trin_tokenizer_v3/resolve/main/spiece.model
1.19 MB
- Xet hash:
- cd0e9a1403773f80263fabee34eb038c438c8cc171aa9567e2847989607ec784
- Size of remote file:
- 1.19 MB
- SHA256:
- ec31a22c0dca80dc303894ca87547154961b22e312c10c6fab751db7c4584439
·
Xet efficiently stores Large Files inside Git, intelligently splitting files into unique chunks and accelerating uploads and downloads. More info.