Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
ta4tsering
/
NLP-Unigram_language_model_tokenizer
like
0
Model card
Files
Files and versions
xet
Community
cc7535c
NLP-Unigram_language_model_tokenizer
Ctrl+K
Ctrl+K
1 contributor
History:
5 commits
ta4tsering
Add trained_tokenizer_32000.json
cc7535c
verified
7 months ago
.gitattributes
Safe
1.52 kB
initial commit
7 months ago
tokenizer_training.ipynb
Safe
61.3 kB
Add tokenizer_training.ipynb
7 months ago
trained_tokenizer_16000.json
Safe
1.2 MB
Add trained_tokenizer_16000.json
7 months ago
trained_tokenizer_32000.json
Safe
2.41 MB
Add trained_tokenizer_32000.json
7 months ago
trained_tokenizer_8000.json
Safe
594 kB
Add trained_tokenizer_8000.json
7 months ago