Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
stabilityai
/
arcade100k
like
3
Follow
Stability AI
19.6k
arxiv:
2402.17834
Model card
Files
Files and versions
Community
dfe1f6f
arcade100k
2 contributors
History:
18 commits
jon-tow
fix: make `eos_token`/`pad_token` overridable
dfe1f6f
about 1 year ago
.gitattributes
Safe
1.52 kB
initial commit
over 1 year ago
LICENSE
Safe
6.9 kB
fix: update license
over 1 year ago
README.md
258 Bytes
Update README.md
over 1 year ago
arcade100k.tiktoken
Safe
1.68 MB
fix: store `cl100k_base` mergeable ranks in `arcade100k.tiktoken`
over 1 year ago
tokenization_arcade100k.py
9.6 kB
fix: make `eos_token`/`pad_token` overridable
about 1 year ago
tokenizer_config.json
Safe
224 Bytes
fix: make `eos_token`/`pad_token` overridable
about 1 year ago