Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up

Spaces:

xu-song
/

tokenizer-arena

Running

App Files Files Community

Fetching metadata from the HF Docker repository...

tokenizer-arena

Ctrl+K

Ctrl+K

2 contributors

History: 45 commits

xu-song's picture

add more tokenizer

c75633b over 1 year ago

css
update over 1 year ago
images
update over 1 year ago
js
fix chatglm; new feature about add_special_tokens; over 1 year ago
utils
add more tokenizer over 1 year ago
vocab
add more tokenizer over 1 year ago
.gitattributes

1.68 kB

add more tokenizers over 1 year ago
.gitignore

171 Bytes

update over 1 year ago
README.md

330 Bytes

update over 1 year ago
app.py

7.18 kB

fix chatglm; new feature about add_special_tokens; over 1 year ago
config.py

45 Bytes

fix chatglm; new feature about add_special_tokens; over 1 year ago
evaluation.md

58 Bytes

update over 1 year ago
examples.py

2.37 kB

fix chatglm; new feature about add_special_tokens; over 1 year ago
requirements.txt

57 Bytes

add more tokenizer over 1 year ago
util.py

5.98 kB

fix chatglm; new feature about add_special_tokens; over 1 year ago