Spaces:

yhavinga
/

dutch-tokenizer-arena

Running

App Files Files Community

dutch-tokenizer-arena / stats

Ctrl+K

Ctrl+K

3 contributors

History: 4 commits

yhavinga's picture

Add Llama tokenizer creation for Dutch, English, Code, Markdown and TeX.

c78da21 about 1 year ago

README.md

0 Bytes

update compress rate about 1 year ago
compress_rate.json

105 kB

Add Llama tokenizer creation for Dutch, English, Code, Markdown and TeX. about 1 year ago