Spaces:

yhavinga
/

dutch-tokenizer-arena

Running

App Files Files Community

dutch-tokenizer-arena / vocab /deepseek_llm_7b_base

Ctrl+K

Ctrl+K

3 contributors

History: 1 commit

xu-song's picture

add more tokenizers

a1b0cd0 over 1 year ago

__init__.py

143 Bytes

add more tokenizers over 1 year ago