Spaces:

TWO
/

sutra-tokenizer-comparison

Running

App Files Files Community

sutra-tokenizer-comparison / data

1 contributor

History: 2 commits

mikesapi's picture

adding more examples

5be3066 10 months ago

multilingualphrases01.txt

24.4 kB

adding sutra tokenizer inspector app 10 months ago
multilingualphrases02.txt

11.3 kB

adding sutra tokenizer inspector app 10 months ago
multilingualphrases03.txt

6.51 kB

adding more examples 10 months ago