Spaces:

vpkprasanna
/

TokenizerViz

Sleeping

App Files Files Community

TokenizerViz / models /Meta-Llama-3.1-8B /original

Ctrl+K

Ctrl+K

4 contributors

History: 2 commits

prasanna kumar

added GIT LFS support

eb89467 11 months ago

params.json

199 Bytes
LFS

added GIT LFS support 11 months ago
tokenizer.model

2.18 MB

added llama3 models for tokenize and show as well as pass token ids will give back text 11 months ago