opencoder484 / tokenizer.json
tyzhu's picture
Add tokenizer.json for fast tokenizer support
4170d04 verified
This file is stored with Xet . It is too big to display, but you can still download it.

Large File Pointer Details

( Raw pointer file )
SHA256:
739d8e2f2e0876f8f27be817195e725e998ad3838abfc942dd46989995e47ba4
Pointer size:
133 Bytes
·
Size of remote file:
11.1 MB
·
Xet hash:
1a94b4b612eec41c45873f1c7b18370934bc9578b9c983d796ccc797e5519b98

Xet efficiently stores Large Files inside Git, intelligently splitting files into unique chunks and accelerating uploads and downloads. More info.