Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
Spaces:
Ahmadzei
/
RAG
like
0
Runtime error
App
Files
Files
Community
Fetching metadata from the HF Docker repository...
main
RAG
/
chunked
/
nltk_chunking
/
_fast_tokenizers
/
chunk_4.txt
Ahmadzei
added 3 more tables for large emb model
5fa1a76
about 1 year ago
raw
Copy download link
history
blame
contribute
delete
Wrap lines
124 Bytes
Loading directly from the tokenizer object
Let's see how to leverage this tokenizer object in the 🤗 Transformers library.
