Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
Spaces:
Duplicated from
sonalkum/GAMA
sonalkum
/
GAMA-IT
like
4
Running
on
Zero
App
Files
Files
Community
Fetching metadata from the HF Docker repository...
be0b943
GAMA-IT
/
utils
/
test_module
/
custom_tokenization.py
sonalkum
Upload folder using huggingface_hub
be0b943
verified
9 months ago
raw
Copy download link
history
blame
Safe
88 Bytes
from
transformers
import
BertTokenizer
class
CustomTokenizer
(
BertTokenizer
):
pass