GAMA-IT

Running on Zero

GAMA-IT / utils /test_module /custom_tokenization.py

Upload folder using huggingface_hub

be0b943 verified 9 months ago

88 Bytes

	from transformers import BertTokenizer


	class CustomTokenizer(BertTokenizer):
	pass