Spaces:

Duplicated from sonalkum/GAMA

sonalkum
/

GAMA-IT

Running on Zero

App Files Files Community

GAMA-IT / hf-dev-train /transformers-main /utils /test_module /custom_tokenization.py

sonalkum's picture

hf peft

1e6d67a 9 months ago

88 Bytes

	from transformers import BertTokenizer


	class CustomTokenizer(BertTokenizer):
	pass