nishtahir
/

mtg-glove-embedding-commander

mtg-glove-commander

Model card Files Files and versions

mtg-glove-embedding-commander / tokenizer.py

nishtahir's picture

Initial commit

dc7b215 unverified 4 months ago

history blame contribute delete

184 Bytes

	from transformers import AutoTokenizer, PreTrainedTokenizerFast


	class MtgGloVeTokenizer(PreTrainedTokenizerFast):
	pass


	MtgGloVeTokenizer.register_for_auto_class(AutoTokenizer)