Adapt tokenization_interns1.py to transformers>=5.0.0

#15

Sign up or log in to comment