Hugging Face's logo

aliarda
/
turkish_tokenizer

Transformers
turkish
tokenizer
byte-pair-encoding
nlp
linguistics
Model card Files
xet
 Community
aliarda commited on
Commit
d679b6f
·
verified ·
1 Parent(s): 5107aa9

Upload tokenizer

Browse files
Files changed (3) hide show
  1. README.md +1 -1
  2. tokenizer.json +0 -0
  3. tokenizer_config.json +0 -0
README.md CHANGED
@@ -1,12 +1,12 @@
1
  ---
2
  library_name: transformers
 
3
  tags:
4
  - turkish
5
  - tokenizer
6
  - byte-pair-encoding
7
  - nlp
8
  - linguistics
9
- license: apache-2.0
10
  ---
11
 
12
  # Model Card for Turkish Byte Pair Encoding Tokenizer
 
1
  ---
2
  library_name: transformers
3
+ license: apache-2.0
4
  tags:
5
  - turkish
6
  - tokenizer
7
  - byte-pair-encoding
8
  - nlp
9
  - linguistics
 
10
  ---
11
 
12
  # Model Card for Turkish Byte Pair Encoding Tokenizer
tokenizer.json CHANGED
The diff for this file is too large to render. See raw diff
 
tokenizer_config.json CHANGED
The diff for this file is too large to render. See raw diff