Hugging Face
Models
Datasets
Spaces
Buckets
new
Docs
Enterprise
Pricing
Log In
Sign Up
Johnnyman1100
/
EZ-Tokenizer
like
0
Token Classification
code
English
programming
tokenizer
code-generation
nlp
machine-learning
License:
mit
Model card
Files
Files and versions
xet
Community
main
EZ-Tokenizer
569 kB
Ctrl+K
Ctrl+K
1 contributor
History:
9 commits
Johnnyman1100
Update LICENSE
0520651
verified
11 months ago
Test_tokenizer
Upload 38 files
11 months ago
dist
Upload 38 files
11 months ago
examples
Upload 38 files
11 months ago
src
Upload 38 files
11 months ago
tests
Upload 38 files
11 months ago
.gitattributes
Safe
1.57 kB
Upload 38 files
11 months ago
.gitignore
Safe
2.6 kB
Upload 38 files
11 months ago
EZ-Tokenizer.exe
316 kB
xet
Upload 38 files
11 months ago
INSTALL.md
Safe
2.3 kB
Upload 38 files
11 months ago
LICENSE
Safe
1.28 kB
Update LICENSE
11 months ago
MANIFEST.in
Safe
454 Bytes
Upload 38 files
11 months ago
README.md
Safe
2.59 kB
Update README.md
11 months ago
pyproject.toml
Safe
2.05 kB
Upload 38 files
11 months ago
requirements-dev.txt
Safe
413 Bytes
Upload 38 files
11 months ago
requirements.txt
Safe
609 Bytes
Upload 38 files
11 months ago
run_ez_tokenizer.bat
Safe
8.41 kB
Upload 38 files
11 months ago
setup.py
Safe
1.37 kB
Upload 38 files
11 months ago