Hugging Face
Models
Datasets
Spaces
Buckets
new
Docs
Enterprise
Pricing
Log In
Sign Up
rtferraz
/
domainTokenizer
like
0
arxiv:
9 papers
Model card
Files
Files and versions
xet
Community
1a9dad0
domainTokenizer
/
src
/
domain_tokenizer
8.38 kB
Ctrl+K
Ctrl+K
1 contributor
History:
2 commits
rtferraz
Add schema.py β DomainSchema, FieldSpec, FieldType definitions
1a9dad0
verified
9 days ago
__init__.py
Safe
895 Bytes
Phase 2A: Core tokenizer library β schema, field tokenizers, composite builder, predefined schemas, 72 passing tests
9 days ago
schema.py
Safe
7.49 kB
Add schema.py β DomainSchema, FieldSpec, FieldType definitions
9 days ago