Hugging Face
Models
Datasets
Spaces
Buckets
new
Docs
Enterprise
Pricing
Log In
Sign Up
rtferraz
/
domainTokenizer
like
0
arxiv:
9 papers
Model card
Files
Files and versions
xet
Community
511f3aa
domainTokenizer
/
src
/
domain_tokenizer
21.3 kB
Ctrl+K
Ctrl+K
1 contributor
History:
5 commits
rtferraz
Add field_tokenizers.py β Sign, MagnitudeBucket, Calendar, Categorical, DiscreteNumerical tokenizers
511f3aa
verified
9 days ago
schemas
Add schemas package init
9 days ago
tokenizers
Add field_tokenizers.py β Sign, MagnitudeBucket, Calendar, Categorical, DiscreteNumerical tokenizers
9 days ago
__init__.py
Safe
895 Bytes
Phase 2A: Core tokenizer library β schema, field tokenizers, composite builder, predefined schemas, 72 passing tests
9 days ago
schema.py
Safe
7.49 kB
Add schema.py β DomainSchema, FieldSpec, FieldType definitions
9 days ago