Commit History

Add domain_tokenizer.py β€” DomainTokenizerBuilder (core assembler, HF integration)
818a2e9
verified

rtferraz commited on

Add field_tokenizers.py β€” Sign, MagnitudeBucket, Calendar, Categorical, DiscreteNumerical tokenizers
511f3aa
verified

rtferraz commited on

Add tokenizers package init
0b06df3
verified

rtferraz commited on

Add schemas package init
04b1d24
verified

rtferraz commited on

Add schema.py β€” DomainSchema, FieldSpec, FieldType definitions
1a9dad0
verified

rtferraz commited on

Phase 2A: Core tokenizer library β€” schema, field tokenizers, composite builder, predefined schemas, 72 passing tests
0c1ca58
verified

rtferraz commited on