rtferraz
/

domainTokenizer

Model card Files Files and versions

domainTokenizer / src /domain_tokenizer

36.9 kB

Ctrl+K

Ctrl+K

1 contributor

History: 7 commits

rtferraz's picture

Add predefined schemas (FINANCE, ECOMMERCE, HEALTHCARE)

c00ac2c verified 9 days ago

schemas
Add predefined schemas (FINANCE, ECOMMERCE, HEALTHCARE) 9 days ago
tokenizers
Add domain_tokenizer.py — DomainTokenizerBuilder (core assembler, HF integration) 9 days ago
__init__.py

895 Bytes
Phase 2A: Core tokenizer library — schema, field tokenizers, composite builder, predefined schemas, 72 passing tests 9 days ago
schema.py

7.49 kB
Add schema.py — DomainSchema, FieldSpec, FieldType definitions 9 days ago