rtferraz
/

domainTokenizer

Model card Files Files and versions

domainTokenizer / src /domain_tokenizer

Ctrl+K

Ctrl+K

1 contributor

History: 9 commits

rtferraz's picture

Add DomainTransformerConfig with presets (24M/85M/330M)

15fbfea verified 9 days ago

models
Add DomainTransformerConfig with presets (24M/85M/330M) 9 days ago
schemas
Add predefined schemas (FINANCE, ECOMMERCE, HEALTHCARE) 9 days ago
tokenizers
Add domain_tokenizer.py — DomainTokenizerBuilder (core assembler, HF integration) 9 days ago
__init__.py

895 Bytes
Phase 2A: Core tokenizer library — schema, field tokenizers, composite builder, predefined schemas, 72 passing tests 9 days ago
schema.py

7.49 kB
Add schema.py — DomainSchema, FieldSpec, FieldType definitions 9 days ago