rtferraz
/

domainTokenizer

Model card Files Files and versions

domainTokenizer / src /domain_tokenizer

37.5 kB

Ctrl+K

Ctrl+K

1 contributor

History: 8 commits

rtferraz's picture

Phase 2B: Model architecture — DomainTransformerForCausalLM (NoPE, GPT-style), PLR embeddings, DCNv2 + JointFusion, 105 passing tests

2f5969e verified 9 days ago

models
Phase 2B: Model architecture — DomainTransformerForCausalLM (NoPE, GPT-style), PLR embeddings, DCNv2 + JointFusion, 105 passing tests 9 days ago
schemas
Add predefined schemas (FINANCE, ECOMMERCE, HEALTHCARE) 9 days ago
tokenizers
Add domain_tokenizer.py — DomainTokenizerBuilder (core assembler, HF integration) 9 days ago
__init__.py

895 Bytes
Phase 2A: Core tokenizer library — schema, field tokenizers, composite builder, predefined schemas, 72 passing tests 9 days ago
schema.py

7.49 kB
Add schema.py — DomainSchema, FieldSpec, FieldType definitions 9 days ago