rtferraz
/

domainTokenizer

Model card Files Files and versions

domainTokenizer

Ctrl+K

Ctrl+K

1 contributor

History: 47 commits

rtferraz's picture

Fix model loading: use from_pretrained() instead of torch.load() for safetensors format

165b138 verified 3 days ago

docs
Add e-commerce pre-training report — successful demo, behavioral clusters found, future improvements noted 3 days ago
examples
Phase 3.0: Pipeline validation demo on mindweave/bank-transactions-us — ALL 10 CHECKS PASSED 9 days ago
notebooks
Fix model loading: use from_pretrained() instead of torch.load() for safetensors format 3 days ago
src
CRITICAL FIX: Switch from ByteLevel to Whitespace pre-tokenizer — fixes 42% UNK rate on domain token sequences 3 days ago
tests
Add fine-tuning test suite — 15 tests covering dataset, batching, forward/backward, Trainer smoke, multiclass 9 days ago
.gitattributes

1.52 kB
initial commit 9 days ago
.gitignore

452 Bytes
Add .gitignore — Python, Jupyter, training artifacts, IDE files 8 days ago
README.md

8.46 kB
Update README v0.3.0 — add usage example, update roadmap status, add implementation report link 9 days ago