rtferraz
/

domainTokenizer

Model card Files Files and versions

domainTokenizer

339 kB

Ctrl+K

Ctrl+K

1 contributor

History: 45 commits

rtferraz's picture

Add e-commerce pre-training report — successful demo, behavioral clusters found, future improvements noted

2b3e3af verified 2 days ago

docs
Add e-commerce pre-training report — successful demo, behavioral clusters found, future improvements noted 2 days ago
examples
Phase 3.0: Pipeline validation demo on mindweave/bank-transactions-us — ALL 10 CHECKS PASSED 8 days ago
notebooks
Update 02_ecommerce notebook: add HF login, memory-free cell, subsample option for <64GB RAM machines 2 days ago
src
CRITICAL FIX: Switch from ByteLevel to Whitespace pre-tokenizer — fixes 42% UNK rate on domain token sequences 2 days ago
tests
Add fine-tuning test suite — 15 tests covering dataset, batching, forward/backward, Trainer smoke, multiclass 8 days ago
.gitattributes

1.52 kB
initial commit 8 days ago
.gitignore

452 Bytes
Add .gitignore — Python, Jupyter, training artifacts, IDE files 7 days ago
README.md

8.46 kB
Update README v0.3.0 — add usage example, update roadmap status, add implementation report link 8 days ago