rtferraz
/

domainTokenizer

Model card Files Files and versions

domainTokenizer

Ctrl+K

Ctrl+K

1 contributor

History: 44 commits

rtferraz's picture

Update 02_ecommerce notebook: add HF login, memory-free cell, subsample option for <64GB RAM machines

2410b7e verified 5 days ago

docs
Add finance pre-training report — honest analysis of results and lessons learned 9 days ago
examples
Phase 3.0: Pipeline validation demo on mindweave/bank-transactions-us — ALL 10 CHECKS PASSED 10 days ago
notebooks
Update 02_ecommerce notebook: add HF login, memory-free cell, subsample option for <64GB RAM machines 5 days ago
src
CRITICAL FIX: Switch from ByteLevel to Whitespace pre-tokenizer — fixes 42% UNK rate on domain token sequences 5 days ago
tests
Add fine-tuning test suite — 15 tests covering dataset, batching, forward/backward, Trainer smoke, multiclass 10 days ago
.gitattributes

1.52 kB
initial commit 11 days ago
.gitignore

452 Bytes
Add .gitignore — Python, Jupyter, training artifacts, IDE files 9 days ago
README.md

8.46 kB
Update README v0.3.0 — add usage example, update roadmap status, add implementation report link 10 days ago