rtferraz
/

domainTokenizer

Model card Files Files and versions

domainTokenizer / src /domain_tokenizer /training

Ctrl+K

Ctrl+K

1 contributor

History: 3 commits

rtferraz's picture

Add pretrain.py — pretrain_domain_model with HF Trainer, cosine schedule, DataCollatorForLanguageModeling

6ccb9e6 verified 25 days ago

__init__.py

315 Bytes
Phase 2C: Pre-training pipeline — data pipeline, sequence packing, HF Trainer CLM, 124 total tests passing 25 days ago
data_pipeline.py

3.65 kB
Add data_pipeline.py — tokenize_user_sequences, pack_sequences, prepare_clm_dataset 25 days ago
pretrain.py

4.62 kB
Add pretrain.py — pretrain_domain_model with HF Trainer, cosine schedule, DataCollatorForLanguageModeling 25 days ago