Hugging Face
Models
Datasets
Spaces
Buckets
new
Docs
Enterprise
Pricing
Log In
Sign Up
rtferraz
/
domainTokenizer
like
0
arxiv:
9 papers
Model card
Files
Files and versions
xet
Community
46a6d37
domainTokenizer
/
src
/
domain_tokenizer
/
training
15.4 kB
Ctrl+K
Ctrl+K
1 contributor
History:
5 commits
rtferraz
Add finetune.py — finetune_domain_model (HF Trainer Pattern A, auto tabular_features passthrough)
46a6d37
verified
11 days ago
__init__.py
Safe
315 Bytes
Phase 2C: Pre-training pipeline — data pipeline, sequence packing, HF Trainer CLM, 124 total tests passing
11 days ago
data_pipeline.py
Safe
3.65 kB
Add data_pipeline.py — tokenize_user_sequences, pack_sequences, prepare_clm_dataset
11 days ago
finetune.py
Safe
3.35 kB
Add finetune.py — finetune_domain_model (HF Trainer Pattern A, auto tabular_features passthrough)
11 days ago
finetune_data.py
Safe
3.45 kB
Phase 2D: Fine-tuning pipeline — DomainFinetuneDataset, finetune_domain_model, 139 total tests passing
11 days ago
pretrain.py
Safe
4.62 kB
Add pretrain.py — pretrain_domain_model with HF Trainer, cosine schedule, DataCollatorForLanguageModeling
11 days ago
