ssc-bxk-mms-model-mix-adapt-max-lowlr

This model was trained from scratch on an unknown dataset. It achieves the following results on the evaluation set:

• Loss: 0.5721
• Cer: 0.1461
• Wer: 0.5402

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 0.0003
• train_batch_size: 2
• eval_batch_size: 6
• seed: 42
• gradient_accumulation_steps: 2
• total_train_batch_size: 4
• optimizer: Use OptimizerNames.ADAMW_TORCH_FUSED with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
• lr_scheduler_type: linear
• lr_scheduler_warmup_steps: 100
• num_epochs: 5
• mixed_precision_training: Native AMP

Training results

Training Loss	Epoch	Step	Validation Loss	Cer	Wer
0.4413	0.4872	200	0.5991	0.1537	0.5712
0.4481	0.9744	400	0.5851	0.1504	0.5558
0.4538	1.4604	600	0.5879	0.1477	0.5460
0.4352	1.9476	800	0.5672	0.1492	0.5482
0.3978	2.4336	1000	0.5721	0.1484	0.5443
0.4042	2.9208	1200	0.5711	0.1475	0.5400
0.4011	3.4068	1400	0.5715	0.1466	0.5397
0.4026	3.8940	1600	0.5753	0.1471	0.5425
0.3845	4.3800	1800	0.5719	0.1465	0.5405
0.3741	4.8672	2000	0.5721	0.1461	0.5402

Framework versions

• Transformers 4.57.2
• Pytorch 2.9.1+cu128
• Datasets 3.6.0
• Tokenizers 0.22.0