End of training

README.md

@@ -12,6 +12,8 @@ should probably proofread and complete it, then remove this comment. -->
 # mt5-base
 
 This model was trained from scratch on an unknown dataset.
+It achieves the following results on the evaluation set:
+- Loss: nan
 
 ## Model description
 
@@ -30,20 +32,20 @@ More information needed
 ### Training hyperparameters
 
 The following hyperparameters were used during training:
-- learning_rate: 0.0002
-- train_batch_size: 2
-- eval_batch_size: 2
+- learning_rate: 2e-05
+- train_batch_size: 4
+- eval_batch_size: 4
 - seed: 42
 - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
 - lr_scheduler_type: linear
-- num_epochs: 0.01
+- num_epochs: 0.11
 - mixed_precision_training: Native AMP
 
 ### Training results
 
 | Training Loss | Epoch | Step | Validation Loss |
 |:-------------:|:-----:|:----:|:---------------:|
-| No log        | 0.01  | 261  | nan             |
+| 0.0           | 0.11  | 1431 | nan             |
 
 
 ### Framework versions

runs/Dec03_17-04-34_9e16d6131049/events.out.tfevents.1701624376.9e16d6131049.601.0

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:661dd401ccdfb1d99ff0810e658e686c920eaf322b3fb3e94ba7c7b4c908879b
-size 4932
+oid sha256:726d51e600ef5ccafa21e83bfe05657d55f496d3ae2f6205188034ffc223449d
+size 5557