google_mobilebert-uncased fold 1

README.md

@@ -21,11 +21,11 @@ should probably proofread and complete it, then remove this comment. -->
 
 This model is a fine-tuned version of [google/mobilebert-uncased](https://huggingface.co/google/mobilebert-uncased) on the None dataset.
 It achieves the following results on the evaluation set:
-- Loss: nan
-- Accuracy: 0.5411
-- F1: 0.0
-- Precision: 0.0
-- Recall: 0.0
+- Loss: 0.1152
+- Accuracy: 0.9599
+- F1: 0.9558
+- Precision: 0.9651
+- Recall: 0.9468
 
 ## Model description
 
@@ -51,15 +51,14 @@ The following hyperparameters were used during training:
 - optimizer: Use OptimizerNames.ADAMW_TORCH_FUSED with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
 - lr_scheduler_type: linear
 - num_epochs: 3
-- mixed_precision_training: Native AMP
 
 ### Training results
 
-| Training Loss | Epoch | Step  | Validation Loss | Accuracy | F1  | Precision | Recall |
-|:-------------:|:-----:|:-----:|:---------------:|:--------:|:---:|:---------:|:------:|
-| 0.0           | 1.0   | 15481 | nan             | 0.5411   | 0.0 | 0.0       | 0.0    |
-| 0.0           | 2.0   | 30962 | nan             | 0.5411   | 0.0 | 0.0       | 0.0    |
-| 0.0           | 3.0   | 46443 | nan             | 0.5411   | 0.0 | 0.0       | 0.0    |
+| Training Loss | Epoch | Step  | Validation Loss | Accuracy | F1     | Precision | Recall |
+|:-------------:|:-----:|:-----:|:---------------:|:--------:|:------:|:---------:|:------:|
+| 1.3193        | 1.0   | 15481 | 0.1280          | 0.9516   | 0.9469 | 0.9543    | 0.9395 |
+| 0.0943        | 2.0   | 30962 | 0.1130          | 0.9580   | 0.9537 | 0.9634    | 0.9443 |
+| 0.0854        | 3.0   | 46443 | 0.1152          | 0.9599   | 0.9558 | 0.9651    | 0.9468 |
 
 
 ### Framework versions