Hugging Face's logo

cuongpp
/
bartpho-word-base-ed

Transformers
TensorBoard
Safetensors
mbart
text2text-generation
Generated from Trainer
Model card Files
xet
 Metrics Community
cuongpp commited on
Commit
00d7125
·
verified ·
1 Parent(s): 320b80c

End of training

Browse files
Files changed (3) hide show
  1. README.md +15 -10
  2. model.safetensors +1 -1
  3. runs/Jun17_16-07-37_106344409c76/events.out.tfevents.1718640481.106344409c76.235.0 +2 -2
README.md CHANGED
@@ -14,13 +14,13 @@ should probably proofread and complete it, then remove this comment. -->
14
 
15
  This model is a fine-tuned version of [vinai/bartpho-word-base](https://huggingface.co/vinai/bartpho-word-base) on an unknown dataset.
16
  It achieves the following results on the evaluation set:
17
- - Loss: 0.0125
18
- - F1 Micro: 0.7420
19
- - Recall Micro: 0.6752
20
- - Precision Micro: 0.8234
21
- - F1 Macro: 0.1574
22
- - Recall Macro: 0.1447
23
- - Precision Macro: 0.1833
24
 
25
  ## Model description
26
 
@@ -43,16 +43,21 @@ The following hyperparameters were used during training:
43
  - train_batch_size: 8
44
  - eval_batch_size: 8
45
  - seed: 42
 
 
46
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
47
  - lr_scheduler_type: linear
48
- - num_epochs: 1
49
- - mixed_precision_training: Native AMP
50
 
51
  ### Training results
52
 
53
  | Training Loss | Epoch | Step | Validation Loss | F1 Micro | Recall Micro | Precision Micro | F1 Macro | Recall Macro | Precision Macro |
54
  |:-------------:|:-----:|:----:|:---------------:|:--------:|:------------:|:---------------:|:--------:|:------------:|:---------------:|
55
- | 0.018 | 1.0 | 1492 | 0.0125 | 0.7420 | 0.6752 | 0.8234 | 0.1574 | 0.1447 | 0.1833 |
 
 
 
 
56
 
57
 
58
  ### Framework versions
 
14
 
15
  This model is a fine-tuned version of [vinai/bartpho-word-base](https://huggingface.co/vinai/bartpho-word-base) on an unknown dataset.
16
  It achieves the following results on the evaluation set:
17
+ - Loss: 0.0119
18
+ - F1 Micro: 0.7414
19
+ - Recall Micro: 0.6649
20
+ - Precision Micro: 0.8378
21
+ - F1 Macro: 0.1869
22
+ - Recall Macro: 0.1816
23
+ - Precision Macro: 0.1949
24
 
25
  ## Model description
26
 
 
43
  - train_batch_size: 8
44
  - eval_batch_size: 8
45
  - seed: 42
46
+ - gradient_accumulation_steps: 4
47
+ - total_train_batch_size: 32
48
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
49
  - lr_scheduler_type: linear
50
+ - num_epochs: 5
 
51
 
52
  ### Training results
53
 
54
  | Training Loss | Epoch | Step | Validation Loss | F1 Micro | Recall Micro | Precision Micro | F1 Macro | Recall Macro | Precision Macro |
55
  |:-------------:|:-----:|:----:|:---------------:|:--------:|:------------:|:---------------:|:--------:|:------------:|:---------------:|
56
+ | No log | 1.0 | 373 | 0.0156 | 0.7286 | 0.6544 | 0.8219 | 0.1709 | 0.1813 | 0.1667 |
57
+ | 0.1321 | 2.0 | 746 | 0.0124 | 0.7387 | 0.6563 | 0.8448 | 0.1711 | 0.1599 | 0.1889 |
58
+ | 0.0134 | 3.0 | 1119 | 0.0126 | 0.7290 | 0.6488 | 0.8319 | 0.1842 | 0.1897 | 0.1866 |
59
+ | 0.0134 | 4.0 | 1492 | 0.0119 | 0.7490 | 0.6859 | 0.8248 | 0.1820 | 0.1644 | 0.2081 |
60
+ | 0.0105 | 5.0 | 1865 | 0.0119 | 0.7414 | 0.6649 | 0.8378 | 0.1869 | 0.1816 | 0.1949 |
61
 
62
 
63
  ### Framework versions
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:f0ef7c833770857231db9ad0c2a3e3de14d088c7494caa648f452a249c4fbb78
3
  size 600177236
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:dd0803b889682cb8c90d31a54ea78f211b6169664cce93babc6385d8c1f0aeec
3
  size 600177236
runs/Jun17_16-07-37_106344409c76/events.out.tfevents.1718640481.106344409c76.235.0 CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:c428fcc2245b6fc2daa65f0c4440bfd8dcfa9fbd31f02566b0843a73143e9d20
3
- size 8931
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4938ad6e2f8af484bed5701407d2c80784ca06ad3c82c01e7f5f570a9da3c8ad
3
+ size 9285