jmmr-8282 commited on
Commit
645ade6
·
verified ·
1 Parent(s): 1281fe1

jmmr-8282/llm

Browse files
Files changed (1) hide show
  1. README.md +7 -7
README.md CHANGED
@@ -16,7 +16,7 @@ should probably proofread and complete it, then remove this comment. -->
16
 
17
  This model is a fine-tuned version of [bert-base-uncased](https://huggingface.co/bert-base-uncased) on an unknown dataset.
18
  It achieves the following results on the evaluation set:
19
- - Loss: 1.2850
20
 
21
  ## Model description
22
 
@@ -35,7 +35,7 @@ More information needed
35
  ### Training hyperparameters
36
 
37
  The following hyperparameters were used during training:
38
- - learning_rate: 2e-05
39
  - train_batch_size: 32
40
  - eval_batch_size: 32
41
  - seed: 42
@@ -48,11 +48,11 @@ The following hyperparameters were used during training:
48
 
49
  | Training Loss | Epoch | Step | Validation Loss |
50
  |:-------------:|:-----:|:----:|:---------------:|
51
- | 1.3748 | 1.0 | 782 | 1.3371 |
52
- | 1.3346 | 2.0 | 1564 | 1.3119 |
53
- | 1.3204 | 3.0 | 2346 | 1.2964 |
54
- | 1.3031 | 4.0 | 3128 | 1.2872 |
55
- | 1.2987 | 5.0 | 3910 | 1.2850 |
56
 
57
 
58
  ### Framework versions
 
16
 
17
  This model is a fine-tuned version of [bert-base-uncased](https://huggingface.co/bert-base-uncased) on an unknown dataset.
18
  It achieves the following results on the evaluation set:
19
+ - Loss: 0.7738
20
 
21
  ## Model description
22
 
 
35
  ### Training hyperparameters
36
 
37
  The following hyperparameters were used during training:
38
+ - learning_rate: 1e-05
39
  - train_batch_size: 32
40
  - eval_batch_size: 32
41
  - seed: 42
 
48
 
49
  | Training Loss | Epoch | Step | Validation Loss |
50
  |:-------------:|:-----:|:----:|:---------------:|
51
+ | 1.2637 | 1.0 | 782 | 1.0078 |
52
+ | 0.9520 | 2.0 | 1564 | 0.8574 |
53
+ | 0.8983 | 3.0 | 2346 | 0.8017 |
54
+ | 0.8357 | 4.0 | 3128 | 0.7798 |
55
+ | 0.8223 | 5.0 | 3910 | 0.7738 |
56
 
57
 
58
  ### Framework versions