Hugging Face's logo

AnonymousCS
/
populism_classifier_404

Text Classification
Transformers
Safetensors
rembert
Generated from Trainer
Model card Files
xet
 Community
AnonymousCS commited on
Commit
4af0db9
·
verified ·
1 Parent(s): 2093ddb

End of training

Browse files
Files changed (4) hide show
  1. README.md +16 -6
  2. config.json +2 -2
  3. model.safetensors +1 -1
  4. training_args.bin +1 -1
README.md CHANGED
@@ -18,7 +18,7 @@ should probably proofread and complete it, then remove this comment. -->
18
 
19
  This model is a fine-tuned version of [google/rembert](https://huggingface.co/google/rembert) on the None dataset.
20
  It achieves the following results on the evaluation set:
21
- - Loss: 0.6921
22
  - Accuracy: 0.9711
23
  - 1-f1: 0.0
24
  - 1-recall: 0.0
@@ -48,6 +48,7 @@ The following hyperparameters were used during training:
48
  - seed: 42
49
  - optimizer: Use adamw_torch with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
50
  - lr_scheduler_type: linear
 
51
  - num_epochs: 20
52
  - mixed_precision_training: Native AMP
53
 
@@ -55,11 +56,20 @@ The following hyperparameters were used during training:
55
 
56
  | Training Loss | Epoch | Step | Validation Loss | Accuracy | 1-f1 | 1-recall | 1-precision | Balanced Acc |
57
  |:-------------:|:-----:|:----:|:---------------:|:--------:|:----:|:--------:|:-----------:|:------------:|
58
- | 0.0183 | 1.0 | 494 | 0.6883 | 0.9711 | 0.0 | 0.0 | 0.0 | 0.5 |
59
- | 0.0122 | 2.0 | 988 | 0.7502 | 0.9711 | 0.0 | 0.0 | 0.0 | 0.5 |
60
- | 0.7195 | 3.0 | 1482 | 0.6656 | 0.9711 | 0.0 | 0.0 | 0.0 | 0.5 |
61
- | 0.7508 | 4.0 | 1976 | 0.7184 | 0.9711 | 0.0 | 0.0 | 0.0 | 0.5 |
62
- | 0.7399 | 5.0 | 2470 | 0.6921 | 0.9711 | 0.0 | 0.0 | 0.0 | 0.5 |
 
 
 
 
 
 
 
 
 
63
 
64
 
65
  ### Framework versions
 
18
 
19
  This model is a fine-tuned version of [google/rembert](https://huggingface.co/google/rembert) on the None dataset.
20
  It achieves the following results on the evaluation set:
21
+ - Loss: 0.6947
22
  - Accuracy: 0.9711
23
  - 1-f1: 0.0
24
  - 1-recall: 0.0
 
48
  - seed: 42
49
  - optimizer: Use adamw_torch with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
50
  - lr_scheduler_type: linear
51
+ - lr_scheduler_warmup_ratio: 0.06
52
  - num_epochs: 20
53
  - mixed_precision_training: Native AMP
54
 
 
56
 
57
  | Training Loss | Epoch | Step | Validation Loss | Accuracy | 1-f1 | 1-recall | 1-precision | Balanced Acc |
58
  |:-------------:|:-----:|:----:|:---------------:|:--------:|:----:|:--------:|:-----------:|:------------:|
59
+ | 0.0097 | 1.0 | 494 | 1.0695 | 0.9711 | 0.0 | 0.0 | 0.0 | 0.5 |
60
+ | 0.004 | 2.0 | 988 | 1.0047 | 0.9711 | 0.0 | 0.0 | 0.0 | 0.5 |
61
+ | 0.8165 | 3.0 | 1482 | 0.7731 | 0.9711 | 0.0 | 0.0 | 0.0 | 0.5 |
62
+ | 0.9303 | 4.0 | 1976 | 0.8081 | 0.9711 | 0.0 | 0.0 | 0.0 | 0.5 |
63
+ | 0.8644 | 5.0 | 2470 | 0.7191 | 0.9711 | 0.0 | 0.0 | 0.0 | 0.5 |
64
+ | 1.0654 | 6.0 | 2964 | 0.7048 | 0.9711 | 0.0 | 0.0 | 0.0 | 0.5 |
65
+ | 0.0221 | 7.0 | 3458 | 0.6890 | 0.9711 | 0.0 | 0.0 | 0.0 | 0.5 |
66
+ | 0.0194 | 8.0 | 3952 | 0.7002 | 0.9711 | 0.0 | 0.0 | 0.0 | 0.5 |
67
+ | 0.0413 | 9.0 | 4446 | 0.6181 | 0.9711 | 0.0 | 0.0 | 0.0 | 0.5 |
68
+ | 1.3684 | 10.0 | 4940 | 0.6951 | 0.9711 | 0.0 | 0.0 | 0.0 | 0.5 |
69
+ | 0.7941 | 11.0 | 5434 | 0.7525 | 0.9711 | 0.0 | 0.0 | 0.0 | 0.5 |
70
+ | 0.672 | 12.0 | 5928 | 0.6746 | 0.9711 | 0.0 | 0.0 | 0.0 | 0.5 |
71
+ | 1.0709 | 13.0 | 6422 | 0.7167 | 0.9711 | 0.0 | 0.0 | 0.0 | 0.5 |
72
+ | 1.3019 | 14.0 | 6916 | 0.6947 | 0.9711 | 0.0 | 0.0 | 0.0 | 0.5 |
73
 
74
 
75
  ### Framework versions
config.json CHANGED
@@ -3,14 +3,14 @@
3
  "architectures": [
4
  "RemBertForSequenceClassification"
5
  ],
6
- "attention_probs_dropout_prob": 0,
7
  "bos_token_id": 312,
8
  "classifier_dropout_prob": 0.1,
9
  "embedding_dropout_prob": 0,
10
  "embedding_size": 256,
11
  "eos_token_id": 313,
12
  "hidden_act": "gelu",
13
- "hidden_dropout_prob": 0,
14
  "hidden_size": 1152,
15
  "initializer_range": 0.02,
16
  "input_embedding_size": 256,
 
3
  "architectures": [
4
  "RemBertForSequenceClassification"
5
  ],
6
+ "attention_probs_dropout_prob": 0.2,
7
  "bos_token_id": 312,
8
  "classifier_dropout_prob": 0.1,
9
  "embedding_dropout_prob": 0,
10
  "embedding_size": 256,
11
  "eos_token_id": 313,
12
  "hidden_act": "gelu",
13
+ "hidden_dropout_prob": 0.2,
14
  "hidden_size": 1152,
15
  "initializer_range": 0.02,
16
  "input_embedding_size": 256,
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:e84c03af2a43eedd3a615dcb4c552c7bd5f4292d7113453b48a09f14b2a6d678
3
  size 2303755328
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:66cfd03be2c2ae48c2fc88774c106bc9b15a859f484600a2e0f61cabe3422595
3
  size 2303755328
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:1e608eef53a16ea48887864c681f4608a76c0a5911e56c81d8464fe45c8c8986
3
  size 5432
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0b1a4f4fbc05f2a158e7f7986e517172d9b8b6243e96993173f4b6ccfaa47317
3
  size 5432