Commit ·
9d1e02c
1
Parent(s): 02eb230
Upload TFBertForMaskedLM
Browse files- README.md +6 -8
- config.json +1 -1
- tf_model.h5 +2 -2
README.md
CHANGED
|
@@ -14,9 +14,9 @@ probably proofread and complete it, then remove this comment. -->
|
|
| 14 |
|
| 15 |
This model is a fine-tuned version of [justinian336/chupeto](https://huggingface.co/justinian336/chupeto) on an unknown dataset.
|
| 16 |
It achieves the following results on the evaluation set:
|
| 17 |
-
- Train Loss: 0.
|
| 18 |
-
- Validation Loss: 0.
|
| 19 |
-
- Epoch:
|
| 20 |
|
| 21 |
## Model description
|
| 22 |
|
|
@@ -42,15 +42,13 @@ The following hyperparameters were used during training:
|
|
| 42 |
|
| 43 |
| Train Loss | Validation Loss | Epoch |
|
| 44 |
|:----------:|:---------------:|:-----:|
|
| 45 |
-
| 0.
|
| 46 |
-
| 0.
|
| 47 |
-
| 0.9574 | 0.8913 | 2 |
|
| 48 |
-
| 0.9468 | 0.8882 | 3 |
|
| 49 |
|
| 50 |
|
| 51 |
### Framework versions
|
| 52 |
|
| 53 |
-
- Transformers 4.
|
| 54 |
- TensorFlow 2.11.0
|
| 55 |
- Datasets 2.10.1
|
| 56 |
- Tokenizers 0.13.2
|
|
|
|
| 14 |
|
| 15 |
This model is a fine-tuned version of [justinian336/chupeto](https://huggingface.co/justinian336/chupeto) on an unknown dataset.
|
| 16 |
It achieves the following results on the evaluation set:
|
| 17 |
+
- Train Loss: 0.9364
|
| 18 |
+
- Validation Loss: 0.8661
|
| 19 |
+
- Epoch: 1
|
| 20 |
|
| 21 |
## Model description
|
| 22 |
|
|
|
|
| 42 |
|
| 43 |
| Train Loss | Validation Loss | Epoch |
|
| 44 |
|:----------:|:---------------:|:-----:|
|
| 45 |
+
| 0.9454 | 0.8668 | 0 |
|
| 46 |
+
| 0.9364 | 0.8661 | 1 |
|
|
|
|
|
|
|
| 47 |
|
| 48 |
|
| 49 |
### Framework versions
|
| 50 |
|
| 51 |
+
- Transformers 4.27.2
|
| 52 |
- TensorFlow 2.11.0
|
| 53 |
- Datasets 2.10.1
|
| 54 |
- Tokenizers 0.13.2
|
config.json
CHANGED
|
@@ -24,7 +24,7 @@
|
|
| 24 |
"pooler_type": "first_token_transform",
|
| 25 |
"position_embedding_type": "absolute",
|
| 26 |
"torch_dtype": "float32",
|
| 27 |
-
"transformers_version": "4.
|
| 28 |
"type_vocab_size": 2,
|
| 29 |
"use_cache": true,
|
| 30 |
"vocab_size": 119547
|
|
|
|
| 24 |
"pooler_type": "first_token_transform",
|
| 25 |
"position_embedding_type": "absolute",
|
| 26 |
"torch_dtype": "float32",
|
| 27 |
+
"transformers_version": "4.27.2",
|
| 28 |
"type_vocab_size": 2,
|
| 29 |
"use_cache": true,
|
| 30 |
"vocab_size": 119547
|
tf_model.h5
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
-
size
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:1368c731690d6e12bcf8ec5e9b6966c56a9b58996484c33053b45eadce7b6590
|
| 3 |
+
size 1081013316
|