Update README.md
Browse files
README.md
CHANGED
|
@@ -19,20 +19,20 @@ Note: it's not clear if these checkpoints have undergone knowledge distillation.
|
|
| 19 |
|
| 20 |
| |H=128|H=256|H=512|H=768|
|
| 21 |
|---|:---:|:---:|:---:|:---:|
|
| 22 |
-
| **L=2** |**2/128 (BERT-Tiny)**|[2/256][2_256]|[2/512][2_512]|[2/768][2_768]|
|
| 23 |
| **L=4** |[4/128][4_128]|[4/256 (BERT-Mini)][4_256]|[4/512 (BERT-Small)][4_512]|[4/768][4_768]|
|
| 24 |
| **L=6** |[6/128][6_128]|[6/256][6_256]|[6/512][6_512]|[6/768][6_768]|
|
| 25 |
| **L=8** |[8/128][8_128]|[8/256][8_256]|[8/512 (BERT-Medium)][8_512]|[8/768][8_768]|
|
| 26 |
| **L=10** |[10/128][10_128]|[10/256][10_256]|[10/512][10_512]|[10/768][10_768]|
|
| 27 |
| **L=12** |[12/128][12_128]|[12/256][12_256]|[12/512][12_512]|[12/768 (BERT-Base, original)][12_768]|
|
| 28 |
|
| 29 |
-
[2_128]: https://huggingface.co/gaunernst/bert-
|
| 30 |
[2_256]: https://huggingface.co/gaunernst/bert-L2-H256-uncased
|
| 31 |
[2_512]: https://huggingface.co/gaunernst/bert-L2-H512-uncased
|
| 32 |
[2_768]: https://huggingface.co/gaunernst/bert-L2-H768-uncased
|
| 33 |
[4_128]: https://huggingface.co/gaunernst/bert-L4-H128-uncased
|
| 34 |
-
[4_256]: https://huggingface.co/gaunernst/bert-
|
| 35 |
-
[4_512]: https://huggingface.co/gaunernst/bert-
|
| 36 |
[4_768]: https://huggingface.co/gaunernst/bert-L4-H768-uncased
|
| 37 |
[6_128]: https://huggingface.co/gaunernst/bert-L6-H128-uncased
|
| 38 |
[6_256]: https://huggingface.co/gaunernst/bert-L6-H256-uncased
|
|
@@ -40,7 +40,7 @@ Note: it's not clear if these checkpoints have undergone knowledge distillation.
|
|
| 40 |
[6_768]: https://huggingface.co/gaunernst/bert-L6-H768-uncased
|
| 41 |
[8_128]: https://huggingface.co/gaunernst/bert-L8-H128-uncased
|
| 42 |
[8_256]: https://huggingface.co/gaunernst/bert-L8-H256-uncased
|
| 43 |
-
[8_512]: https://huggingface.co/gaunernst/bert-
|
| 44 |
[8_768]: https://huggingface.co/gaunernst/bert-L8-H768-uncased
|
| 45 |
[10_128]: https://huggingface.co/gaunernst/bert-L10-H128-uncased
|
| 46 |
[10_256]: https://huggingface.co/gaunernst/bert-L10-H256-uncased
|
|
|
|
| 19 |
|
| 20 |
| |H=128|H=256|H=512|H=768|
|
| 21 |
|---|:---:|:---:|:---:|:---:|
|
| 22 |
+
| **L=2** |[**2/128 (BERT-Tiny)**][2_128]|[2/256][2_256]|[2/512][2_512]|[2/768][2_768]|
|
| 23 |
| **L=4** |[4/128][4_128]|[4/256 (BERT-Mini)][4_256]|[4/512 (BERT-Small)][4_512]|[4/768][4_768]|
|
| 24 |
| **L=6** |[6/128][6_128]|[6/256][6_256]|[6/512][6_512]|[6/768][6_768]|
|
| 25 |
| **L=8** |[8/128][8_128]|[8/256][8_256]|[8/512 (BERT-Medium)][8_512]|[8/768][8_768]|
|
| 26 |
| **L=10** |[10/128][10_128]|[10/256][10_256]|[10/512][10_512]|[10/768][10_768]|
|
| 27 |
| **L=12** |[12/128][12_128]|[12/256][12_256]|[12/512][12_512]|[12/768 (BERT-Base, original)][12_768]|
|
| 28 |
|
| 29 |
+
[2_128]: https://huggingface.co/gaunernst/bert-tiny-uncased
|
| 30 |
[2_256]: https://huggingface.co/gaunernst/bert-L2-H256-uncased
|
| 31 |
[2_512]: https://huggingface.co/gaunernst/bert-L2-H512-uncased
|
| 32 |
[2_768]: https://huggingface.co/gaunernst/bert-L2-H768-uncased
|
| 33 |
[4_128]: https://huggingface.co/gaunernst/bert-L4-H128-uncased
|
| 34 |
+
[4_256]: https://huggingface.co/gaunernst/bert-mini-uncased
|
| 35 |
+
[4_512]: https://huggingface.co/gaunernst/bert-small-uncased
|
| 36 |
[4_768]: https://huggingface.co/gaunernst/bert-L4-H768-uncased
|
| 37 |
[6_128]: https://huggingface.co/gaunernst/bert-L6-H128-uncased
|
| 38 |
[6_256]: https://huggingface.co/gaunernst/bert-L6-H256-uncased
|
|
|
|
| 40 |
[6_768]: https://huggingface.co/gaunernst/bert-L6-H768-uncased
|
| 41 |
[8_128]: https://huggingface.co/gaunernst/bert-L8-H128-uncased
|
| 42 |
[8_256]: https://huggingface.co/gaunernst/bert-L8-H256-uncased
|
| 43 |
+
[8_512]: https://huggingface.co/gaunernst/bert-medium-uncased
|
| 44 |
[8_768]: https://huggingface.co/gaunernst/bert-L8-H768-uncased
|
| 45 |
[10_128]: https://huggingface.co/gaunernst/bert-L10-H128-uncased
|
| 46 |
[10_256]: https://huggingface.co/gaunernst/bert-L10-H256-uncased
|