Update README.md
Browse files
README.md
CHANGED
|
@@ -22,27 +22,27 @@ datasets:
|
|
| 22 |
|
| 23 |
**arXiv link COMING SOON** <br>
|
| 24 |
|
| 25 |
-
[](https://huggingface.co/datasets/ethanjtang/GAMBIT-lichess-puzzle-positions) <br>
|
| 27 |
[](https://huggingface.co/datasets/ethanjtang/GAMBIT-stockfish18-selfplay) <br>
|
| 28 |
|
| 29 |
## Variants
|
| 30 |
|
| 31 |
-
###
|
| 32 |
|
| 33 |
-
|
| 34 |
|
| 35 |
Achieved `train loss 0.3590, val loss 0.3704` on puzzles corpus after training for ~500B tokens.
|
| 36 |
|
| 37 |
-
###
|
| 38 |
|
| 39 |
-
|
| 40 |
|
| 41 |
Achieved `train loss 0.0974, val loss 1.7554` (overfitting due to small dataset size) on selfplay corpus after training for ~25B tokens.
|
| 42 |
|
| 43 |
-
###
|
| 44 |
|
| 45 |
-
|
| 46 |
|
| 47 |
Achieved `train loss 0.3594, val loss 0.3710` on combined corpus after training for ~500B tokens.
|
| 48 |
|
|
|
|
| 22 |
|
| 23 |
**arXiv link COMING SOON** <br>
|
| 24 |
|
| 25 |
+
[](https://github.com/ethanjtang/KinGPT) <br>
|
| 26 |
[](https://huggingface.co/datasets/ethanjtang/GAMBIT-lichess-puzzle-positions) <br>
|
| 27 |
[](https://huggingface.co/datasets/ethanjtang/GAMBIT-stockfish18-selfplay) <br>
|
| 28 |
|
| 29 |
## Variants
|
| 30 |
|
| 31 |
+
### KinGPT-Woodpecker
|
| 32 |
|
| 33 |
+
KinGPT variant trained on 13,341,057 unique puzzle positions (FEN + best move pairs).
|
| 34 |
|
| 35 |
Achieved `train loss 0.3590, val loss 0.3704` on puzzles corpus after training for ~500B tokens.
|
| 36 |
|
| 37 |
+
### KinGPT-Beaver
|
| 38 |
|
| 39 |
+
KinGPT variant trained on 54,681 unique positions generated from 1050 Stockfish 18 self-play games.
|
| 40 |
|
| 41 |
Achieved `train loss 0.0974, val loss 1.7554` (overfitting due to small dataset size) on selfplay corpus after training for ~25B tokens.
|
| 42 |
|
| 43 |
+
### KinGPT-Chimera
|
| 44 |
|
| 45 |
+
KinGPT variant trained on combined dataset of 13,395,738 Woodpecker and Beaver variant positions.
|
| 46 |
|
| 47 |
Achieved `train loss 0.3594, val loss 0.3710` on combined corpus after training for ~500B tokens.
|
| 48 |
|