Text Generation
English
chess
puzzles
chess-games
stockfish
fen
best-move
uci
san
text-generation-inference
ethanjtang commited on
Commit
5d8e6d3
·
verified ·
1 Parent(s): 5fa4515

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +7 -7
README.md CHANGED
@@ -22,27 +22,27 @@ datasets:
22
 
23
  **arXiv link COMING SOON** <br>
24
 
25
- [![GitHub](https://img.shields.io/badge/GitHub-KINGPT-black.svg?style=for-the-badge)](https://github.com/ethanjtang/KINGPT) <br>
26
  [![HuggingFace](https://img.shields.io/badge/🤗_HuggingFace-Puzzles-yellow?style=for-the-badge)](https://huggingface.co/datasets/ethanjtang/GAMBIT-lichess-puzzle-positions) <br>
27
  [![HuggingFace](https://img.shields.io/badge/🤗_HuggingFace-SF18%20Selfplay-yellow?style=for-the-badge)](https://huggingface.co/datasets/ethanjtang/GAMBIT-stockfish18-selfplay) <br>
28
 
29
  ## Variants
30
 
31
- ### KINGPT-Woodpecker
32
 
33
- KINGPT variant trained on 13,341,057 unique puzzle positions (FEN + best move pairs).
34
 
35
  Achieved `train loss 0.3590, val loss 0.3704` on puzzles corpus after training for ~500B tokens.
36
 
37
- ### KINGPT-Beaver
38
 
39
- KINGPT variant trained on 54,681 unique positions generated from 1050 Stockfish 18 self-play games.
40
 
41
  Achieved `train loss 0.0974, val loss 1.7554` (overfitting due to small dataset size) on selfplay corpus after training for ~25B tokens.
42
 
43
- ### KINGPT-Chimera
44
 
45
- KINGPT variant trained on combined dataset of 13,395,738 Woodpecker and Beaver variant positions.
46
 
47
  Achieved `train loss 0.3594, val loss 0.3710` on combined corpus after training for ~500B tokens.
48
 
 
22
 
23
  **arXiv link COMING SOON** <br>
24
 
25
+ [![GitHub](https://img.shields.io/badge/GitHub-KinGPT-black.svg?style=for-the-badge)](https://github.com/ethanjtang/KinGPT) <br>
26
  [![HuggingFace](https://img.shields.io/badge/🤗_HuggingFace-Puzzles-yellow?style=for-the-badge)](https://huggingface.co/datasets/ethanjtang/GAMBIT-lichess-puzzle-positions) <br>
27
  [![HuggingFace](https://img.shields.io/badge/🤗_HuggingFace-SF18%20Selfplay-yellow?style=for-the-badge)](https://huggingface.co/datasets/ethanjtang/GAMBIT-stockfish18-selfplay) <br>
28
 
29
  ## Variants
30
 
31
+ ### KinGPT-Woodpecker
32
 
33
+ KinGPT variant trained on 13,341,057 unique puzzle positions (FEN + best move pairs).
34
 
35
  Achieved `train loss 0.3590, val loss 0.3704` on puzzles corpus after training for ~500B tokens.
36
 
37
+ ### KinGPT-Beaver
38
 
39
+ KinGPT variant trained on 54,681 unique positions generated from 1050 Stockfish 18 self-play games.
40
 
41
  Achieved `train loss 0.0974, val loss 1.7554` (overfitting due to small dataset size) on selfplay corpus after training for ~25B tokens.
42
 
43
+ ### KinGPT-Chimera
44
 
45
+ KinGPT variant trained on combined dataset of 13,395,738 Woodpecker and Beaver variant positions.
46
 
47
  Achieved `train loss 0.3594, val loss 0.3710` on combined corpus after training for ~500B tokens.
48