Causal transformers trained on random chess games. Testbed for finetuning at small scales.