Update README.md
Browse files
README.md
CHANGED
|
@@ -1,70 +1,91 @@
|
|
| 1 |
-
|
| 2 |
-
|
| 3 |
-
|
| 4 |
-
|
| 5 |
-
|
| 6 |
-
|
| 7 |
-
-
|
| 8 |
-
|
| 9 |
-
-
|
| 10 |
-
|
| 11 |
-
|
| 12 |
-
-
|
| 13 |
-
-
|
| 14 |
-
-
|
| 15 |
-
|
| 16 |
-
|
| 17 |
-
|
| 18 |
-
|
| 19 |
-
|
| 20 |
-
-
|
| 21 |
-
-
|
| 22 |
-
|
| 23 |
-
|
| 24 |
-
|
| 25 |
-
|
| 26 |
-
``
|
| 27 |
-
|
| 28 |
-
|
| 29 |
-
|
| 30 |
-
|
| 31 |
-
|
| 32 |
-
|
| 33 |
-
|
| 34 |
-
|
| 35 |
-
|
| 36 |
-
|
| 37 |
-
#
|
| 38 |
-
|
| 39 |
-
|
| 40 |
-
|
| 41 |
-
|
| 42 |
-
|
| 43 |
-
|
| 44 |
-
|
| 45 |
-
|
| 46 |
-
|
| 47 |
-
|
| 48 |
-
|
| 49 |
-
|
| 50 |
-
|
| 51 |
-
|
| 52 |
-
|
| 53 |
-
|
| 54 |
-
|
| 55 |
-
#
|
| 56 |
-
|
| 57 |
-
|
| 58 |
-
|
| 59 |
-
|
| 60 |
-
|
| 61 |
-
|
| 62 |
-
|
| 63 |
-
|
| 64 |
-
|
| 65 |
-
|
| 66 |
-
|
| 67 |
-
|
| 68 |
-
|
| 69 |
-
|
| 70 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
license: apache-2.0
|
| 3 |
+
language:
|
| 4 |
+
- en
|
| 5 |
+
- sv
|
| 6 |
+
metrics:
|
| 7 |
+
- accuracy
|
| 8 |
+
tags:
|
| 9 |
+
- othello
|
| 10 |
+
- reinforcement-learning
|
| 11 |
+
- alphazero
|
| 12 |
+
- edax
|
| 13 |
+
- board-games
|
| 14 |
+
---
|
| 15 |
+
# Dualist Othello AI
|
| 16 |
+
|
| 17 |
+
Dualist is a high-performance Othello (Reversi) AI model trained using a **Deep Residual Neural Network** architecture. It was developed as part of a hybrid learning project where a bitboard-based engine (Edax) acted as the "Grandmaster Teacher" to train the neural network via curriculum learning.
|
| 18 |
+
|
| 19 |
+
## Features
|
| 20 |
+
- **Architecture**: 10 Residual Blocks with 256 channels.
|
| 21 |
+
- **Input**: 3x8x8 planes (Player bits, Opponent bits, Turn/Constant).
|
| 22 |
+
- **Heuristics**: Trained to emulate professional-level Othello gameplay and strategic positioning.
|
| 23 |
+
- **Teacher**: Supervised and Reinforcement Learning against the Edax engine (Depth 1-30).
|
| 24 |
+
|
| 25 |
+
## Model Details
|
| 26 |
+
- **Model File**: `dualist_model.pth`
|
| 27 |
+
- **Total Parameters**: Optimized for balancing speed and strategic depth.
|
| 28 |
+
- **Architecture Class**: `OthelloNet` in `model.py`.
|
| 29 |
+
|
| 30 |
+
## Installation & Usage
|
| 31 |
+
|
| 32 |
+
### Prerequisites
|
| 33 |
+
- Python 3.8+
|
| 34 |
+
- PyTorch
|
| 35 |
+
- NumPy
|
| 36 |
+
|
| 37 |
+
### Quick Start (Inference)
|
| 38 |
+
The model can be loaded and used for move prediction. Make sure `model.py`, `bitboard.py`, and `dualist_model.pth` are in your working directory.
|
| 39 |
+
|
| 40 |
+
```python
|
| 41 |
+
import torch
|
| 42 |
+
from model import OthelloNet
|
| 43 |
+
from bitboard import get_bit, make_input_planes
|
| 44 |
+
|
| 45 |
+
# Load model
|
| 46 |
+
model = OthelloNet(num_res_blocks=10, num_channels=256)
|
| 47 |
+
checkpoint = torch.load("dualist_model.pth", map_location="cpu")
|
| 48 |
+
model.load_state_dict(checkpoint["model_state_dict"])
|
| 49 |
+
model.eval()
|
| 50 |
+
|
| 51 |
+
# Example input (Bitboards)
|
| 52 |
+
black_bb = 0x0000000810000000
|
| 53 |
+
white_bb = 0x0000001008000000
|
| 54 |
+
|
| 55 |
+
# Get prediction
|
| 56 |
+
input_planes = make_input_planes(black_bb, white_bb)
|
| 57 |
+
with torch.no_grad():
|
| 58 |
+
policy, value = model(input_planes)
|
| 59 |
+
|
| 60 |
+
# 'policy' contains move probabilities (log_softmax)
|
| 61 |
+
# 'value' is the predicted game outcome [-1, 1]
|
| 62 |
+
```
|
| 63 |
+
|
| 64 |
+
### Optimal Performance: MCTS Integration
|
| 65 |
+
While the model provides strong "intuitive" moves (Policy Head), it is designed to be used with **Monte Carlo Tree Search (MCTS)** to reach its full potential. By using the Policy to guide the search and the Value head to prune it, the agent can look ahead multiple turns, making it significantly more "sharp" and strategically sound.
|
| 66 |
+
|
| 67 |
+
In the provided `inference.py` and the associated Space, we demonstrate how to use 400-800 simulations per move to achieve Expert/Master level play.
|
| 68 |
+
|
| 69 |
+
### Files Description
|
| 70 |
+
- `dualist_model.pth`: Pre-trained weights for the OthelloNet.
|
| 71 |
+
- `model.py`: Neural Network architecture definition.
|
| 72 |
+
- `game.py`: Core Othello logic and move generation.
|
| 73 |
+
- `bitboard.py`: Bit manipulation and input plane processing.
|
| 74 |
+
- `mcts.py`: Monte Carlo Tree Search implementation (recommended for play).
|
| 75 |
+
- `inference.py`: Example script to run the model on a board state.
|
| 76 |
+
|
| 77 |
+
## Hugging Face Integration
|
| 78 |
+
To push this to your Hugging Face account:
|
| 79 |
+
1. Install `huggingface_hub`: `pip install huggingface_hub`
|
| 80 |
+
2. Login: `huggingface-cli login`
|
| 81 |
+
3. Push files to `brandonlanexyz/dualist`.
|
| 82 |
+
|
| 83 |
+
|
| 84 |
+
https://cdn-uploads.huggingface.co/production/uploads/65fc3d2c2ba04e5ae4f1c1c6/UkwcYLNdpBffFM3JKN1mL.mp4
|
| 85 |
+
|
| 86 |
+
|
| 87 |
+
|
| 88 |
+
|
| 89 |
+
|
| 90 |
+
---
|
| 91 |
+
*Created by Brandon | Part of the AntiGravity AI-LAB Othello Project*
|