Update README.md
Browse files
README.md
CHANGED
|
@@ -17,7 +17,7 @@ tags:
|
|
| 17 |
</p>
|
| 18 |
|
| 19 |
|
| 20 |
-
Official pretrained weights for
|
| 21 |
|
| 22 |
|
| 23 |
## Quickstart
|
|
|
|
| 17 |
</p>
|
| 18 |
|
| 19 |
|
| 20 |
+
Official pretrained weights for **Celo2-base** learned update rule: This variant uses the learned update rule for all parameters without any optimization harness. For better performance, see [celo2](https://huggingface.co/amoudgl/celo2) that uses Newton-Schulz orthogonalization and AdamW for biases/embeddings.
|
| 21 |
|
| 22 |
|
| 23 |
## Quickstart
|