Update README.md
Browse files
README.md
CHANGED
|
@@ -460,7 +460,9 @@ datasets:
|
|
| 460 |
- fabiochiu/medium-articles
|
| 461 |
---
|
| 462 |
|
| 463 |
-
|
|
|
|
|
|
|
| 464 |
|
| 465 |
**Tenete-8M** is an **eight-million parameter model** trained on **five hundred and seventy-seven million tokens**.
|
| 466 |
While it can't answer "2 + 2" or write a coherent, logically sound essay, it will *surprise* you, and the credit goes to nampdnai's [**tiny-textbooks**](https://huggingface.co/datasets/nampdn-ai/tiny-textbooks).
|
|
|
|
| 460 |
- fabiochiu/medium-articles
|
| 461 |
---
|
| 462 |
|
| 463 |
+
**Note**: This was mostly a proof-of-concept. A new, improved second version will be coming out soon with a much larger training budget and better architectural decisions. Stay tuned! :)
|
| 464 |
+
|
| 465 |
+
#Tenete-8M
|
| 466 |
|
| 467 |
**Tenete-8M** is an **eight-million parameter model** trained on **five hundred and seventy-seven million tokens**.
|
| 468 |
While it can't answer "2 + 2" or write a coherent, logically sound essay, it will *surprise* you, and the credit goes to nampdnai's [**tiny-textbooks**](https://huggingface.co/datasets/nampdn-ai/tiny-textbooks).
|