Update README.md
Browse files
README.md
CHANGED
|
@@ -13,7 +13,7 @@ pipeline_tag: question-answering
|
|
| 13 |
|
| 14 |
# PurelyUnfunctionalAI/GibberishGPT
|
| 15 |
|
| 16 |
-
A lightweight decoder-only transformer language model trained with Flash Attention on the WikiText dataset. This is a version used for learning about training LLMs and ML pipelines.
|
| 17 |
<a href="https://github.com/PUFAI/GibberishGPT"> <img alt="GitHub" src="https://img.shields.io/badge/GitHub-Repo-blue?logo=github&style=flat-square"> </a>
|
| 18 |
|
| 19 |
## Model Details
|
|
|
|
| 13 |
|
| 14 |
# PurelyUnfunctionalAI/GibberishGPT
|
| 15 |
|
| 16 |
+
A lightweight decoder-only transformer language model trained with Flash Attention on the WikiText dataset. This is a version used for learning about training LLMs and ML pipelines. The model does not actually output coherent text, although serves as a good starting point for learning more about LLMs
|
| 17 |
<a href="https://github.com/PUFAI/GibberishGPT"> <img alt="GitHub" src="https://img.shields.io/badge/GitHub-Repo-blue?logo=github&style=flat-square"> </a>
|
| 18 |
|
| 19 |
## Model Details
|