Update README.md
Browse files
README.md
CHANGED
|
@@ -554,6 +554,7 @@ We decided to evaluate the model on each source to see the difference in perplex
|
|
| 554 |
| Medium articles | 3.79 | 44.40 |
|
| 555 |
|
| 556 |
The textbooks' perplexity is six times lower than that of the Medium articles. This is expected. Tiny-Textbooks uses a templated structure (e.g., Section 1, conclusion, etc.) and an LLM generates the rest, resulting in a lower entropy than standard English. Medium articles are structurally, tonally, and stylistically more diverse and unpredictable. The same could be said for the books.
|
|
|
|
| 557 |
---
|
| 558 |
|
| 559 |
## Benchmarks
|
|
|
|
| 554 |
| Medium articles | 3.79 | 44.40 |
|
| 555 |
|
| 556 |
The textbooks' perplexity is six times lower than that of the Medium articles. This is expected. Tiny-Textbooks uses a templated structure (e.g., Section 1, conclusion, etc.) and an LLM generates the rest, resulting in a lower entropy than standard English. Medium articles are structurally, tonally, and stylistically more diverse and unpredictable. The same could be said for the books.
|
| 557 |
+
|
| 558 |
---
|
| 559 |
|
| 560 |
## Benchmarks
|