Update README.md
Browse files
README.md
CHANGED
|
@@ -551,7 +551,7 @@ We decided to evaluate the model on each source to see the difference in perplex
|
|
| 551 |
| Books | 3.73 | 41.88 |
|
| 552 |
| Medium articles | 3.79 | 44.40 |
|
| 553 |
|
| 554 |
-
The textbooks' perplexity is six times lower than that of the Medium articles. This is expected
|
| 555 |
---
|
| 556 |
|
| 557 |
## Benchmarks
|
|
|
|
| 551 |
| Books | 3.73 | 41.88 |
|
| 552 |
| Medium articles | 3.79 | 44.40 |
|
| 553 |
|
| 554 |
+
The textbooks' perplexity is six times lower than that of the Medium articles. This is expected. Tiny-Textbooks uses a templated structure (e.g., Section 1, conclusion, etc.) and an LLM generates the rest, resulting in a lower entropy than standard English. Medium articles are structurally, tonally, and stylistically more diverse and unpredictable. The same could be said for the books.
|
| 555 |
---
|
| 556 |
|
| 557 |
## Benchmarks
|