Harley-ml commited on
Commit
ee8e0fa
·
verified ·
1 Parent(s): 5a43b2d

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -551,7 +551,7 @@ We decided to evaluate the model on each source to see the difference in perplex
551
  | Books | 3.73 | 41.88 |
552
  | Medium articles | 3.79 | 44.40 |
553
 
554
- The textbooks' perplexity is six times lower than that of the Medium articles. This is expected: Tiny-Textbooks uses a templated structure (e.g., Section 1, conclusion, etc.) and an LLM generates the rest. resulting in a lower entropy than standard English. Medium articles are structurally, tonally, and stylistically more diverse and unpredictable. The same could be said for the books.
555
  ---
556
 
557
  ## Benchmarks
 
551
  | Books | 3.73 | 41.88 |
552
  | Medium articles | 3.79 | 44.40 |
553
 
554
+ The textbooks' perplexity is six times lower than that of the Medium articles. This is expected. Tiny-Textbooks uses a templated structure (e.g., Section 1, conclusion, etc.) and an LLM generates the rest, resulting in a lower entropy than standard English. Medium articles are structurally, tonally, and stylistically more diverse and unpredictable. The same could be said for the books.
555
  ---
556
 
557
  ## Benchmarks