Hugging Face's logo

MihaiPopa-1
/
CinnabarLM-4M-Base

Text Generation
Safetensors
English
llama
tiny-model
cinnabarlm
tiny-llm
tiny-lm
tinylm
tinyllm
Model card Files
xet
 Community
MihaiPopa-1 commited on
Commit
85c4d58
·
verified ·
1 Parent(s): c1b0281

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -29,7 +29,7 @@ Because it's a good idea to make tiny LLMs. Some people already did with [MicroL
29
  |---|---|
30
  | Tokenizer | Llama 3's tokenizer (Tiktoken / BPE) |
31
  | Vocabulary Size | 4096 tokens |
32
- | Batch Size | 4 x 8= 32 |
33
  | Context Window | Maybe 2048 tokens |
34
  | `hidden_size` | 192 |
35
  | `intermediate_size` | 192 |
 
29
  |---|---|
30
  | Tokenizer | Llama 3's tokenizer (Tiktoken / BPE) |
31
  | Vocabulary Size | 4096 tokens |
32
+ | Batch Size | 4 x 8 = 32 |
33
  | Context Window | Maybe 2048 tokens |
34
  | `hidden_size` | 192 |
35
  | `intermediate_size` | 192 |