LH-Tech-AI commited on
Commit
be26fc5
·
verified ·
1 Parent(s): 95b158c

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +13 -7
README.md CHANGED
@@ -34,7 +34,7 @@ Supra Mini v2 0.1M is a very tiny base model trained on 700 million tokens of Fi
34
  - Weight Decay: 0.01
35
 
36
  ## Final Loss
37
- This model reached a final train loss after 3 epochs of **4.XYZ**.
38
 
39
  ## Benchmarks
40
 
@@ -42,19 +42,25 @@ All benchmarks were executed using `lm-eval`.
42
 
43
  | Task | Value | Random level |
44
  | :------------ | :----------: | -----------: |
45
- | Arc_Easy | 0.XXXX | 0.25 (25%) |
46
- | Wikitext | XX.XXXX | - |
47
- | BLiMP | 0.XXXX | 0.5 (50%) |
48
 
49
  ## Examples
50
  **Prompt:** "Artificial intelligence is "<br>
51
- **Output:**: "XXXXXXXXXXXXXXXXXXXXXXXXXXXXXX"
 
 
52
  <br><br>
53
  **Prompt:** "The main concept of physics is "<br>
54
- **Output:**: "XXXXXXXXXXXXXXXXXXXXXXXXXXXXXX"
 
55
  <br><br>
56
  **Prompt:** "Once upon a time, "<br>
57
- **Output:**: "XXXXXXXXXXXXXXXXXXXXXXXXXXXXXX"
 
 
 
58
 
59
  ## Usage
60
  To use our model, just run this code using HF Transformers to execute the model:
 
34
  - Weight Decay: 0.01
35
 
36
  ## Final Loss
37
+ This model reached a final train loss after 3 epochs of **4.413**.
38
 
39
  ## Benchmarks
40
 
 
42
 
43
  | Task | Value | Random level |
44
  | :------------ | :----------: | -----------: |
45
+ | Arc_Easy | 0.2677 | 0.25 (25%) |
46
+ | Wikitext | 7.7940 | - |
47
+ | BLiMP | 0.5354 | 0.5 (50%) |
48
 
49
  ## Examples
50
  **Prompt:** "Artificial intelligence is "<br>
51
+ **Output:**: *"Artificial intelligence is irreciously, and the diet of a battery.
52
+ These are also known as the following:
53
+ \- Foods, in the most commonly used to be taken by the priority of the South African American Modela, which was nothing for the first time. The federal government has been a wall of the world’s two moisture and the came on the national range of the Great Department of Amazonia, and the Politary Society of the Carli. This is that the Letters were the first third of the Building S"*
54
  <br><br>
55
  **Prompt:** "The main concept of physics is "<br>
56
+ **Output:**: *"The main concept of physics is utilized in the most commonly used to be achieved.
57
+ Chotos, an efficient for a dietary pathogene, and that are also known as a source of the molecularly. The failure wastered in the national categories of the California, and the Modela’s brought by the Florida. In the world's this time, it is not only on the sense of the first-metrial gardens, but they can be living in the task of the Political School of History (professed"*
58
  <br><br>
59
  **Prompt:** "Once upon a time, "<br>
60
+ **Output:**: *"Once upon a time, utilizing the fire.
61
+ The Samboard is that the lot of the bill.
62
+ After the day to be a widely money and in the world’s a harmful force.
63
+ Despite the size of the Bradese, and his owner, and he was noted by the Department of Management, and the Lord of Petersonia and the Council, which had been a destroyed on the tree, but the giving a came from the Hiska. The Great Marius and Jewish Amazon's Rich"*
64
 
65
  ## Usage
66
  To use our model, just run this code using HF Transformers to execute the model: