Upload folder using huggingface_hub
Browse files- .ipynb_checkpoints/README-checkpoint.md +1 -0
- README.md +1 -0
.ipynb_checkpoints/README-checkpoint.md
CHANGED
|
@@ -35,6 +35,7 @@ More information needed
|
|
| 35 |
### Training hyperparameters
|
| 36 |
|
| 37 |
The following hyperparameters were used during training:
|
|
|
|
| 38 |
- language_lr = 5e-6
|
| 39 |
vision_lr = 5e-7
|
| 40 |
merger_lr = 1e-5
|
|
|
|
| 35 |
### Training hyperparameters
|
| 36 |
|
| 37 |
The following hyperparameters were used during training:
|
| 38 |
+
- last 14 language blocks
|
| 39 |
- language_lr = 5e-6
|
| 40 |
vision_lr = 5e-7
|
| 41 |
merger_lr = 1e-5
|
README.md
CHANGED
|
@@ -35,6 +35,7 @@ More information needed
|
|
| 35 |
### Training hyperparameters
|
| 36 |
|
| 37 |
The following hyperparameters were used during training:
|
|
|
|
| 38 |
- language_lr = 5e-6
|
| 39 |
vision_lr = 5e-7
|
| 40 |
merger_lr = 1e-5
|
|
|
|
| 35 |
### Training hyperparameters
|
| 36 |
|
| 37 |
The following hyperparameters were used during training:
|
| 38 |
+
- last 14 language blocks
|
| 39 |
- language_lr = 5e-6
|
| 40 |
vision_lr = 5e-7
|
| 41 |
merger_lr = 1e-5
|