Hugging Face's logo

jjee2
/
lora_recycle

TensorBoard
Safetensors
GGUF
conversational
Model card Files
xet
 Metrics Community
jjee2 commited on
Commit
aa01f4a
·
verified ·
1 Parent(s): 934248f

Add jonathand94__llama-sentiment-classifier-classic-fine-tuning

Browse files
Files changed (18) hide show
  1. jonathand94__llama-sentiment-classifier-classic-fine-tuning/.gitattributes +35 -0
  2. jonathand94__llama-sentiment-classifier-classic-fine-tuning/README.md +70 -0
  3. jonathand94__llama-sentiment-classifier-classic-fine-tuning/adapter_config.json +31 -0
  4. jonathand94__llama-sentiment-classifier-classic-fine-tuning/adapter_model.safetensors +3 -0
  5. jonathand94__llama-sentiment-classifier-classic-fine-tuning/runs/Nov03_07-41-45_9310b85e087c/events.out.tfevents.1730619715.9310b85e087c.192280.0 +3 -0
  6. jonathand94__llama-sentiment-classifier-classic-fine-tuning/runs/Nov03_07-50-39_9310b85e087c/events.out.tfevents.1730620249.9310b85e087c.194976.0 +3 -0
  7. jonathand94__llama-sentiment-classifier-classic-fine-tuning/runs/Nov03_07-50-39_9310b85e087c/events.out.tfevents.1730620569.9310b85e087c.194976.1 +3 -0
  8. jonathand94__llama-sentiment-classifier-classic-fine-tuning/runs/Nov03_08-03-57_9310b85e087c/events.out.tfevents.1730621049.9310b85e087c.198657.0 +3 -0
  9. jonathand94__llama-sentiment-classifier-classic-fine-tuning/runs/Nov03_08-28-37_9310b85e087c/events.out.tfevents.1730622529.9310b85e087c.205328.0 +3 -0
  10. jonathand94__llama-sentiment-classifier-classic-fine-tuning/runs/Nov03_08-34-32_9310b85e087c/events.out.tfevents.1730622906.9310b85e087c.206687.0 +3 -0
  11. jonathand94__llama-sentiment-classifier-classic-fine-tuning/runs/Nov03_08-38-44_9310b85e087c/events.out.tfevents.1730623134.9310b85e087c.208402.0 +3 -0
  12. jonathand94__llama-sentiment-classifier-classic-fine-tuning/runs/Nov03_08-51-05_9310b85e087c/events.out.tfevents.1730623876.9310b85e087c.211778.0 +3 -0
  13. jonathand94__llama-sentiment-classifier-classic-fine-tuning/runs/Nov03_18-43-30_99e417a62aa2/events.out.tfevents.1730659810.99e417a62aa2.3195.0 +3 -0
  14. jonathand94__llama-sentiment-classifier-classic-fine-tuning/runs/Nov03_18-56-46_99e417a62aa2/events.out.tfevents.1730660219.99e417a62aa2.7167.0 +3 -0
  15. jonathand94__llama-sentiment-classifier-classic-fine-tuning/runs/Nov03_19-13-05_99e417a62aa2/events.out.tfevents.1730661194.99e417a62aa2.7167.1 +3 -0
  16. jonathand94__llama-sentiment-classifier-classic-fine-tuning/runs/Nov03_19-27-01_99e417a62aa2/events.out.tfevents.1730662032.99e417a62aa2.14986.0 +3 -0
  17. jonathand94__llama-sentiment-classifier-classic-fine-tuning/runs/Nov03_19-41-52_99e417a62aa2/events.out.tfevents.1730662927.99e417a62aa2.18786.0 +3 -0
  18. jonathand94__llama-sentiment-classifier-classic-fine-tuning/training_args.bin +3 -0
jonathand94__llama-sentiment-classifier-classic-fine-tuning/.gitattributes ADDED
@@ -0,0 +1,35 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ *.7z filter=lfs diff=lfs merge=lfs -text
2
+ *.arrow filter=lfs diff=lfs merge=lfs -text
3
+ *.bin filter=lfs diff=lfs merge=lfs -text
4
+ *.bz2 filter=lfs diff=lfs merge=lfs -text
5
+ *.ckpt filter=lfs diff=lfs merge=lfs -text
6
+ *.ftz filter=lfs diff=lfs merge=lfs -text
7
+ *.gz filter=lfs diff=lfs merge=lfs -text
8
+ *.h5 filter=lfs diff=lfs merge=lfs -text
9
+ *.joblib filter=lfs diff=lfs merge=lfs -text
10
+ *.lfs.* filter=lfs diff=lfs merge=lfs -text
11
+ *.mlmodel filter=lfs diff=lfs merge=lfs -text
12
+ *.model filter=lfs diff=lfs merge=lfs -text
13
+ *.msgpack filter=lfs diff=lfs merge=lfs -text
14
+ *.npy filter=lfs diff=lfs merge=lfs -text
15
+ *.npz filter=lfs diff=lfs merge=lfs -text
16
+ *.onnx filter=lfs diff=lfs merge=lfs -text
17
+ *.ot filter=lfs diff=lfs merge=lfs -text
18
+ *.parquet filter=lfs diff=lfs merge=lfs -text
19
+ *.pb filter=lfs diff=lfs merge=lfs -text
20
+ *.pickle filter=lfs diff=lfs merge=lfs -text
21
+ *.pkl filter=lfs diff=lfs merge=lfs -text
22
+ *.pt filter=lfs diff=lfs merge=lfs -text
23
+ *.pth filter=lfs diff=lfs merge=lfs -text
24
+ *.rar filter=lfs diff=lfs merge=lfs -text
25
+ *.safetensors filter=lfs diff=lfs merge=lfs -text
26
+ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
27
+ *.tar.* filter=lfs diff=lfs merge=lfs -text
28
+ *.tar filter=lfs diff=lfs merge=lfs -text
29
+ *.tflite filter=lfs diff=lfs merge=lfs -text
30
+ *.tgz filter=lfs diff=lfs merge=lfs -text
31
+ *.wasm filter=lfs diff=lfs merge=lfs -text
32
+ *.xz filter=lfs diff=lfs merge=lfs -text
33
+ *.zip filter=lfs diff=lfs merge=lfs -text
34
+ *.zst filter=lfs diff=lfs merge=lfs -text
35
+ *tfevents* filter=lfs diff=lfs merge=lfs -text
jonathand94__llama-sentiment-classifier-classic-fine-tuning/README.md ADDED
@@ -0,0 +1,70 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ base_model: meta-llama/Llama-3.1-8B-Instruct
3
+ library_name: peft
4
+ license: llama3.1
5
+ tags:
6
+ - generated_from_trainer
7
+ model-index:
8
+ - name: llama-sentiment-classifier-classic-fine-tuning
9
+ results: []
10
+ ---
11
+
12
+ <!-- This model card has been generated automatically according to the information the Trainer had access to. You
13
+ should probably proofread and complete it, then remove this comment. -->
14
+
15
+ # llama-sentiment-classifier-classic-fine-tuning
16
+
17
+ This model is a fine-tuned version of [meta-llama/Llama-3.1-8B-Instruct](https://huggingface.co/meta-llama/Llama-3.1-8B-Instruct) on the None dataset.
18
+ It achieves the following results on the evaluation set:
19
+ - Loss: 1.4995
20
+
21
+ ## Model description
22
+
23
+ More information needed
24
+
25
+ ## Intended uses & limitations
26
+
27
+ More information needed
28
+
29
+ ## Training and evaluation data
30
+
31
+ More information needed
32
+
33
+ ## Training procedure
34
+
35
+ ### Training hyperparameters
36
+
37
+ The following hyperparameters were used during training:
38
+ - learning_rate: 2e-05
39
+ - train_batch_size: 4
40
+ - eval_batch_size: 4
41
+ - seed: 42
42
+ - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
43
+ - lr_scheduler_type: linear
44
+ - num_epochs: 5
45
+
46
+ ### Training results
47
+
48
+ | Training Loss | Epoch | Step | Validation Loss |
49
+ |:-------------:|:------:|:----:|:---------------:|
50
+ | 1.551 | 0.3915 | 500 | 1.6018 |
51
+ | 1.6264 | 0.7831 | 1000 | 1.5546 |
52
+ | 1.5287 | 1.1746 | 1500 | 1.5336 |
53
+ | 1.4458 | 1.5662 | 2000 | 1.5179 |
54
+ | 1.4449 | 1.9577 | 2500 | 1.5072 |
55
+ | 1.4057 | 2.3493 | 3000 | 1.5033 |
56
+ | 1.5532 | 2.7408 | 3500 | 1.4967 |
57
+ | 1.474 | 3.1323 | 4000 | 1.4997 |
58
+ | 1.3809 | 3.5239 | 4500 | 1.4990 |
59
+ | 1.3981 | 3.9154 | 5000 | 1.4937 |
60
+ | 1.311 | 4.3070 | 5500 | 1.4971 |
61
+ | 1.2245 | 4.6985 | 6000 | 1.4995 |
62
+
63
+
64
+ ### Framework versions
65
+
66
+ - PEFT 0.13.2
67
+ - Transformers 4.44.2
68
+ - Pytorch 2.5.0+cu121
69
+ - Datasets 3.1.0
70
+ - Tokenizers 0.19.1
jonathand94__llama-sentiment-classifier-classic-fine-tuning/adapter_config.json ADDED
@@ -0,0 +1,31 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "alpha_pattern": {},
3
+ "auto_mapping": null,
4
+ "base_model_name_or_path": "meta-llama/Llama-3.1-8B-Instruct",
5
+ "bias": "none",
6
+ "fan_in_fan_out": false,
7
+ "inference_mode": true,
8
+ "init_lora_weights": true,
9
+ "layer_replication": null,
10
+ "layers_pattern": null,
11
+ "layers_to_transform": null,
12
+ "loftq_config": {},
13
+ "lora_alpha": 32,
14
+ "lora_dropout": 0.1,
15
+ "megatron_config": null,
16
+ "megatron_core": "megatron.core",
17
+ "modules_to_save": null,
18
+ "peft_type": "LORA",
19
+ "r": 16,
20
+ "rank_pattern": {},
21
+ "revision": null,
22
+ "target_modules": [
23
+ "q_proj",
24
+ "o_proj",
25
+ "k_proj",
26
+ "v_proj"
27
+ ],
28
+ "task_type": "CAUSAL_LM",
29
+ "use_dora": false,
30
+ "use_rslora": false
31
+ }
jonathand94__llama-sentiment-classifier-classic-fine-tuning/adapter_model.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:99c9095bb7af4744e1ddc5911d22c0834535e422f271f92da8bdb20259d6e892
3
+ size 54560368
jonathand94__llama-sentiment-classifier-classic-fine-tuning/runs/Nov03_07-41-45_9310b85e087c/events.out.tfevents.1730619715.9310b85e087c.192280.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1f3f41776a6803cae579817a470c0b316039af38565dd0f1fd91add1bf96ba7c
3
+ size 5275
jonathand94__llama-sentiment-classifier-classic-fine-tuning/runs/Nov03_07-50-39_9310b85e087c/events.out.tfevents.1730620249.9310b85e087c.194976.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:799539aa3b20cc841ad7b017542a74eb4c59f606297289d4cad9fc87f21691cf
3
+ size 5275
jonathand94__llama-sentiment-classifier-classic-fine-tuning/runs/Nov03_07-50-39_9310b85e087c/events.out.tfevents.1730620569.9310b85e087c.194976.1 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:267a8272c25fce7ba32ecb70c3bd5329d877d0a492348ca534e09c988d34cc3a
3
+ size 5275
jonathand94__llama-sentiment-classifier-classic-fine-tuning/runs/Nov03_08-03-57_9310b85e087c/events.out.tfevents.1730621049.9310b85e087c.198657.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9a1c1aa499dab24ca12b0254d8ea9479857db8fdb30d2822191728b77929cc2a
3
+ size 5275
jonathand94__llama-sentiment-classifier-classic-fine-tuning/runs/Nov03_08-28-37_9310b85e087c/events.out.tfevents.1730622529.9310b85e087c.205328.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4c4c2db03195d3a7d5d44c14f2173a73fc29475ade910db635ba3953cd16762a
3
+ size 5275
jonathand94__llama-sentiment-classifier-classic-fine-tuning/runs/Nov03_08-34-32_9310b85e087c/events.out.tfevents.1730622906.9310b85e087c.206687.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:985b4c7d6a04d366b8eae135d6eb0724a3ca4bd6be5bf607656d127229b0d24e
3
+ size 5275
jonathand94__llama-sentiment-classifier-classic-fine-tuning/runs/Nov03_08-38-44_9310b85e087c/events.out.tfevents.1730623134.9310b85e087c.208402.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2efcdd1ade80450704dad9ab3d2479eafb032ca5ed8e8993aff7eacdf1041b5a
3
+ size 5275
jonathand94__llama-sentiment-classifier-classic-fine-tuning/runs/Nov03_08-51-05_9310b85e087c/events.out.tfevents.1730623876.9310b85e087c.211778.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a21a51bdaa85467efbb3464601e448a6f286e9c2046a9b3777f9edaaf439111a
3
+ size 10856
jonathand94__llama-sentiment-classifier-classic-fine-tuning/runs/Nov03_18-43-30_99e417a62aa2/events.out.tfevents.1730659810.99e417a62aa2.3195.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d34a13cb84d4616166b43a98c7f615f6d2f8c6f5c89fc057cca0731d778ea791
3
+ size 6931
jonathand94__llama-sentiment-classifier-classic-fine-tuning/runs/Nov03_18-56-46_99e417a62aa2/events.out.tfevents.1730660219.99e417a62aa2.7167.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c8ebcbe2375f0d5d876768a3e44ec50d72cb3f48e35ece028710c591dbe282b0
3
+ size 16045
jonathand94__llama-sentiment-classifier-classic-fine-tuning/runs/Nov03_19-13-05_99e417a62aa2/events.out.tfevents.1730661194.99e417a62aa2.7167.1 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:bd26c5ead413577f7ef0da7bb8f892b0601a3a865637a2e7ab50a3cbec447635
3
+ size 15771
jonathand94__llama-sentiment-classifier-classic-fine-tuning/runs/Nov03_19-27-01_99e417a62aa2/events.out.tfevents.1730662032.99e417a62aa2.14986.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b17583918760a150b2ad58c65fcc42d0475f696859436191c74e03cfe448460d
3
+ size 15771
jonathand94__llama-sentiment-classifier-classic-fine-tuning/runs/Nov03_19-41-52_99e417a62aa2/events.out.tfevents.1730662927.99e417a62aa2.18786.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d5a41bdbb2816ffe87cc73a7a3f8eaa01bb31f95581f128521fec5d6b9454dd2
3
+ size 143448
jonathand94__llama-sentiment-classifier-classic-fine-tuning/training_args.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b0392630a0941093a3fbc5a79b8ee8ad17754f8dc4041879a7d0b3ad6165c126
3
+ size 5240