ARC-Challenge_Llama-3.2-1B-lrye0hm9

This model is a fine-tuned version of meta-llama/Llama-3.2-1B on an unknown dataset. It achieves the following results on the evaluation set:

• Loss: 7.8894
• Model Preparation Time: 0.0059
• Mdl: 3403.2139
• Accumulated Loss: 2358.9281
• Correct Preds: 128.0
• Total Preds: 299.0
• Accuracy: 0.4281
• Correct Gen Preds: 124.0
• Gen Accuracy: 0.4147
• Correct Gen Preds 32: 10.0
• Correct Preds 32: 12.0
• Total Labels 32: 64.0
• Accuracy 32: 0.1875
• Gen Accuracy 32: 0.1562
• Correct Gen Preds 33: 26.0
• Correct Preds 33: 26.0
• Total Labels 33: 73.0
• Accuracy 33: 0.3562
• Gen Accuracy 33: 0.3562
• Correct Gen Preds 34: 41.0
• Correct Preds 34: 43.0
• Total Labels 34: 78.0
• Accuracy 34: 0.5513
• Gen Accuracy 34: 0.5256
• Correct Gen Preds 35: 46.0
• Correct Preds 35: 46.0
• Total Labels 35: 83.0
• Accuracy 35: 0.5542
• Gen Accuracy 35: 0.5542
• Correct Gen Preds 36: 1.0
• Correct Preds 36: 1.0
• Total Labels 36: 1.0
• Accuracy 36: 1.0
• Gen Accuracy 36: 1.0

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 64
• eval_batch_size: 112
• seed: 42
• optimizer: Use OptimizerNames.ADAMW_TORCH with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
• lr_scheduler_type: cosine
• lr_scheduler_warmup_ratio: 0.01
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Model Preparation Time	Mdl	Accumulated Loss	Correct Preds	Total Preds	Accuracy	Correct Gen Preds	Gen Accuracy	Correct Gen Preds 32	Correct Preds 32	Total Labels 32	Accuracy 32	Gen Accuracy 32	Correct Gen Preds 33	Correct Preds 33	Total Labels 33	Accuracy 33	Gen Accuracy 33	Correct Gen Preds 34	Correct Preds 34	Total Labels 34	Accuracy 34	Gen Accuracy 34	Correct Gen Preds 35	Correct Preds 35	Total Labels 35	Accuracy 35	Gen Accuracy 35	Correct Gen Preds 36	Correct Preds 36	Total Labels 36	Accuracy 36	Gen Accuracy 36
No log	0	0	1.6389	0.0059	706.9523	490.0220	66.0	299.0	0.2207	66.0	0.2207	62.0	62.0	64.0	0.9688	0.9688	0.0	0.0	73.0	0.0	0.0	4.0	4.0	78.0	0.0513	0.0513	0.0	0.0	83.0	0.0	0.0	0.0	0.0	1.0	0.0	0.0
1.7113	1.0	1	1.6389	0.0059	706.9523	490.0220	66.0	299.0	0.2207	66.0	0.2207	62.0	62.0	64.0	0.9688	0.9688	0.0	0.0	73.0	0.0	0.0	4.0	4.0	78.0	0.0513	0.0513	0.0	0.0	83.0	0.0	0.0	0.0	0.0	1.0	0.0	0.0
1.7113	2.0	2	2.1440	0.0059	924.8453	641.0539	75.0	299.0	0.2508	75.0	0.2508	0.0	0.0	64.0	0.0	0.0	71.0	71.0	73.0	0.9726	0.9726	4.0	4.0	78.0	0.0513	0.0513	0.0	0.0	83.0	0.0	0.0	0.0	0.0	1.0	0.0	0.0
1.7428	3.0	3	1.4025	0.0059	604.9963	419.3515	79.0	299.0	0.2642	79.0	0.2642	0.0	0.0	64.0	0.0	0.0	71.0	71.0	73.0	0.9726	0.9726	5.0	5.0	78.0	0.0641	0.0641	3.0	3.0	83.0	0.0361	0.0361	0.0	0.0	1.0	0.0	0.0
1.1982	4.0	4	1.7444	0.0059	752.4550	521.5620	73.0	299.0	0.2441	73.0	0.2441	1.0	1.0	64.0	0.0156	0.0156	72.0	72.0	73.0	0.9863	0.9863	0.0	0.0	78.0	0.0	0.0	0.0	0.0	83.0	0.0	0.0	0.0	0.0	1.0	0.0	0.0
0.7838	5.0	5	1.8842	0.0059	812.7778	563.3746	87.0	299.0	0.2910	85.0	0.2843	10.0	12.0	64.0	0.1875	0.1562	51.0	51.0	73.0	0.6986	0.6986	18.0	18.0	78.0	0.2308	0.2308	6.0	6.0	83.0	0.0723	0.0723	0.0	0.0	1.0	0.0	0.0
0.2602	6.0	6	2.4606	0.0059	1061.4055	735.7102	95.0	299.0	0.3177	68.0	0.2274	10.0	24.0	64.0	0.375	0.1562	23.0	32.0	73.0	0.4384	0.3151	14.0	16.0	78.0	0.2051	0.1795	21.0	23.0	83.0	0.2771	0.2530	0.0	0.0	1.0	0.0	0.0
0.0285	7.0	7	3.1420	0.0059	1355.3679	939.4695	107.0	299.0	0.3579	83.0	0.2776	4.0	9.0	64.0	0.1406	0.0625	34.0	46.0	73.0	0.6301	0.4658	17.0	22.0	78.0	0.2821	0.2179	28.0	30.0	83.0	0.3614	0.3373	0.0	0.0	1.0	0.0	0.0
0.0009	8.0	8	4.1453	0.0059	1788.1271	1239.4352	115.0	299.0	0.3846	101.0	0.3378	8.0	12.0	64.0	0.1875	0.125	40.0	45.0	73.0	0.6164	0.5479	24.0	27.0	78.0	0.3462	0.3077	29.0	31.0	83.0	0.3735	0.3494	0.0	0.0	1.0	0.0	0.0
0.0	9.0	9	5.0133	0.0059	2162.5674	1498.9775	116.0	299.0	0.3880	102.0	0.3411	8.0	12.0	64.0	0.1875	0.125	35.0	40.0	73.0	0.5479	0.4795	30.0	33.0	78.0	0.4231	0.3846	29.0	31.0	83.0	0.3735	0.3494	0.0	0.0	1.0	0.0	0.0
0.0	10.0	10	5.6515	0.0059	2437.8701	1689.8028	118.0	299.0	0.3946	110.0	0.3679	10.0	13.0	64.0	0.2031	0.1562	32.0	35.0	73.0	0.4795	0.4384	31.0	32.0	78.0	0.4103	0.3974	37.0	38.0	83.0	0.4578	0.4458	0.0	0.0	1.0	0.0	0.0
0.0	11.0	11	6.1781	0.0059	2665.0396	1847.2647	118.0	299.0	0.3946	113.0	0.3779	9.0	10.0	64.0	0.1562	0.1406	30.0	32.0	73.0	0.4384	0.4110	34.0	34.0	78.0	0.4359	0.4359	39.0	41.0	83.0	0.4940	0.4699	1.0	1.0	1.0	1.0	1.0
0.0	12.0	12	6.6123	0.0059	2852.3371	1977.0894	122.0	299.0	0.4080	116.0	0.3880	9.0	10.0	64.0	0.1562	0.1406	28.0	30.0	73.0	0.4110	0.3836	35.0	37.0	78.0	0.4744	0.4487	43.0	44.0	83.0	0.5301	0.5181	1.0	1.0	1.0	1.0	1.0
0.0	13.0	13	6.9018	0.0059	2977.1837	2063.6265	121.0	299.0	0.4047	116.0	0.3880	9.0	10.0	64.0	0.1562	0.1406	27.0	28.0	73.0	0.3836	0.3699	37.0	39.0	78.0	0.5	0.4744	42.0	43.0	83.0	0.5181	0.5060	1.0	1.0	1.0	1.0	1.0
0.0	14.0	14	7.1079	0.0059	3066.1175	2125.2707	125.0	299.0	0.4181	121.0	0.4047	9.0	10.0	64.0	0.1562	0.1406	28.0	28.0	73.0	0.3836	0.3836	41.0	43.0	78.0	0.5513	0.5256	42.0	43.0	83.0	0.5181	0.5060	1.0	1.0	1.0	1.0	1.0
0.0	15.0	15	7.2904	0.0059	3144.8470	2179.8418	125.0	299.0	0.4181	120.0	0.4013	9.0	10.0	64.0	0.1562	0.1406	26.0	27.0	73.0	0.3699	0.3562	41.0	43.0	78.0	0.5513	0.5256	43.0	44.0	83.0	0.5301	0.5181	1.0	1.0	1.0	1.0	1.0
0.0	16.0	16	7.4569	0.0059	3216.6729	2229.6277	125.0	299.0	0.4181	121.0	0.4047	10.0	11.0	64.0	0.1719	0.1562	27.0	27.0	73.0	0.3699	0.3699	40.0	42.0	78.0	0.5385	0.5128	43.0	44.0	83.0	0.5301	0.5181	1.0	1.0	1.0	1.0	1.0
0.0	17.0	17	7.4957	0.0059	3233.3900	2241.2151	125.0	299.0	0.4181	120.0	0.4013	9.0	11.0	64.0	0.1719	0.1406	27.0	27.0	73.0	0.3699	0.3699	40.0	42.0	78.0	0.5385	0.5128	43.0	44.0	83.0	0.5301	0.5181	1.0	1.0	1.0	1.0	1.0
0.0	18.0	18	7.6444	0.0059	3297.5506	2285.6879	125.0	299.0	0.4181	119.0	0.3980	9.0	11.0	64.0	0.1719	0.1406	26.0	27.0	73.0	0.3699	0.3562	40.0	42.0	78.0	0.5385	0.5128	43.0	44.0	83.0	0.5301	0.5181	1.0	1.0	1.0	1.0	1.0
0.0	19.0	19	7.6703	0.0059	3308.6862	2293.4065	127.0	299.0	0.4247	124.0	0.4147	10.0	12.0	64.0	0.1875	0.1562	27.0	27.0	73.0	0.3699	0.3699	41.0	42.0	78.0	0.5385	0.5256	45.0	45.0	83.0	0.5422	0.5422	1.0	1.0	1.0	1.0	1.0
0.0	20.0	20	7.8179	0.0059	3372.3838	2337.5583	126.0	299.0	0.4214	122.0	0.4080	9.0	11.0	64.0	0.1719	0.1406	26.0	26.0	73.0	0.3562	0.3562	41.0	42.0	78.0	0.5385	0.5256	45.0	46.0	83.0	0.5542	0.5422	1.0	1.0	1.0	1.0	1.0
0.0	21.0	21	7.7771	0.0059	3354.7715	2325.3504	124.0	299.0	0.4147	119.0	0.3980	10.0	12.0	64.0	0.1875	0.1562	26.0	26.0	73.0	0.3562	0.3562	40.0	42.0	78.0	0.5385	0.5128	42.0	43.0	83.0	0.5181	0.5060	1.0	1.0	1.0	1.0	1.0
0.0	22.0	22	7.8631	0.0059	3391.8845	2351.0752	125.0	299.0	0.4181	122.0	0.4080	10.0	12.0	64.0	0.1875	0.1562	25.0	25.0	73.0	0.3425	0.3425	41.0	42.0	78.0	0.5385	0.5256	45.0	45.0	83.0	0.5422	0.5422	1.0	1.0	1.0	1.0	1.0
0.0	23.0	23	7.9227	0.0059	3417.5955	2368.8967	126.0	299.0	0.4214	123.0	0.4114	10.0	12.0	64.0	0.1875	0.1562	26.0	26.0	73.0	0.3562	0.3562	40.0	41.0	78.0	0.5256	0.5128	46.0	46.0	83.0	0.5542	0.5542	1.0	1.0	1.0	1.0	1.0
0.0	24.0	24	7.8625	0.0059	3391.5975	2350.8762	124.0	299.0	0.4147	119.0	0.3980	9.0	11.0	64.0	0.1719	0.1406	26.0	26.0	73.0	0.3562	0.3562	39.0	41.0	78.0	0.5256	0.5	44.0	45.0	83.0	0.5422	0.5301	1.0	1.0	1.0	1.0	1.0
0.0	25.0	25	7.8978	0.0059	3406.8346	2361.4378	124.0	299.0	0.4147	119.0	0.3980	10.0	12.0	64.0	0.1875	0.1562	25.0	25.0	73.0	0.3425	0.3425	40.0	42.0	78.0	0.5385	0.5128	43.0	44.0	83.0	0.5301	0.5181	1.0	1.0	1.0	1.0	1.0
0.0	26.0	26	7.9594	0.0059	3433.3955	2379.8484	123.0	299.0	0.4114	120.0	0.4013	10.0	12.0	64.0	0.1875	0.1562	25.0	25.0	73.0	0.3425	0.3425	39.0	40.0	78.0	0.5128	0.5	45.0	45.0	83.0	0.5422	0.5422	1.0	1.0	1.0	1.0	1.0
0.0	27.0	27	7.9088	0.0059	3411.5958	2364.7380	124.0	299.0	0.4147	121.0	0.4047	9.0	11.0	64.0	0.1719	0.1406	26.0	26.0	73.0	0.3562	0.3562	40.0	41.0	78.0	0.5256	0.5128	45.0	45.0	83.0	0.5422	0.5422	1.0	1.0	1.0	1.0	1.0
0.0	28.0	28	7.9538	0.0059	3431.0113	2378.1958	123.0	299.0	0.4114	119.0	0.3980	10.0	12.0	64.0	0.1875	0.1562	26.0	26.0	73.0	0.3562	0.3562	39.0	40.0	78.0	0.5128	0.5	43.0	44.0	83.0	0.5301	0.5181	1.0	1.0	1.0	1.0	1.0
0.0	29.0	29	8.0002	0.0059	3451.0238	2392.0674	124.0	299.0	0.4147	119.0	0.3980	10.0	12.0	64.0	0.1875	0.1562	25.0	25.0	73.0	0.3425	0.3425	39.0	41.0	78.0	0.5256	0.5	44.0	45.0	83.0	0.5422	0.5301	1.0	1.0	1.0	1.0	1.0
0.0	30.0	30	7.9668	0.0059	3436.5854	2382.0594	125.0	299.0	0.4181	121.0	0.4047	9.0	11.0	64.0	0.1719	0.1406	26.0	26.0	73.0	0.3562	0.3562	41.0	43.0	78.0	0.5513	0.5256	44.0	44.0	83.0	0.5301	0.5301	1.0	1.0	1.0	1.0	1.0
0.0	31.0	31	8.0202	0.0059	3459.6514	2398.0476	123.0	299.0	0.4114	119.0	0.3980	10.0	12.0	64.0	0.1875	0.1562	25.0	25.0	73.0	0.3425	0.3425	39.0	40.0	78.0	0.5128	0.5	44.0	45.0	83.0	0.5422	0.5301	1.0	1.0	1.0	1.0	1.0
0.0	32.0	32	8.0020	0.0059	3451.7987	2392.6046	124.0	299.0	0.4147	119.0	0.3980	9.0	11.0	64.0	0.1719	0.1406	25.0	25.0	73.0	0.3425	0.3425	40.0	42.0	78.0	0.5385	0.5128	44.0	45.0	83.0	0.5422	0.5301	1.0	1.0	1.0	1.0	1.0
0.0	33.0	33	8.0588	0.0059	3476.2905	2409.5809	125.0	299.0	0.4181	120.0	0.4013	9.0	11.0	64.0	0.1719	0.1406	25.0	25.0	73.0	0.3425	0.3425	41.0	43.0	78.0	0.5513	0.5256	44.0	45.0	83.0	0.5422	0.5301	1.0	1.0	1.0	1.0	1.0
0.0	34.0	34	8.0086	0.0059	3454.6341	2394.5699	126.0	299.0	0.4214	121.0	0.4047	9.0	11.0	64.0	0.1719	0.1406	25.0	25.0	73.0	0.3425	0.3425	40.0	42.0	78.0	0.5385	0.5128	46.0	47.0	83.0	0.5663	0.5542	1.0	1.0	1.0	1.0	1.0
0.0	35.0	35	8.0514	0.0059	3473.0991	2407.3688	121.0	299.0	0.4047	117.0	0.3913	9.0	11.0	64.0	0.1719	0.1406	24.0	24.0	73.0	0.3288	0.3288	40.0	42.0	78.0	0.5385	0.5128	43.0	43.0	83.0	0.5181	0.5181	1.0	1.0	1.0	1.0	1.0
0.0	36.0	36	8.0330	0.0059	3465.1610	2401.8666	122.0	299.0	0.4080	119.0	0.3980	9.0	11.0	64.0	0.1719	0.1406	24.0	24.0	73.0	0.3288	0.3288	40.0	41.0	78.0	0.5256	0.5128	45.0	45.0	83.0	0.5422	0.5422	1.0	1.0	1.0	1.0	1.0
0.0	37.0	37	7.8894	0.0059	3403.2139	2358.9281	128.0	299.0	0.4281	124.0	0.4147	10.0	12.0	64.0	0.1875	0.1562	26.0	26.0	73.0	0.3562	0.3562	41.0	43.0	78.0	0.5513	0.5256	46.0	46.0	83.0	0.5542	0.5542	1.0	1.0	1.0	1.0	1.0
0.0	38.0	38	7.9993	0.0059	3450.6112	2391.7814	123.0	299.0	0.4114	118.0	0.3946	9.0	11.0	64.0	0.1719	0.1406	25.0	25.0	73.0	0.3425	0.3425	39.0	42.0	78.0	0.5385	0.5	44.0	44.0	83.0	0.5301	0.5301	1.0	1.0	1.0	1.0	1.0
0.0	39.0	39	8.1214	0.0059	3503.3070	2428.3074	123.0	299.0	0.4114	119.0	0.3980	9.0	11.0	64.0	0.1719	0.1406	25.0	25.0	73.0	0.3425	0.3425	41.0	42.0	78.0	0.5385	0.5256	43.0	44.0	83.0	0.5301	0.5181	1.0	1.0	1.0	1.0	1.0
0.0	40.0	40	8.0491	0.0059	3472.0847	2406.6657	126.0	299.0	0.4214	123.0	0.4114	10.0	12.0	64.0	0.1875	0.1562	26.0	26.0	73.0	0.3562	0.3562	42.0	43.0	78.0	0.5513	0.5385	44.0	44.0	83.0	0.5301	0.5301	1.0	1.0	1.0	1.0	1.0
0.0	41.0	41	8.0723	0.0059	3482.1039	2413.6105	126.0	299.0	0.4214	121.0	0.4047	9.0	11.0	64.0	0.1719	0.1406	25.0	25.0	73.0	0.3425	0.3425	40.0	43.0	78.0	0.5513	0.5128	46.0	46.0	83.0	0.5542	0.5542	1.0	1.0	1.0	1.0	1.0
0.0	42.0	42	7.9577	0.0059	3432.6964	2379.3638	124.0	299.0	0.4147	120.0	0.4013	10.0	12.0	64.0	0.1875	0.1562	25.0	25.0	73.0	0.3425	0.3425	40.0	41.0	78.0	0.5256	0.5128	44.0	45.0	83.0	0.5422	0.5301	1.0	1.0	1.0	1.0	1.0
0.0	43.0	43	8.0251	0.0059	3461.7419	2399.4966	122.0	299.0	0.4080	119.0	0.3980	10.0	12.0	64.0	0.1875	0.1562	25.0	25.0	73.0	0.3425	0.3425	38.0	39.0	78.0	0.5	0.4872	45.0	45.0	83.0	0.5422	0.5422	1.0	1.0	1.0	1.0	1.0
0.0	44.0	44	8.0967	0.0059	3492.6576	2420.9258	125.0	299.0	0.4181	122.0	0.4080	10.0	12.0	64.0	0.1875	0.1562	25.0	25.0	73.0	0.3425	0.3425	40.0	41.0	78.0	0.5256	0.5128	46.0	46.0	83.0	0.5542	0.5542	1.0	1.0	1.0	1.0	1.0
0.0	45.0	45	8.0849	0.0059	3487.5431	2417.3807	122.0	299.0	0.4080	118.0	0.3946	9.0	11.0	64.0	0.1719	0.1406	25.0	25.0	73.0	0.3425	0.3425	40.0	41.0	78.0	0.5256	0.5128	43.0	44.0	83.0	0.5301	0.5181	1.0	1.0	1.0	1.0	1.0
0.0	46.0	46	8.0767	0.0059	3484.0279	2414.9441	122.0	299.0	0.4080	118.0	0.3946	9.0	11.0	64.0	0.1719	0.1406	25.0	25.0	73.0	0.3425	0.3425	39.0	40.0	78.0	0.5128	0.5	44.0	45.0	83.0	0.5422	0.5301	1.0	1.0	1.0	1.0	1.0
0.0	47.0	47	8.0608	0.0059	3477.1673	2410.1887	122.0	299.0	0.4080	118.0	0.3946	9.0	11.0	64.0	0.1719	0.1406	25.0	25.0	73.0	0.3425	0.3425	41.0	42.0	78.0	0.5385	0.5256	42.0	43.0	83.0	0.5181	0.5060	1.0	1.0	1.0	1.0	1.0
0.0	48.0	48	8.0172	0.0059	3458.3521	2397.1470	127.0	299.0	0.4247	123.0	0.4114	10.0	12.0	64.0	0.1875	0.1562	26.0	26.0	73.0	0.3562	0.3562	40.0	42.0	78.0	0.5385	0.5128	46.0	46.0	83.0	0.5542	0.5542	1.0	1.0	1.0	1.0	1.0
0.0	49.0	49	8.0232	0.0059	3460.9344	2398.9369	123.0	299.0	0.4114	120.0	0.4013	9.0	11.0	64.0	0.1719	0.1406	25.0	25.0	73.0	0.3425	0.3425	40.0	41.0	78.0	0.5256	0.5128	45.0	45.0	83.0	0.5422	0.5422	1.0	1.0	1.0	1.0	1.0
0.0	50.0	50	8.0491	0.0059	3472.1105	2406.6836	122.0	299.0	0.4080	117.0	0.3913	10.0	12.0	64.0	0.1875	0.1562	24.0	24.0	73.0	0.3288	0.3288	39.0	41.0	78.0	0.5256	0.5	43.0	44.0	83.0	0.5301	0.5181	1.0	1.0	1.0	1.0	1.0
0.0	51.0	51	8.0681	0.0059	3480.3073	2412.3652	124.0	299.0	0.4147	120.0	0.4013	10.0	12.0	64.0	0.1875	0.1562	25.0	25.0	73.0	0.3425	0.3425	41.0	42.0	78.0	0.5385	0.5256	43.0	44.0	83.0	0.5301	0.5181	1.0	1.0	1.0	1.0	1.0
0.0	52.0	52	8.0889	0.0059	3489.2664	2418.5752	126.0	299.0	0.4214	122.0	0.4080	9.0	11.0	64.0	0.1719	0.1406	24.0	24.0	73.0	0.3288	0.3288	42.0	44.0	78.0	0.5641	0.5385	46.0	46.0	83.0	0.5542	0.5542	1.0	1.0	1.0	1.0	1.0
0.0	53.0	53	7.9598	0.0059	3433.5921	2379.9847	124.0	299.0	0.4147	120.0	0.4013	10.0	11.0	64.0	0.1719	0.1562	25.0	25.0	73.0	0.3425	0.3425	40.0	42.0	78.0	0.5385	0.5128	44.0	45.0	83.0	0.5422	0.5301	1.0	1.0	1.0	1.0	1.0
0.0	54.0	54	7.9669	0.0059	3436.6540	2382.1071	127.0	299.0	0.4247	123.0	0.4114	10.0	12.0	64.0	0.1875	0.1562	26.0	26.0	73.0	0.3562	0.3562	42.0	43.0	78.0	0.5513	0.5385	44.0	45.0	83.0	0.5422	0.5301	1.0	1.0	1.0	1.0	1.0
0.0	55.0	55	7.9915	0.0059	3447.2403	2389.4449	123.0	299.0	0.4114	119.0	0.3980	10.0	12.0	64.0	0.1875	0.1562	24.0	24.0	73.0	0.3288	0.3288	40.0	42.0	78.0	0.5385	0.5128	44.0	44.0	83.0	0.5301	0.5301	1.0	1.0	1.0	1.0	1.0
0.0	56.0	56	8.0194	0.0059	3459.2954	2397.8008	123.0	299.0	0.4114	119.0	0.3980	10.0	12.0	64.0	0.1875	0.1562	24.0	24.0	73.0	0.3288	0.3288	41.0	42.0	78.0	0.5385	0.5256	43.0	44.0	83.0	0.5301	0.5181	1.0	1.0	1.0	1.0	1.0
0.0	57.0	57	8.1018	0.0059	3494.8293	2422.4311	123.0	299.0	0.4114	119.0	0.3980	10.0	11.0	64.0	0.1719	0.1562	25.0	25.0	73.0	0.3425	0.3425	38.0	41.0	78.0	0.5256	0.4872	45.0	45.0	83.0	0.5422	0.5422	1.0	1.0	1.0	1.0	1.0
0.0	58.0	58	7.9873	0.0059	3445.4512	2388.2048	125.0	299.0	0.4181	122.0	0.4080	10.0	12.0	64.0	0.1875	0.1562	24.0	24.0	73.0	0.3288	0.3288	41.0	42.0	78.0	0.5385	0.5256	46.0	46.0	83.0	0.5542	0.5542	1.0	1.0	1.0	1.0	1.0
0.0	59.0	59	7.9713	0.0059	3438.5248	2383.4037	126.0	299.0	0.4214	122.0	0.4080	9.0	11.0	64.0	0.1719	0.1406	26.0	26.0	73.0	0.3562	0.3562	39.0	41.0	78.0	0.5256	0.5	47.0	47.0	83.0	0.5663	0.5663	1.0	1.0	1.0	1.0	1.0
0.0	60.0	60	7.9893	0.0059	3446.3213	2388.8079	122.0	299.0	0.4080	119.0	0.3980	9.0	11.0	64.0	0.1719	0.1406	24.0	24.0	73.0	0.3288	0.3288	40.0	41.0	78.0	0.5256	0.5128	45.0	45.0	83.0	0.5422	0.5422	1.0	1.0	1.0	1.0	1.0
0.0	61.0	61	8.0244	0.0059	3461.4420	2399.2888	123.0	299.0	0.4114	120.0	0.4013	10.0	11.0	64.0	0.1719	0.1562	24.0	24.0	73.0	0.3288	0.3288	40.0	41.0	78.0	0.5256	0.5128	45.0	46.0	83.0	0.5542	0.5422	1.0	1.0	1.0	1.0	1.0
0.0	62.0	62	7.9848	0.0059	3444.3506	2387.4419	126.0	299.0	0.4214	123.0	0.4114	9.0	11.0	64.0	0.1719	0.1406	24.0	24.0	73.0	0.3288	0.3288	42.0	43.0	78.0	0.5513	0.5385	47.0	47.0	83.0	0.5663	0.5663	1.0	1.0	1.0	1.0	1.0
0.0	63.0	63	8.0876	0.0059	3488.6957	2418.1796	125.0	299.0	0.4181	123.0	0.4114	10.0	11.0	64.0	0.1719	0.1562	25.0	25.0	73.0	0.3425	0.3425	42.0	43.0	78.0	0.5513	0.5385	45.0	45.0	83.0	0.5422	0.5422	1.0	1.0	1.0	1.0	1.0
0.0	64.0	64	8.0495	0.0059	3472.2891	2406.8074	123.0	299.0	0.4114	119.0	0.3980	9.0	11.0	64.0	0.1719	0.1406	24.0	24.0	73.0	0.3288	0.3288	39.0	41.0	78.0	0.5256	0.5	46.0	46.0	83.0	0.5542	0.5542	1.0	1.0	1.0	1.0	1.0
0.0	65.0	65	8.0236	0.0059	3461.1096	2399.0583	125.0	299.0	0.4181	121.0	0.4047	9.0	11.0	64.0	0.1719	0.1406	25.0	25.0	73.0	0.3425	0.3425	41.0	43.0	78.0	0.5513	0.5256	45.0	45.0	83.0	0.5422	0.5422	1.0	1.0	1.0	1.0	1.0
0.0	66.0	66	7.9965	0.0059	3449.4266	2390.9603	120.0	299.0	0.4013	117.0	0.3913	9.0	11.0	64.0	0.1719	0.1406	23.0	23.0	73.0	0.3151	0.3151	40.0	41.0	78.0	0.5256	0.5128	44.0	44.0	83.0	0.5301	0.5301	1.0	1.0	1.0	1.0	1.0
0.0	67.0	67	8.1078	0.0059	3497.4418	2424.2419	122.0	299.0	0.4080	119.0	0.3980	9.0	11.0	64.0	0.1719	0.1406	24.0	24.0	73.0	0.3288	0.3288	41.0	42.0	78.0	0.5385	0.5256	44.0	44.0	83.0	0.5301	0.5301	1.0	1.0	1.0	1.0	1.0

Framework versions

• Transformers 4.51.3
• Pytorch 2.6.0+cu124
• Datasets 3.5.0
• Tokenizers 0.21.1