geolip-cv-experiments / colab_cv_loss_sweep_batched_output.txt
AbstractPhil's picture
Rename colab_cv_loss_batched_sweep.txt to colab_cv_loss_sweep_batched_output.txt
a608c00 verified
================================================================================
CV LOSS SWEEP β€” PURE NOISE PREDICTION
Random inputs β†’ MLP β†’ S^(d-1) β†’ constellation β†’ 10 random labels
No data structure. No signal. Pure sphere geometry + optimizer.
200 steps per run, ~2s each.
================================================================================
Running 43 configurations, 200 steps each
Estimated time: ~129s
[ 1/43] no_cv w=0.000 t=0.00 d=128 β†’ CV=0.2405 dim=48 acc=77% (2.1s)
[ 2/43] no_cv_s2 w=0.000 t=0.00 d=128 β†’ CV=0.2361 dim=47 acc=74% (1.9s)
[ 3/43] no_cv_s3 w=0.000 t=0.00 d=128 β†’ CV=0.2464 dim=46 acc=74% (1.9s)
[ 4/43] no_cv_s4 w=0.000 t=0.00 d=128 β†’ CV=0.2399 dim=47 acc=73% (1.9s)
[ 5/43] no_cv_s5 w=0.000 t=0.00 d=128 β†’ CV=0.2335 dim=47 acc=74% (2.1s)
[ 6/43] w0.001_t0.22 w=0.001 t=0.22 d=128 β†’ CV=0.2380 dim=48 acc=77% (2.4s)
[ 7/43] w0.01_t0.22 w=0.010 t=0.22 d=128 β†’ CV=0.2383 dim=48 acc=77% (2.4s)
[ 8/43] w0.1_t0.22 w=0.100 t=0.22 d=128 β†’ CV=0.2349 dim=48 acc=77% (2.3s)
[ 9/43] w0.5_t0.22 w=0.500 t=0.22 d=128 β†’ CV=0.2118 dim=50 acc=73% (2.5s)
[10/43] w1.0_t0.22 w=1.000 t=0.22 d=128 β†’ CV=0.2068 dim=52 acc=66% (2.3s)
[11/43] w5.0_t0.22 w=5.000 t=0.22 d=128 β†’ CV=0.2081 dim=50 acc=27% (2.4s)
[12/43] w10_t0.22 w=10.000 t=0.22 d=128 β†’ CV=0.2400 dim=47 acc=19% (2.3s)
[13/43] w50_t0.22 w=50.000 t=0.22 d=128 β†’ CV=0.2345 dim=46 acc=15% (2.3s)
[14/43] w100_t0.22 w=100.000 t=0.22 d=128 β†’ CV=0.2266 dim=44 acc=13% (2.5s)
[15/43] w0.01_t0.00 w=0.010 t=0.00 d=128 β†’ CV=0.2359 dim=48 acc=77% (2.3s)
[16/43] w0.01_t0.05 w=0.010 t=0.05 d=128 β†’ CV=0.2365 dim=48 acc=77% (2.3s)
[17/43] w0.01_t0.10 w=0.010 t=0.10 d=128 β†’ CV=0.2368 dim=48 acc=77% (2.4s)
[18/43] w0.01_t0.30 w=0.010 t=0.30 d=128 β†’ CV=0.2390 dim=48 acc=77% (2.5s)
[19/43] w0.01_t0.50 w=0.010 t=0.50 d=128 β†’ CV=0.2432 dim=47 acc=76% (2.3s)
[20/43] w0.01_t0.80 w=0.010 t=0.80 d=128 β†’ CV=0.2497 dim=46 acc=76% (2.3s)
[21/43] w0.01_t1.00 w=0.010 t=1.00 d=128 β†’ CV=0.2536 dim=45 acc=75% (2.3s)
[22/43] w0.01_t2.00 w=0.010 t=2.00 d=128 β†’ CV=0.5964 dim=34 acc=56% (2.5s)
[23/43] w1_t0.00 w=1.000 t=0.00 d=128 β†’ CV=0.1375 dim=72 acc=50% (2.3s)
[24/43] w1_t0.05 w=1.000 t=0.05 d=128 β†’ CV=0.1481 dim=69 acc=60% (2.3s)
[25/43] w1_t0.50 w=1.000 t=0.50 d=128 β†’ CV=0.4783 dim=46 acc=27% (2.3s)
[26/43] w1_t0.80 w=1.000 t=0.80 d=128 β†’ CV=0.7093 dim=25 acc=16% (2.5s)
[27/43] w1_t1.00 w=1.000 t=1.00 d=128 β†’ CV=0.9932 dim=32 acc=14% (2.4s)
[28/43] w100_t0.00 w=100.000 t=0.00 d=128 β†’ CV=0.1193 dim=70 acc=14% (2.3s)
[29/43] w100_t0.05 w=100.000 t=0.05 d=128 β†’ CV=0.1189 dim=70 acc=15% (2.4s)
[30/43] w100_t0.10 w=100.000 t=0.10 d=128 β†’ CV=0.1156 dim=69 acc=16% (2.5s)
[31/43] w100_t0.50 w=100.000 t=0.50 d=128 β†’ CV=0.4911 dim=32 acc=11% (2.4s)
[32/43] w100_t0.80 w=100.000 t=0.80 d=128 β†’ CV=0.8214 dim=21 acc=11% (2.3s)
[33/43] w100_t1.00 w=100.000 t=1.00 d=128 β†’ CV=0.9380 dim=16 acc=11% (2.4s)
[34/43] pure_cv_t0.22 w=1.000 t=0.22 d=128 β†’ CV=0.2441 dim=51 acc=10% (1.7s)
[35/43] pure_cv_t0.05 w=1.000 t=0.05 d=128 β†’ CV=0.1125 dim=74 acc=10% (1.6s)
[36/43] pure_cv_t0.50 w=1.000 t=0.50 d=128 β†’ CV=0.5095 dim=43 acc=10% (1.6s)
[37/43] pure_cv_t0.80 w=1.000 t=0.80 d=128 β†’ CV=0.7739 dim=25 acc=10% (1.6s)
[38/43] pure_cv_t1.00 w=1.000 t=1.00 d=128 β†’ CV=1.0356 dim=29 acc=10% (1.7s)
[39/43] dim16 w=0.000 t=0.00 d=16 β†’ CV=0.3687 dim=11 acc=18% (1.9s)
[40/43] dim32 w=0.000 t=0.00 d=32 β†’ CV=0.2578 dim=20 acc=29% (1.8s)
[41/43] dim64 w=0.000 t=0.00 d=64 β†’ CV=0.2282 dim=33 acc=48% (1.9s)
[42/43] dim256 w=0.000 t=0.00 d=256 β†’ CV=0.2729 dim=49 acc=96% (2.1s)
[43/43] dim512 w=0.000 t=0.00 d=512 β†’ CV=0.3254 dim=41 acc=98% (2.3s)
==========================================================================================
LABEL CV_W CV_T DIM FINAL_CV EFF_DIM ACC% CE
──────────────────────────────────────────────────────────────────────────────────────────
no_cv 0.000 0.00 128 0.2405~ 48 77% 0.7358
no_cv_s2 0.000 0.00 128 0.2361βœ“ 47 74% 0.7979
no_cv_s3 0.000 0.00 128 0.2464~ 46 74% 0.8117
no_cv_s4 0.000 0.00 128 0.2399βœ“ 47 73% 0.8253
no_cv_s5 0.000 0.00 128 0.2335βœ“ 47 74% 0.8215
w0.001_t0.22 0.001 0.22 128 0.2380βœ“ 48 77% 0.7356
w0.01_t0.22 0.010 0.22 128 0.2383βœ“ 48 77% 0.7347
w0.1_t0.22 0.100 0.22 128 0.2349βœ“ 48 77% 0.7393
w0.5_t0.22 0.500 0.22 128 0.2118βœ“ 50 73% 0.8655
w1.0_t0.22 1.000 0.22 128 0.2068βœ“ 52 66% 1.0556
w5.0_t0.22 5.000 0.22 128 0.2081βœ“ 50 27% 2.0441
w10_t0.22 10.000 0.22 128 0.2400βœ“ 47 19% 2.2069
w50_t0.22 50.000 0.22 128 0.2345βœ“ 46 15% 2.2766
w100_t0.22 100.000 0.22 128 0.2266βœ“ 44 13% 2.2899
w0.01_t0.00 0.010 0.00 128 0.2359βœ“ 48 77% 0.7327
w0.01_t0.05 0.010 0.05 128 0.2365βœ“ 48 77% 0.7331
w0.01_t0.10 0.010 0.10 128 0.2368βœ“ 48 77% 0.7333
w0.01_t0.30 0.010 0.30 128 0.2390βœ“ 48 77% 0.7364
w0.01_t0.50 0.010 0.50 128 0.2432~ 47 76% 0.7441
w0.01_t0.80 0.010 0.80 128 0.2497~ 46 76% 0.7659
w0.01_t1.00 0.010 1.00 128 0.2536~ 45 75% 0.7931
w0.01_t2.00 0.010 2.00 128 0.5964βœ— 34 56% 1.2895
w1_t0.00 1.000 0.00 128 0.1375βœ— 72 50% 1.4606
w1_t0.05 1.000 0.05 128 0.1481βœ— 69 60% 1.1755
w1_t0.50 1.000 0.50 128 0.4783βœ— 46 27% 2.0525
w1_t0.80 1.000 0.80 128 0.7093βœ— 25 16% 2.2492
w1_t1.00 1.000 1.00 128 0.9932βœ— 32 14% 2.2735
w100_t0.00 100.000 0.00 128 0.1193βœ— 70 14% 2.2686
w100_t0.05 100.000 0.05 128 0.1189βœ— 70 15% 2.2661
w100_t0.10 100.000 0.10 128 0.1156βœ— 69 16% 2.2596
w100_t0.50 100.000 0.50 128 0.4911βœ— 32 11% 2.2973
w100_t0.80 100.000 0.80 128 0.8214βœ— 21 11% 2.2996
w100_t1.00 100.000 1.00 128 0.9380βœ— 16 11% 2.3023
pure_cv_t0.22 1.000 0.22 128 0.2441~ 51 10% 2.3049
pure_cv_t0.05 1.000 0.05 128 0.1125βœ— 74 10% 2.3045
pure_cv_t0.50 1.000 0.50 128 0.5095βœ— 43 10% 2.3048
pure_cv_t0.80 1.000 0.80 128 0.7739βœ— 25 10% 2.3050
pure_cv_t1.00 1.000 1.00 128 1.0356βœ— 29 10% 2.3044
dim16 0.000 0.00 16 0.3687βœ— 11 18% 2.2120
dim32 0.000 0.00 32 0.2578~ 20 29% 2.0134
dim64 0.000 0.00 64 0.2282βœ“ 33 48% 1.5450
dim256 0.000 0.00 256 0.2729βœ— 49 96% 0.1350
dim512 0.000 0.00 512 0.3254βœ— 41 98% 0.0575
==========================================================================================
ANALYSIS
==========================================================================================
[1] NO CV LOSS, PURE NOISE (d=128, 5 seeds):
CV: mean=0.2393 min=0.2335 max=0.2464 spread=0.0129
Dim: mean=47.0
Within [0.17, 0.24]: 3/5
[2] WEIGHT SWEEP (target=0.22, d=128):
w= 0.001 β†’ CV=0.2380 acc=77%
w= 0.010 β†’ CV=0.2383 acc=77%
w= 0.100 β†’ CV=0.2349 acc=77%
w= 0.500 β†’ CV=0.2118 acc=73%
w= 1.000 β†’ CV=0.2068 acc=66%
w= 5.000 β†’ CV=0.2081 acc=27%
w= 10.000 β†’ CV=0.2400 acc=19%
w= 50.000 β†’ CV=0.2345 acc=15%
w= 100.000 β†’ CV=0.2266 acc=13%
[3] TARGET SWEEP (w=0.01, d=128):
target=0.00 β†’ CV=0.2359βœ“ acc=77%
target=0.05 β†’ CV=0.2365βœ“ acc=77%
target=0.10 β†’ CV=0.2368βœ“ acc=77%
target=0.22 β†’ CV=0.2383βœ“ acc=77%
target=0.30 β†’ CV=0.2390βœ“ acc=77%
target=0.50 β†’ CV=0.2432βœ— acc=76%
target=0.80 β†’ CV=0.2497βœ— acc=76%
target=1.00 β†’ CV=0.2536βœ— acc=75%
target=2.00 β†’ CV=0.5964βœ— acc=56%
[3] TARGET SWEEP (w=1.0, d=128):
target=0.00 β†’ CV=0.1375βœ— acc=50%
target=0.05 β†’ CV=0.1481βœ— acc=60%
target=0.22 β†’ CV=0.2068βœ“ acc=66%
target=0.50 β†’ CV=0.4783βœ— acc=27%
target=0.80 β†’ CV=0.7093βœ— acc=16%
target=1.00 β†’ CV=0.9932βœ— acc=14%
[3] TARGET SWEEP (w=100.0, d=128):
target=0.00 β†’ CV=0.1193βœ— acc=14%
target=0.05 β†’ CV=0.1189βœ— acc=15%
target=0.10 β†’ CV=0.1156βœ— acc=16%
target=0.22 β†’ CV=0.2266βœ“ acc=13%
target=0.50 β†’ CV=0.4911βœ— acc=11%
target=0.80 β†’ CV=0.8214βœ— acc=11%
target=1.00 β†’ CV=0.9380βœ— acc=11%
[4] DIMENSION SWEEP (no CV loss):
d= 16 β†’ CV=0.3687 eff_dim=11
d= 32 β†’ CV=0.2578 eff_dim=20
d= 64 β†’ CV=0.2282 eff_dim=33
d= 256 β†’ CV=0.2729 eff_dim=49
d= 512 β†’ CV=0.3254 eff_dim=41
[5] EXTREME FORCE (wβ‰₯100, d=128):
target=0.00 β†’ CV=0.1193 (Ξ” from 0.20: 0.0807) acc=14%
target=0.05 β†’ CV=0.1189 (Ξ” from 0.20: 0.0811) acc=15%
target=0.10 β†’ CV=0.1156 (Ξ” from 0.20: 0.0844) acc=16%
target=0.22 β†’ CV=0.2266 (Ξ” from 0.20: 0.0266) acc=13%
target=0.50 β†’ CV=0.4911 (Ξ” from 0.20: 0.2911) acc=11%
target=0.80 β†’ CV=0.8214 (Ξ” from 0.20: 0.6214) acc=11%
target=1.00 β†’ CV=0.9380 (Ξ” from 0.20: 0.7380) acc=11%
[5b] PURE CV (no CE loss, only geometric pressure):
target=0.05 β†’ CV=0.1125 (Ξ” from 0.20: 0.0875) dim=74
target=0.22 β†’ CV=0.2441 (Ξ” from 0.20: 0.0441) dim=51
target=0.50 β†’ CV=0.5095 (Ξ” from 0.20: 0.3095) dim=43
target=0.80 β†’ CV=0.7739 (Ξ” from 0.20: 0.5739) dim=25
target=1.00 β†’ CV=1.0356 (Ξ” from 0.20: 0.8356) dim=29
[6] CV TRAJECTORIES (step 0 β†’ step 200):
no_cv : 0.1553 β†’ 0.2134 (Ξ”=+0.0581)
no_cv_s2 : 0.1392 β†’ 0.2291 (Ξ”=+0.0899)
no_cv_s3 : 0.1539 β†’ 0.2406 (Ξ”=+0.0867)
no_cv_s4 : 0.1369 β†’ 0.2439 (Ξ”=+0.1070)
no_cv_s5 : 0.1408 β†’ 0.2311 (Ξ”=+0.0903)
Raw results saved to cv_sweep_results.json
================================================================================
CV SWEEP COMPLETE
================================================================================