| Loading Freckles v40 + CIFAR-10... |
|
|
| Precomputing train set... |
|
|
| Train: 0%| | 0/391 [00:00<?, ?it/s] |
| Train: 1%| | 2/391 [00:00<00:21, 18.10it/s] |
| Train: 2%|β | 7/391 [00:00<00:11, 34.74it/s] |
| Train: 3%|β | 12/391 [00:00<00:09, 40.25it/s] |
| Train: 4%|β | 17/391 [00:00<00:08, 42.89it/s] |
| Train: 6%|β | 22/391 [00:00<00:08, 44.37it/s] |
| Train: 7%|β | 27/391 [00:00<00:08, 45.24it/s] |
| Train: 8%|β | 32/391 [00:00<00:07, 45.80it/s] |
| Train: 9%|β | 37/391 [00:00<00:07, 46.14it/s] |
| Train: 11%|β | 42/391 [00:00<00:07, 46.38it/s] |
| Train: 12%|ββ | 47/391 [00:01<00:07, 46.53it/s] |
| Train: 13%|ββ | 52/391 [00:01<00:07, 46.59it/s] |
| Train: 15%|ββ | 57/391 [00:01<00:07, 46.63it/s] |
| Train: 16%|ββ | 62/391 [00:01<00:07, 46.64it/s] |
| Train: 17%|ββ | 67/391 [00:01<00:06, 46.74it/s] |
| Train: 18%|ββ | 72/391 [00:01<00:06, 46.76it/s] |
| Train: 20%|ββ | 77/391 [00:01<00:06, 46.88it/s] |
| Train: 21%|ββ | 82/391 [00:01<00:06, 46.95it/s] |
| Train: 22%|βββ | 87/391 [00:01<00:06, 47.03it/s] |
| Train: 24%|βββ | 92/391 [00:02<00:06, 47.07it/s] |
| Train: 25%|βββ | 97/391 [00:02<00:06, 47.08it/s] |
| Train: 26%|βββ | 102/391 [00:02<00:06, 47.13it/s] |
| Train: 27%|βββ | 107/391 [00:02<00:06, 47.16it/s] |
| Train: 29%|βββ | 112/391 [00:02<00:05, 47.15it/s] |
| Train: 30%|βββ | 117/391 [00:02<00:05, 47.14it/s] |
| Train: 31%|βββ | 122/391 [00:02<00:05, 47.16it/s] |
| Train: 32%|ββββ | 127/391 [00:02<00:05, 47.15it/s] |
| Train: 34%|ββββ | 132/391 [00:02<00:05, 47.14it/s] |
| Train: 35%|ββββ | 137/391 [00:02<00:05, 47.13it/s] |
| Train: 36%|ββββ | 142/391 [00:03<00:05, 47.11it/s] |
| Train: 38%|ββββ | 147/391 [00:03<00:05, 47.12it/s] |
| Train: 39%|ββββ | 152/391 [00:03<00:05, 47.13it/s] |
| Train: 40%|ββββ | 157/391 [00:03<00:04, 47.12it/s] |
| Train: 41%|βββββ | 162/391 [00:03<00:04, 47.12it/s] |
| Train: 43%|βββββ | 167/391 [00:03<00:04, 47.12it/s] |
| Train: 44%|βββββ | 172/391 [00:03<00:04, 47.13it/s] |
| Train: 45%|βββββ | 177/391 [00:03<00:04, 47.13it/s] |
| Train: 47%|βββββ | 182/391 [00:03<00:04, 47.14it/s] |
| Train: 48%|βββββ | 187/391 [00:04<00:04, 47.13it/s] |
| Train: 49%|βββββ | 192/391 [00:04<00:04, 47.12it/s] |
| Train: 50%|βββββ | 197/391 [00:04<00:04, 47.13it/s] |
| Train: 52%|ββββββ | 202/391 [00:04<00:04, 47.14it/s] |
| Train: 53%|ββββββ | 207/391 [00:04<00:03, 47.14it/s] |
| Train: 54%|ββββββ | 212/391 [00:04<00:03, 47.12it/s] |
| Train: 55%|ββββββ | 217/391 [00:04<00:03, 47.10it/s] |
| Train: 57%|ββββββ | 222/391 [00:04<00:03, 47.11it/s] |
| Train: 58%|ββββββ | 227/391 [00:04<00:03, 47.08it/s] |
| Train: 59%|ββββββ | 232/391 [00:04<00:03, 47.08it/s] |
| Train: 61%|ββββββ | 237/391 [00:05<00:03, 47.04it/s] |
| Train: 62%|βββββββ | 242/391 [00:05<00:03, 47.03it/s] |
| Train: 63%|βββββββ | 247/391 [00:05<00:03, 47.03it/s] |
| Train: 64%|βββββββ | 252/391 [00:05<00:02, 47.02it/s] |
| Train: 66%|βββββββ | 257/391 [00:05<00:02, 47.06it/s] |
| Train: 67%|βββββββ | 262/391 [00:05<00:02, 47.12it/s] |
| Train: 68%|βββββββ | 267/391 [00:05<00:02, 47.12it/s] |
| Train: 70%|βββββββ | 272/391 [00:05<00:02, 47.11it/s] |
| Train: 71%|βββββββ | 277/391 [00:05<00:02, 47.09it/s] |
| Train: 72%|ββββββββ | 282/391 [00:06<00:02, 47.08it/s] |
| Train: 73%|ββββββββ | 287/391 [00:06<00:02, 47.07it/s] |
| Train: 75%|ββββββββ | 292/391 [00:06<00:02, 47.04it/s] |
| Train: 76%|ββββββββ | 297/391 [00:06<00:01, 47.02it/s] |
| Train: 77%|ββββββββ | 302/391 [00:06<00:01, 47.03it/s] |
| Train: 79%|ββββββββ | 307/391 [00:06<00:01, 47.05it/s] |
| Train: 80%|ββββββββ | 312/391 [00:06<00:01, 47.05it/s] |
| Train: 81%|ββββββββ | 317/391 [00:06<00:01, 47.09it/s] |
| Train: 82%|βββββββββ | 322/391 [00:06<00:01, 47.11it/s] |
| Train: 84%|βββββββββ | 327/391 [00:07<00:01, 47.08it/s] |
| Train: 85%|βββββββββ | 332/391 [00:07<00:01, 47.06it/s] |
| Train: 86%|βββββββββ | 337/391 [00:07<00:01, 47.14it/s] |
| Train: 87%|βββββββββ | 342/391 [00:07<00:01, 47.18it/s] |
| Train: 89%|βββββββββ | 347/391 [00:07<00:00, 47.19it/s] |
| Train: 90%|βββββββββ | 352/391 [00:07<00:00, 47.24it/s] |
| Train: 91%|ββββββββββ| 357/391 [00:07<00:00, 47.20it/s] |
| Train: 93%|ββββββββββ| 362/391 [00:07<00:00, 47.22it/s] |
| Train: 94%|ββββββββββ| 367/391 [00:07<00:00, 47.24it/s] |
| Train: 95%|ββββββββββ| 372/391 [00:07<00:00, 47.21it/s] |
| Train: 96%|ββββββββββ| 377/391 [00:08<00:00, 47.17it/s] |
| Train: 98%|ββββββββββ| 382/391 [00:08<00:00, 47.19it/s] |
| Train: 100%|ββββββββββ| 391/391 [00:08<00:00, 46.29it/s] |
| Train: 50000 images |
| Precomputing test set... |
|
|
| Test: 0%| | 0/79 [00:00<?, ?it/s] |
| Test: 1%|β | 1/79 [00:00<00:09, 8.51it/s] |
| Test: 8%|β | 6/79 [00:00<00:02, 30.09it/s] |
| Test: 14%|ββ | 11/79 [00:00<00:01, 37.54it/s] |
| Test: 20%|ββ | 16/79 [00:00<00:01, 41.19it/s] |
| Test: 27%|βββ | 21/79 [00:00<00:01, 43.26it/s] |
| Test: 33%|ββββ | 26/79 [00:00<00:01, 44.51it/s] |
| Test: 39%|ββββ | 31/79 [00:00<00:01, 45.31it/s] |
| Test: 46%|βββββ | 36/79 [00:00<00:00, 45.88it/s] |
| Test: 52%|ββββββ | 41/79 [00:00<00:00, 46.23it/s] |
| Test: 58%|ββββββ | 46/79 [00:01<00:00, 46.49it/s] |
| Test: 65%|βββββββ | 51/79 [00:01<00:00, 46.62it/s] |
| Test: 71%|βββββββ | 56/79 [00:01<00:00, 46.74it/s] |
| Test: 77%|ββββββββ | 61/79 [00:01<00:00, 46.81it/s] |
| Test: 84%|βββββββββ | 66/79 [00:01<00:00, 46.82it/s] |
| Test: 90%|βββββββββ | 71/79 [00:01<00:00, 46.89it/s] |
| Test: 100%|ββββββββββ| 79/79 [00:01<00:00, 42.76it/s] Test: 10000 images |
|
|
| ====================================================================== |
| SPATIAL CONV READOUT β All conduit configurations |
| ====================================================================== |
|
|
| ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ |
| Training: Eigenvalues (S) only β 4ch |
| ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ |
|
|
| ep 5 train=9.9% test=10.0% |
| ep 10 train=9.9% test=10.0% |
| ep 15 train=13.8% test=15.1% |
| ep 20 train=16.7% test=15.9% |
| ep 25 train=19.4% test=19.0% |
| ep 30 train=20.4% test=20.9% |
|
|
| Eigenvalues (S) only β 4ch |
| Channels: 4, Params: 232,714, Time: 28s |
| Best test: 20.9% |
|
|
| Class Acc |
| ---------------------- |
| airplane 53.3% ββββββββββ |
| auto 4.3% |
| bird 3.6% |
| cat 0.3% |
| deer 3.3% |
| dog 26.3% βββββ |
| frog 51.3% ββββββββββ |
| horse 7.1% β |
| ship 8.2% β |
| truck 51.7% ββββββββββ |
|
|
|
|
| ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ |
| Training: Friction only β 4ch |
| ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ |
| ep 5 train=30.0% test=31.6% |
| ep 10 train=38.5% test=38.4% |
| ep 15 train=42.2% test=42.9% |
| ep 20 train=43.7% test=43.3% |
| ep 25 train=45.4% test=45.5% |
| ep 30 train=45.8% test=45.8% |
|
|
| Friction only β 4ch |
| Channels: 4, Params: 232,714, Time: 28s |
| Best test: 45.8% |
|
|
| Class Acc |
| ---------------------- |
| airplane 49.8% βββββββββ |
| auto 56.2% βββββββββββ |
| bird 25.8% βββββ |
| cat 28.8% βββββ |
| deer 33.8% ββββββ |
| dog 40.6% ββββββββ |
| frog 57.5% βββββββββββ |
| horse 53.3% ββββββββββ |
| ship 59.9% βββββββββββ |
| truck 52.0% ββββββββββ |
|
|
|
|
| ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ |
| Training: Release error only β 1ch |
| ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ |
| ep 5 train=9.9% test=10.0% |
| ep 10 train=9.8% test=10.0% |
| ep 15 train=10.1% test=10.0% |
| ep 20 train=9.9% test=10.0% |
| ep 25 train=9.9% test=10.0% |
| ep 30 train=10.0% test=10.0% |
|
|
| Release error only β 1ch |
| Channels: 1, Params: 230,986, Time: 27s |
| Best test: 10.0% |
|
|
| Class Acc |
| ---------------------- |
| airplane 0.0% |
| auto 100.0% ββββββββββββββββββββ |
| bird 0.0% |
| cat 0.0% |
| deer 0.0% |
| dog 0.0% |
| frog 0.0% |
| horse 0.0% |
| ship 0.0% |
| truck 0.0% |
|
|
|
|
| ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ |
| Training: Settle only β 4ch |
| ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ |
| ep 5 train=9.8% test=10.0% |
| ep 10 train=9.8% test=10.0% |
| ep 15 train=9.9% test=10.0% |
| ep 20 train=9.8% test=10.0% |
| ep 25 train=9.8% test=10.0% |
| ep 30 train=10.0% test=10.0% |
|
|
| Settle only β 4ch |
| Channels: 4, Params: 232,714, Time: 28s |
| Best test: 10.0% |
|
|
| Class Acc |
| ---------------------- |
| airplane 0.0% |
| auto 100.0% ββββββββββββββββββββ |
| bird 0.0% |
| cat 0.0% |
| deer 0.0% |
| dog 0.0% |
| frog 0.0% |
| horse 0.0% |
| ship 0.0% |
| truck 0.0% |
|
|
|
|
| ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ |
| Training: S + Friction β 8ch |
| ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ |
| ep 5 train=30.0% test=33.1% |
| ep 10 train=37.0% test=39.8% |
| ep 15 train=40.1% test=41.6% |
| ep 20 train=41.9% test=43.4% |
| ep 25 train=42.9% test=43.8% |
| ep 30 train=43.3% test=44.2% |
|
|
| S + Friction β 8ch |
| Channels: 8, Params: 235,018, Time: 29s |
| Best test: 44.2% |
|
|
| Class Acc |
| ---------------------- |
| airplane 48.3% βββββββββ |
| auto 52.1% ββββββββββ |
| bird 29.5% βββββ |
| cat 27.3% βββββ |
| deer 33.2% ββββββ |
| dog 35.2% βββββββ |
| frog 58.0% βββββββββββ |
| horse 50.1% ββββββββββ |
| ship 58.9% βββββββββββ |
| truck 49.6% βββββββββ |
|
|
|
|
| ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ |
| Training: S + Release error β 5ch |
| ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ |
| ep 5 train=9.8% test=10.0% |
| ep 10 train=9.8% test=10.0% |
| ep 15 train=10.4% test=10.0% |
| ep 20 train=18.3% test=20.2% |
| ep 25 train=22.4% test=23.0% |
| ep 30 train=23.4% test=23.5% |
|
|
| S + Release error β 5ch |
| Channels: 5, Params: 233,290, Time: 29s |
| Best test: 23.8% |
|
|
| Class Acc |
| ---------------------- |
| airplane 46.7% βββββββββ |
| auto 16.6% βββ |
| bird 1.5% |
| cat 0.4% |
| deer 3.4% |
| dog 33.5% ββββββ |
| frog 46.6% βββββββββ |
| horse 9.2% β |
| ship 37.2% βββββββ |
| truck 39.7% βββββββ |
|
|
|
|
| ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ |
| Training: S + Friction + Release β 9ch |
| ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ |
| ep 5 train=31.0% test=34.0% |
| ep 10 train=37.0% test=38.8% |
| ep 15 train=40.4% test=41.4% |
| ep 20 train=42.6% test=43.2% |
| ep 25 train=43.6% test=43.7% |
| ep 30 train=43.9% test=44.1% |
|
|
| S + Friction + Release β 9ch |
| Channels: 9, Params: 235,594, Time: 30s |
| Best test: 44.2% |
|
|
| Class Acc |
| ---------------------- |
| airplane 48.9% βββββββββ |
| auto 52.7% ββββββββββ |
| bird 29.8% βββββ |
| cat 28.0% βββββ |
| deer 32.4% ββββββ |
| dog 35.0% βββββββ |
| frog 56.4% βββββββββββ |
| horse 49.0% βββββββββ |
| ship 58.6% βββββββββββ |
| truck 49.8% βββββββββ |
|
|
|
|
| ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ |
| Training: FULL CONDUIT β 13ch |
| ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ |
| ep 5 train=29.7% test=31.5% |
| ep 10 train=37.1% test=37.7% |
| ep 15 train=40.6% test=41.3% |
| ep 20 train=42.4% test=43.1% |
| ep 25 train=43.6% test=43.7% |
| ep 30 train=44.3% test=44.5% |
|
|
| FULL CONDUIT β 13ch |
| Channels: 13, Params: 237,898, Time: 31s |
| Best test: 44.6% |
|
|
| Class Acc |
| ---------------------- |
| airplane 48.4% βββββββββ |
| auto 55.3% βββββββββββ |
| bird 27.3% βββββ |
| cat 27.8% βββββ |
| deer 33.2% ββββββ |
| dog 36.7% βββββββ |
| frog 57.0% βββββββββββ |
| horse 51.2% ββββββββββ |
| ship 58.2% βββββββββββ |
| truck 50.2% ββββββββββ |
|
|
|
|
| ====================================================================== |
| SCOREBOARD β Spatial Conv Readout |
| ====================================================================== |
|
|
| Configuration Channels Params Test Acc |
| ----------------------------------------------------------------- |
| Chance β β 10.0% |
| Release error only β 1ch E 230,986 10.0% |
| Settle only β 4ch T 232,714 10.0% |
| Eigenvalues (S) only β 4ch S 232,714 20.9% |
| S + Release error β 5ch SE 233,290 23.8% |
| S + Friction + Release β 9ch SFE 235,594 44.2% |
| S + Friction β 8ch SF 235,018 44.2% |
| FULL CONDUIT β 13ch SFET 237,898 44.6% |
| Friction only β 4ch F 232,714 45.8% |
|
|
| --- REFERENCE (from earlier) --- |
| Linear probe (friction flat) β β 24.3% |
| Linear probe (S flat) β β 21.0% |
| Patchwork + calibrated embeds β 530K 48.0% |
| Scatter + conv (raw S) β 2.9M 70.5% |
| CNN condensed (SGD) β 730K 74.7% |
|
|
| S-only conv: 20.9% |
| Best conduit: 45.8% (Friction only β 4ch) |
| Conduit lift: +24.8pp |
| vs scatter+conv reference: -24.7pp |