| ==> Building model.. |
| Postprocessor_name is ignored because postprocessor is passed |
| Performing inference on bronze2 test set... |
| Processing near ood... |
| Performing inference on imagenet22k_container dataset... |
| Computing metrics on imagenet22k_container dataset... |
| FPR@95: 48.49, AUROC: 82.61 AUPR_IN: 43.38, AUPR_OUT: 98.88 |
| ────────────────────────────────────────────────────────────────────── |
|
|
| Performing inference on ssb_hard dataset... |
| Computing metrics on ssb_hard dataset... |
| FPR@95: 48.10, AUROC: 80.16 AUPR_IN: 49.74, AUPR_OUT: 97.79 |
| ────────────────────────────────────────────────────────────────────── |
|
|
| Performing inference on ninco dataset... |
| Computing metrics on ninco dataset... |
| FPR@95: 57.75, AUROC: 76.60 AUPR_IN: 71.68, AUPR_OUT: 82.72 |
| ────────────────────────────────────────────────────────────────────── |
|
|
| Computing mean metrics... |
| FPR@95: 51.45, AUROC: 79.79 AUPR_IN: 54.93, AUPR_OUT: 93.13 |
| ────────────────────────────────────────────────────────────────────── |
|
|
| Processing far ood... |
| Performing inference on inaturalist dataset... |
| Computing metrics on inaturalist dataset... |
| FPR@95: 50.19, AUROC: 76.31 AUPR_IN: 67.05, AUPR_OUT: 86.42 |
| ────────────────────────────────────────────────────────────────────── |
|
|
| Performing inference on textures dataset... |
| Computing metrics on textures dataset... |
| FPR@95: 62.99, AUROC: 76.62 AUPR_IN: 71.68, AUPR_OUT: 81.33 |
| ────────────────────────────────────────────────────────────────────── |
|
|
| Performing inference on openimage_o dataset... |
| Computing metrics on openimage_o dataset... |
| FPR@95: 53.44, AUROC: 77.72 AUPR_IN: 59.19, AUPR_OUT: 92.63 |
| ────────────────────────────────────────────────────────────────────── |
|
|
| Computing mean metrics... |
| FPR@95: 55.54, AUROC: 76.88 AUPR_IN: 65.98, AUPR_OUT: 86.80 |
| ────────────────────────────────────────────────────────────────────── |
|
|
| FPR@95 AUROC AUPR_IN AUPR_OUT ACC |
| imagenet22k_container 48.49 82.61 43.38 98.88 74.76 |
| ssb_hard 48.10 80.16 49.74 97.79 74.76 |
| ninco 57.75 76.60 71.68 82.72 74.76 |
| nearood 51.45 79.79 54.93 93.13 74.76 |
| inaturalist 50.19 76.31 67.05 86.42 74.76 |
| textures 62.99 76.62 71.68 81.33 74.76 |
| openimage_o 53.44 77.72 59.19 92.63 74.76 |
| farood 55.54 76.88 65.98 86.80 74.76 |
|
|
