yx21e commited on
Commit
e5dd1fb
·
verified ·
1 Parent(s): d3bbb53

Update model card summary to best task-contract values

Browse files
README.md CHANGED
@@ -71,14 +71,14 @@ The checkpoint expects the same 16-channel gridded input described in the paper
71
 
72
  ## Evaluation Snapshot
73
 
74
- The paper evaluates WildFIRE-FM and ten Earth-FM comparators under fixed task contracts. A few final-paper WildFIRE-FM values are:
75
-
76
- - **Occupancy union F1:** `59.0656 ± 2.7372` percent.
77
- - **Fire-spread AP:** `30.0900 ± 1.2500` percent.
78
- - **Final burned-area log-RMSE:** `1.1657 ± 0.0126`, where lower is better.
79
- - **Analog retrieval nDCG@10:** `0.5099 ± 0.0336`.
80
- - **Smoke PM2.5 RMSE:** `4.4646 ± 0.0060`, where lower is better.
81
- - **Extreme-heat RMSE-C:** `0.2179 ± 0.0043`, where lower is better.
82
 
83
  The public release includes sanitized CSV/JSON summaries used to audit the displayed values. Manuscript table TeX is not included.
84
 
 
71
 
72
  ## Evaluation Snapshot
73
 
74
+ The paper evaluates WildFIRE-FM and ten Earth-FM comparators under fixed task contracts. The top card reports the best final-paper mean for each displayed task contract, with the winning backbone named in the card. The corresponding values are:
75
+
76
+ - **Occupancy union F1:** `60.1506 ± 7.5865` percent, ClimaX.
77
+ - **Fire-spread spatial F1:** `80.9700 ± 2.0200` percent, WildFIRE-FM.
78
+ - **Final burned-area log-RMSE:** `1.1657 ± 0.0126`, WildFIRE-FM; lower is better.
79
+ - **Analog retrieval nDCG@10:** `0.5099 ± 0.0336`, WildFIRE-FM.
80
+ - **Smoke PM2.5 RMSE:** `4.4403 ± 0.0488`, AlphaEarth; lower is better.
81
+ - **Extreme-heat RMSE-C:** `0.2179 ± 0.0043`, WildFIRE-FM; lower is better.
82
 
83
  The public release includes sanitized CSV/JSON summaries used to audit the displayed values. Manuscript table TeX is not included.
84
 
artifacts/manifests/paper_outputs.sha256 CHANGED
@@ -3,7 +3,7 @@ ca11c75c03078a9be26421b527ab5a49f5fc43ce8e5edd7da14af120a247b67c assets/primary
3
  1f992d7245b55b8674c00753efbd0e25f4e3be658e736b353772624dea2b7a8f assets/release_contents.svg
4
  5552fb6cca6a0a683592e724b4bd562f923cf99c04e2abdb846546b1d67aecc4 assets/selection_regret_final.png
5
  34807e65ca71365a26a3b74cae70e6b40ae6f2151110e12c53e0efa9f8b726aa assets/supporting_rank_map_final.png
6
- 024505248c8ba2bbb50d36d0b015d7fd7fbf5577b8b34faadda0efc972c6d3e8 assets/wildfire_fm_model_card.svg
7
  b369d13e0419fa8272ccdc994b6642f3b141248a879c030218e387c583537eb2 paper_outputs/figures/fig_fireprone_contract_progression_compact.pdf
8
  e3110c70c3cf8ecb8671163a401a155920266e3f907f9c6baf08e27ec6e6c410 paper_outputs/figures/fig_primary_rank_change_map.pdf
9
  4e5b791ba4d136f722bd75a61097203836819ce9411def1caac4cc1e6d881275 paper_outputs/figures/fig_rank_heatmap1.pdf
 
3
  1f992d7245b55b8674c00753efbd0e25f4e3be658e736b353772624dea2b7a8f assets/release_contents.svg
4
  5552fb6cca6a0a683592e724b4bd562f923cf99c04e2abdb846546b1d67aecc4 assets/selection_regret_final.png
5
  34807e65ca71365a26a3b74cae70e6b40ae6f2151110e12c53e0efa9f8b726aa assets/supporting_rank_map_final.png
6
+ 7adb6a949bce3203b6cb10a458e115c60ba0b3efdb10f2ca1a1fd508924bc2ac assets/wildfire_fm_model_card.svg
7
  b369d13e0419fa8272ccdc994b6642f3b141248a879c030218e387c583537eb2 paper_outputs/figures/fig_fireprone_contract_progression_compact.pdf
8
  e3110c70c3cf8ecb8671163a401a155920266e3f907f9c6baf08e27ec6e6c410 paper_outputs/figures/fig_primary_rank_change_map.pdf
9
  4e5b791ba4d136f722bd75a61097203836819ce9411def1caac4cc1e6d881275 paper_outputs/figures/fig_rank_heatmap1.pdf
artifacts/manifests/paper_outputs.yml CHANGED
@@ -11,7 +11,7 @@ outputs:
11
  - path: assets/supporting_rank_map_final.png
12
  sha256: 34807e65ca71365a26a3b74cae70e6b40ae6f2151110e12c53e0efa9f8b726aa
13
  - path: assets/wildfire_fm_model_card.svg
14
- sha256: 024505248c8ba2bbb50d36d0b015d7fd7fbf5577b8b34faadda0efc972c6d3e8
15
  - path: paper_outputs/figures/fig_fireprone_contract_progression_compact.pdf
16
  sha256: b369d13e0419fa8272ccdc994b6642f3b141248a879c030218e387c583537eb2
17
  - path: paper_outputs/figures/fig_primary_rank_change_map.pdf
 
11
  - path: assets/supporting_rank_map_final.png
12
  sha256: 34807e65ca71365a26a3b74cae70e6b40ae6f2151110e12c53e0efa9f8b726aa
13
  - path: assets/wildfire_fm_model_card.svg
14
+ sha256: 7adb6a949bce3203b6cb10a458e115c60ba0b3efdb10f2ca1a1fd508924bc2ac
15
  - path: paper_outputs/figures/fig_fireprone_contract_progression_compact.pdf
16
  sha256: b369d13e0419fa8272ccdc994b6642f3b141248a879c030218e387c583537eb2
17
  - path: paper_outputs/figures/fig_primary_rank_change_map.pdf
assets/wildfire_fm_model_card.svg CHANGED