rciric commited on
Commit
d0b331e
·
verified ·
1 Parent(s): 50b7f27

Initial upload via tools/push_to_hf.py (architecture: ilex.models.triad.TriadPlainConvUNet)

Browse files
Files changed (3) hide show
  1. README.md +65 -0
  2. config.json +42 -0
  3. model.safetensors +3 -0
README.md ADDED
@@ -0,0 +1,65 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ library_name: ilex
3
+ tags:
4
+ - jax
5
+ - equinox
6
+ - ilex
7
+ - neuroimaging
8
+ - 3d-mri
9
+ license: mit
10
+ license_link: https://github.com/wangshansong1/Triad/blob/main/LICENSE
11
+ ---
12
+
13
+ # Triad (3D-MRI self-supervised foundation backbone) -- Triad PlainConvUNet encoder (SimMIM-pretrained)
14
+
15
+ ## Description
16
+
17
+ Triad vision foundation model for 3D MRI, ported to JAX / Equinox from the upstream PyTorch release. Triad is an nnUNet PlainConvEncoder pretrained self-supervised on Triad-131K (131,170 3D MRI volumes spanning brain, breast, and prostate; T1/T2/FLAIR/DWI/fMRI/DCE) and serves as a transfer-learning backbone for downstream MRI segmentation, classification, and registration. The published checkpoints are encoder-only (the self-supervised decoder / mask token are stripped); this port exposes the pretrained encoder, whose multi-scale skip features are the transfer representation. Two pretraining objectives are released as separate bundles: masked autoencoding (MAE) and SimMIM. The alternative Swin-B backbone variants are out of scope for v0 (pending a 3D Swin-UNETR primitive).
18
+
19
+ ## Intended use
20
+
21
+ As the MAE variant, but pretrained with the SimMIM masked-image-modelling objective (in-place masking + L1 reconstruction). Same encoder architecture and Triad-131K corpus; provided so downstream users can pick whichever SSL objective transfers better for their task. Encoder-only.
22
+
23
+ ## Usage
24
+
25
+ ```python
26
+ from ilex.models.triad import TriadPlainConvUNet
27
+ model = TriadPlainConvUNet.from_pretrained('ilex-hub/triad.plainconvunet-simmim.1')
28
+ ```
29
+
30
+ ## Authors
31
+
32
+ Wang S., et al.
33
+
34
+ ## Citation
35
+
36
+ Wang S., Safari M., Li Q., Chang C.-W., Qiu R. L. J., Roper J., Yu D. S., Yang X. (2025). Triad: Vision Foundation Model for 3D Magnetic Resonance Imaging. arXiv:2502.14064. The nnU-Net backbone the encoder is taken from: Isensee F., Jaeger P. F., Kohl S. A. A., Petersen J., Maier-Hein K. H. (2021). nnU-Net: a self- configuring method for deep learning-based biomedical image segmentation. Nature Methods 18(2):203-211. doi:10.1038/s41592-020-01008-z
37
+
38
+ ### References
39
+
40
+ - Wang S., et al. (2025). Triad: Vision Foundation Model for 3D Magnetic Resonance Imaging. arXiv:2502.14064. https://arxiv.org/abs/2502.14064
41
+ - Codebase: https://github.com/wangshansong1/Triad
42
+
43
+ ## License
44
+
45
+ HF Hub license tag: `mit`
46
+
47
+ **Effective terms:** MIT (Shansong Wang et al.) on both the Triad code (https://github.com/wangshansong1/Triad) and the released pretrained checkpoints. No commercial restrictions; no gating required. The arXiv preprint (2502.14064) is separately distributed under CC BY 4.0, but the code and weights the ilex bundle re-expresses are MIT. The ilex JAX / Equinox port code is separately licensed under Apache-2.0 / GPL-3.0; that does not alter the upstream MIT terms governing the weights.
48
+
49
+ Upstream license reference: https://github.com/wangshansong1/Triad/blob/main/LICENSE
50
+
51
+ ### Copyright
52
+
53
+ Network architecture and pretrained weights: copyright (c) the Triad authors, released under the MIT License. JAX / Equinox port: copyright (c) the ilex authors, released under the Apache-2.0 / GPL-3.0 dual license used by ilex itself.
54
+
55
+ ## Upstream source
56
+
57
+ Original weights / reference implementation: https://github.com/wangshansong1/Triad
58
+
59
+ ## Provenance
60
+
61
+ This artefact was produced by [ilex](https://github.com/hypercoil/ilex)'s
62
+ save/load pipeline. The architecture is implemented in
63
+ `ilex.models.triad.TriadPlainConvUNet` and the weights have been converted
64
+ from their upstream format. See the upstream source above
65
+ for the canonical reference.
config.json ADDED
@@ -0,0 +1,42 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "_ilex": {
3
+ "architecture": "ilex.models.triad.model.TriadPlainConvUNet",
4
+ "constructor_kwargs": {
5
+ "input_channels": 1
6
+ },
7
+ "format": "ilex",
8
+ "framework_version": {
9
+ "equinox": "0.13.8",
10
+ "ilex": "0.0.0.dev0",
11
+ "jax": "0.10.0",
12
+ "jaxlib": "0.10.0",
13
+ "numpy": "2.4.4",
14
+ "safetensors": "0.7.0"
15
+ },
16
+ "has_state": false,
17
+ "origin": "ilex-native"
18
+ },
19
+ "authors": "Wang S., et al.",
20
+ "copyright": "Network architecture and pretrained weights: copyright (c) the Triad authors, released under the MIT License. JAX / Equinox port: copyright (c) the ilex authors, released under the Apache-2.0 / GPL-3.0 dual license used by ilex itself.",
21
+ "data_type": "nibabel",
22
+ "description": "Triad vision foundation model for 3D MRI, ported to JAX / Equinox from the upstream PyTorch release. Triad is an nnUNet PlainConvEncoder pretrained self-supervised on Triad-131K (131,170 3D MRI volumes spanning brain, breast, and prostate; T1/T2/FLAIR/DWI/fMRI/DCE) and serves as a transfer-learning backbone for downstream MRI segmentation, classification, and registration. The published checkpoints are encoder-only (the self-supervised decoder / mask token are stripped); this port exposes the pretrained encoder, whose multi-scale skip features are the transfer representation. Two pretraining objectives are released as separate bundles: masked autoencoding (MAE) and SimMIM. The alternative Swin-B backbone variants are out of scope for v0 (pending a 3D Swin-UNETR primitive).",
23
+ "equinox_version": "0.13.8",
24
+ "ilex_version": "0.0.0.dev0",
25
+ "image_classes": "Single-channel 3D MRI volume (contrast-general; pretrained across T1, T2, FLAIR, DWI, fMRI, DCE).",
26
+ "intended_use": "Research. A pretrained 3D-MRI encoder backbone for transfer learning; consumers attach a task-specific decoder / head and fine-tune. Inputs are single-channel 3D MRI volumes with each spatial dimension a multiple of 32.",
27
+ "jax_version": "0.10.0",
28
+ "label_classes": "N/A -- self-supervised backbone; no fixed label set. Output is the tuple of per-stage encoder feature maps.",
29
+ "network_data_format": {
30
+ "inputs": {},
31
+ "outputs": {}
32
+ },
33
+ "numpy_version": "2.4.4",
34
+ "pred_classes": "Multi-scale encoder skip features (6 stages, channels [32, 64, 128, 256, 320, 320]); the bottleneck is the deepest skip.",
35
+ "references": [
36
+ "Wang S., et al. (2025). Triad: Vision Foundation Model for 3D Magnetic Resonance Imaging. arXiv:2502.14064. https://arxiv.org/abs/2502.14064",
37
+ "Codebase: https://github.com/wangshansong1/Triad"
38
+ ],
39
+ "schema": "https://github.com/Project-MONAI/MONAI-extra-test-data/releases/download/0.8.1/meta_schema_20240725.json",
40
+ "task": "3D-MRI self-supervised foundation backbone (transfer learning)",
41
+ "version": "0.0.0"
42
+ }
model.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6dfa2c1bad59af37331957bf712c47871e25042becb0a1e4acd3b15d329ad498
3
+ size 56105544