Initial upload via tools/push_to_hf.py (architecture: ilex.models.triad.TriadPlainConvUNet)
Browse files- README.md +65 -0
- config.json +42 -0
- model.safetensors +3 -0
README.md
ADDED
|
@@ -0,0 +1,65 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
library_name: ilex
|
| 3 |
+
tags:
|
| 4 |
+
- jax
|
| 5 |
+
- equinox
|
| 6 |
+
- ilex
|
| 7 |
+
- neuroimaging
|
| 8 |
+
- 3d-mri
|
| 9 |
+
license: mit
|
| 10 |
+
license_link: https://github.com/wangshansong1/Triad/blob/main/LICENSE
|
| 11 |
+
---
|
| 12 |
+
|
| 13 |
+
# Triad (3D-MRI self-supervised foundation backbone) -- Triad PlainConvUNet encoder (SimMIM-pretrained)
|
| 14 |
+
|
| 15 |
+
## Description
|
| 16 |
+
|
| 17 |
+
Triad vision foundation model for 3D MRI, ported to JAX / Equinox from the upstream PyTorch release. Triad is an nnUNet PlainConvEncoder pretrained self-supervised on Triad-131K (131,170 3D MRI volumes spanning brain, breast, and prostate; T1/T2/FLAIR/DWI/fMRI/DCE) and serves as a transfer-learning backbone for downstream MRI segmentation, classification, and registration. The published checkpoints are encoder-only (the self-supervised decoder / mask token are stripped); this port exposes the pretrained encoder, whose multi-scale skip features are the transfer representation. Two pretraining objectives are released as separate bundles: masked autoencoding (MAE) and SimMIM. The alternative Swin-B backbone variants are out of scope for v0 (pending a 3D Swin-UNETR primitive).
|
| 18 |
+
|
| 19 |
+
## Intended use
|
| 20 |
+
|
| 21 |
+
As the MAE variant, but pretrained with the SimMIM masked-image-modelling objective (in-place masking + L1 reconstruction). Same encoder architecture and Triad-131K corpus; provided so downstream users can pick whichever SSL objective transfers better for their task. Encoder-only.
|
| 22 |
+
|
| 23 |
+
## Usage
|
| 24 |
+
|
| 25 |
+
```python
|
| 26 |
+
from ilex.models.triad import TriadPlainConvUNet
|
| 27 |
+
model = TriadPlainConvUNet.from_pretrained('ilex-hub/triad.plainconvunet-simmim.1')
|
| 28 |
+
```
|
| 29 |
+
|
| 30 |
+
## Authors
|
| 31 |
+
|
| 32 |
+
Wang S., et al.
|
| 33 |
+
|
| 34 |
+
## Citation
|
| 35 |
+
|
| 36 |
+
Wang S., Safari M., Li Q., Chang C.-W., Qiu R. L. J., Roper J., Yu D. S., Yang X. (2025). Triad: Vision Foundation Model for 3D Magnetic Resonance Imaging. arXiv:2502.14064. The nnU-Net backbone the encoder is taken from: Isensee F., Jaeger P. F., Kohl S. A. A., Petersen J., Maier-Hein K. H. (2021). nnU-Net: a self- configuring method for deep learning-based biomedical image segmentation. Nature Methods 18(2):203-211. doi:10.1038/s41592-020-01008-z
|
| 37 |
+
|
| 38 |
+
### References
|
| 39 |
+
|
| 40 |
+
- Wang S., et al. (2025). Triad: Vision Foundation Model for 3D Magnetic Resonance Imaging. arXiv:2502.14064. https://arxiv.org/abs/2502.14064
|
| 41 |
+
- Codebase: https://github.com/wangshansong1/Triad
|
| 42 |
+
|
| 43 |
+
## License
|
| 44 |
+
|
| 45 |
+
HF Hub license tag: `mit`
|
| 46 |
+
|
| 47 |
+
**Effective terms:** MIT (Shansong Wang et al.) on both the Triad code (https://github.com/wangshansong1/Triad) and the released pretrained checkpoints. No commercial restrictions; no gating required. The arXiv preprint (2502.14064) is separately distributed under CC BY 4.0, but the code and weights the ilex bundle re-expresses are MIT. The ilex JAX / Equinox port code is separately licensed under Apache-2.0 / GPL-3.0; that does not alter the upstream MIT terms governing the weights.
|
| 48 |
+
|
| 49 |
+
Upstream license reference: https://github.com/wangshansong1/Triad/blob/main/LICENSE
|
| 50 |
+
|
| 51 |
+
### Copyright
|
| 52 |
+
|
| 53 |
+
Network architecture and pretrained weights: copyright (c) the Triad authors, released under the MIT License. JAX / Equinox port: copyright (c) the ilex authors, released under the Apache-2.0 / GPL-3.0 dual license used by ilex itself.
|
| 54 |
+
|
| 55 |
+
## Upstream source
|
| 56 |
+
|
| 57 |
+
Original weights / reference implementation: https://github.com/wangshansong1/Triad
|
| 58 |
+
|
| 59 |
+
## Provenance
|
| 60 |
+
|
| 61 |
+
This artefact was produced by [ilex](https://github.com/hypercoil/ilex)'s
|
| 62 |
+
save/load pipeline. The architecture is implemented in
|
| 63 |
+
`ilex.models.triad.TriadPlainConvUNet` and the weights have been converted
|
| 64 |
+
from their upstream format. See the upstream source above
|
| 65 |
+
for the canonical reference.
|
config.json
ADDED
|
@@ -0,0 +1,42 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"_ilex": {
|
| 3 |
+
"architecture": "ilex.models.triad.model.TriadPlainConvUNet",
|
| 4 |
+
"constructor_kwargs": {
|
| 5 |
+
"input_channels": 1
|
| 6 |
+
},
|
| 7 |
+
"format": "ilex",
|
| 8 |
+
"framework_version": {
|
| 9 |
+
"equinox": "0.13.8",
|
| 10 |
+
"ilex": "0.0.0.dev0",
|
| 11 |
+
"jax": "0.10.0",
|
| 12 |
+
"jaxlib": "0.10.0",
|
| 13 |
+
"numpy": "2.4.4",
|
| 14 |
+
"safetensors": "0.7.0"
|
| 15 |
+
},
|
| 16 |
+
"has_state": false,
|
| 17 |
+
"origin": "ilex-native"
|
| 18 |
+
},
|
| 19 |
+
"authors": "Wang S., et al.",
|
| 20 |
+
"copyright": "Network architecture and pretrained weights: copyright (c) the Triad authors, released under the MIT License. JAX / Equinox port: copyright (c) the ilex authors, released under the Apache-2.0 / GPL-3.0 dual license used by ilex itself.",
|
| 21 |
+
"data_type": "nibabel",
|
| 22 |
+
"description": "Triad vision foundation model for 3D MRI, ported to JAX / Equinox from the upstream PyTorch release. Triad is an nnUNet PlainConvEncoder pretrained self-supervised on Triad-131K (131,170 3D MRI volumes spanning brain, breast, and prostate; T1/T2/FLAIR/DWI/fMRI/DCE) and serves as a transfer-learning backbone for downstream MRI segmentation, classification, and registration. The published checkpoints are encoder-only (the self-supervised decoder / mask token are stripped); this port exposes the pretrained encoder, whose multi-scale skip features are the transfer representation. Two pretraining objectives are released as separate bundles: masked autoencoding (MAE) and SimMIM. The alternative Swin-B backbone variants are out of scope for v0 (pending a 3D Swin-UNETR primitive).",
|
| 23 |
+
"equinox_version": "0.13.8",
|
| 24 |
+
"ilex_version": "0.0.0.dev0",
|
| 25 |
+
"image_classes": "Single-channel 3D MRI volume (contrast-general; pretrained across T1, T2, FLAIR, DWI, fMRI, DCE).",
|
| 26 |
+
"intended_use": "Research. A pretrained 3D-MRI encoder backbone for transfer learning; consumers attach a task-specific decoder / head and fine-tune. Inputs are single-channel 3D MRI volumes with each spatial dimension a multiple of 32.",
|
| 27 |
+
"jax_version": "0.10.0",
|
| 28 |
+
"label_classes": "N/A -- self-supervised backbone; no fixed label set. Output is the tuple of per-stage encoder feature maps.",
|
| 29 |
+
"network_data_format": {
|
| 30 |
+
"inputs": {},
|
| 31 |
+
"outputs": {}
|
| 32 |
+
},
|
| 33 |
+
"numpy_version": "2.4.4",
|
| 34 |
+
"pred_classes": "Multi-scale encoder skip features (6 stages, channels [32, 64, 128, 256, 320, 320]); the bottleneck is the deepest skip.",
|
| 35 |
+
"references": [
|
| 36 |
+
"Wang S., et al. (2025). Triad: Vision Foundation Model for 3D Magnetic Resonance Imaging. arXiv:2502.14064. https://arxiv.org/abs/2502.14064",
|
| 37 |
+
"Codebase: https://github.com/wangshansong1/Triad"
|
| 38 |
+
],
|
| 39 |
+
"schema": "https://github.com/Project-MONAI/MONAI-extra-test-data/releases/download/0.8.1/meta_schema_20240725.json",
|
| 40 |
+
"task": "3D-MRI self-supervised foundation backbone (transfer learning)",
|
| 41 |
+
"version": "0.0.0"
|
| 42 |
+
}
|
model.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:6dfa2c1bad59af37331957bf712c47871e25042becb0a1e4acd3b15d329ad498
|
| 3 |
+
size 56105544
|