Improve model card and add paper/code links
#1
by nielsr HF Staff - opened
README.md
CHANGED
|
@@ -1,24 +1,24 @@
|
|
| 1 |
---
|
| 2 |
library_name: tedbench
|
| 3 |
-
tags:
|
| 4 |
-
- protein
|
| 5 |
-
- structure
|
| 6 |
-
- fold-classification
|
| 7 |
-
- tedbench
|
| 8 |
-
pipeline_tag: feature-extraction
|
| 9 |
license: bsd-3-clause
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 10 |
---
|
| 11 |
|
| 12 |
# TEDBench — Pretrained autoencoder (structure only)
|
| 13 |
|
| 14 |
**Variant:** `miae_s` | **Parameters:** 29M | **Layers:** 6 | **Hidden dim:** 512 | **Attn heads:** 8
|
| 15 |
|
| 16 |
-
This
|
|
|
|
|
|
|
| 17 |
|
| 18 |
-
|
| 19 |
-
|
| 20 |
-
autoencoder that masks up to 90% of backbone frames and reconstructs the full
|
| 21 |
-
structure with a lightweight decoder.
|
| 22 |
|
| 23 |
## Architecture sizes
|
| 24 |
|
|
@@ -34,6 +34,8 @@ Append `+model.use_seq_input=true` to `miae_b` for the **+seq** variant.
|
|
| 34 |
|
| 35 |
### Load from the HuggingFace Hub
|
| 36 |
|
|
|
|
|
|
|
| 37 |
```python
|
| 38 |
from tedbench.utils.io import load_from_hf
|
| 39 |
|
|
@@ -41,6 +43,15 @@ model = load_from_hf("TEDBench/miae-s")
|
|
| 41 |
model.eval()
|
| 42 |
```
|
| 43 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 44 |
### From a Lightning checkpoint
|
| 45 |
|
| 46 |
```python
|
|
@@ -56,7 +67,7 @@ model.eval()
|
|
| 56 |
@inproceedings{chen2026tedbench,
|
| 57 |
title={Protein Fold Classification at Scale: Benchmarking and Pretraining},
|
| 58 |
author={Chen, Dexiong and Manolache, Andrei and Niepert, Mathias and Borgwardt, Karsten},
|
| 59 |
-
booktitle={Proceedings of the 43rd International Conference on Machine Learning},
|
| 60 |
year={2026}
|
| 61 |
}
|
| 62 |
-
```
|
|
|
|
| 1 |
---
|
| 2 |
library_name: tedbench
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 3 |
license: bsd-3-clause
|
| 4 |
+
pipeline_tag: graph-ml
|
| 5 |
+
tags:
|
| 6 |
+
- protein
|
| 7 |
+
- structure
|
| 8 |
+
- fold-classification
|
| 9 |
+
- tedbench
|
| 10 |
---
|
| 11 |
|
| 12 |
# TEDBench — Pretrained autoencoder (structure only)
|
| 13 |
|
| 14 |
**Variant:** `miae_s` | **Parameters:** 29M | **Layers:** 6 | **Hidden dim:** 512 | **Attn heads:** 8
|
| 15 |
|
| 16 |
+
This repository contains a **pretrained MiAE** checkpoint. Use it as a feature extractor or as the starting point for fine-tuning on protein structure tasks.
|
| 17 |
+
|
| 18 |
+
MiAE (Masked Invariant Autoencoder) is an $\mathrm{SE(3)}$-invariant masked autoencoder that masks up to 90% of backbone frames and reconstructs the full structure with a lightweight decoder. It was introduced in the paper [Protein Fold Classification at Scale: Benchmarking and Pretraining](https://arxiv.org/abs/2605.18552).
|
| 19 |
|
| 20 |
+
- **Paper:** [Protein Fold Classification at Scale: Benchmarking and Pretraining](https://arxiv.org/abs/2605.18552)
|
| 21 |
+
- **Repository:** [BorgwardtLab/TEDBench](https://github.com/BorgwardtLab/TEDBench)
|
|
|
|
|
|
|
| 22 |
|
| 23 |
## Architecture sizes
|
| 24 |
|
|
|
|
| 34 |
|
| 35 |
### Load from the HuggingFace Hub
|
| 36 |
|
| 37 |
+
You can load the model using the `tedbench` library:
|
| 38 |
+
|
| 39 |
```python
|
| 40 |
from tedbench.utils.io import load_from_hf
|
| 41 |
|
|
|
|
| 43 |
model.eval()
|
| 44 |
```
|
| 45 |
|
| 46 |
+
Alternatively, using the library's high-level API:
|
| 47 |
+
|
| 48 |
+
```python
|
| 49 |
+
import tedbench
|
| 50 |
+
|
| 51 |
+
model = tedbench.load_model("miae-s")
|
| 52 |
+
model.eval()
|
| 53 |
+
```
|
| 54 |
+
|
| 55 |
### From a Lightning checkpoint
|
| 56 |
|
| 57 |
```python
|
|
|
|
| 67 |
@inproceedings{chen2026tedbench,
|
| 68 |
title={Protein Fold Classification at Scale: Benchmarking and Pretraining},
|
| 69 |
author={Chen, Dexiong and Manolache, Andrei and Niepert, Mathias and Borgwardt, Karsten},
|
| 70 |
+
booktitle={Proceedings of the 43rd International Conference on Machine Learning (ICML)},
|
| 71 |
year={2026}
|
| 72 |
}
|
| 73 |
+
```
|