Improve model card
#1
by nielsr HF Staff - opened
README.md
CHANGED
|
@@ -1,7 +1,7 @@
|
|
| 1 |
---
|
| 2 |
-
license: mit
|
| 3 |
language:
|
| 4 |
- en
|
|
|
|
| 5 |
metrics:
|
| 6 |
- recall
|
| 7 |
- precision
|
|
@@ -14,4 +14,45 @@ tags:
|
|
| 14 |
- mesh-reconstruction
|
| 15 |
- pose-aware
|
| 16 |
- icme-2026
|
| 17 |
-
---
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
---
|
|
|
|
| 2 |
language:
|
| 3 |
- en
|
| 4 |
+
license: mit
|
| 5 |
metrics:
|
| 6 |
- recall
|
| 7 |
- precision
|
|
|
|
| 14 |
- mesh-reconstruction
|
| 15 |
- pose-aware
|
| 16 |
- icme-2026
|
| 17 |
+
---
|
| 18 |
+
|
| 19 |
+
# GraphiContact: Pose-aware Human-Scene Robust Contact Perception for Interactive Systems
|
| 20 |
+
|
| 21 |
+
This repository contains the pre-trained checkpoints for **GraphiContact**, a novel framework for monocular vertex-level human-scene contact prediction and 3D human mesh reconstruction.
|
| 22 |
+
|
| 23 |
+
[**Paper (arXiv)**](https://huggingface.co/papers/2603.20310) | [**Official GitHub Repository**](https://github.com/Aveiro-Lin/GraphiContact)
|
| 24 |
+
|
| 25 |
+
## Overview
|
| 26 |
+
|
| 27 |
+
GraphiContact jointly addresses vertex-level contact prediction and single-image 3D human mesh reconstruction. It uses reconstructed body geometry as a scaffold for contact reasoning, integrating pose-aware features with human-scene interaction understanding.
|
| 28 |
+
|
| 29 |
+
### Key Features
|
| 30 |
+
|
| 31 |
+
* **Pose-aware Framework**: Transfers complementary human priors from pretrained Transformer encoders to predict per-vertex human-scene contact on the reconstructed mesh.
|
| 32 |
+
* **SIMU Training Strategy**: Introduces a Single-Image Multi-Infer Uncertainty (SIMU) training strategy with token-level adaptive routing. This simulates occlusion and noisy observations during training while preserving efficient single-branch inference at test time.
|
| 33 |
+
* **Robust Perception**: Specifically designed to handle real-world scenarios with perceptual noise and occlusions, making it suitable for interactive systems like embodied AI and rehabilitation analysis.
|
| 34 |
+
|
| 35 |
+
<p align="center">
|
| 36 |
+
<img src="https://github.com/Aveiro-Lin/GraphiContact/raw/main/docs/Overview.png" width="850">
|
| 37 |
+
</p>
|
| 38 |
+
|
| 39 |
+
## Installation and Usage
|
| 40 |
+
|
| 41 |
+
For detailed instructions on environment setup, downloading model weights, and running inference demos, please refer to the [official GitHub repository](https://github.com/Aveiro-Lin/GraphiContact).
|
| 42 |
+
|
| 43 |
+
## Citation
|
| 44 |
+
|
| 45 |
+
If you find this work useful for your research, please consider citing the paper:
|
| 46 |
+
|
| 47 |
+
```bibtex
|
| 48 |
+
@inproceedings{lin2026graphicontact,
|
| 49 |
+
title={GraphiContact: Pose-aware Human-Scene Robust Contact Perception for Interactive Systems},
|
| 50 |
+
author={Lin, Aveiro and others},
|
| 51 |
+
booktitle={IEEE International Conference on Multimedia and Expo (ICME)},
|
| 52 |
+
year={2026}
|
| 53 |
+
}
|
| 54 |
+
```
|
| 55 |
+
|
| 56 |
+
## License
|
| 57 |
+
|
| 58 |
+
The research code is released under the **MIT license**. Note that the model has dependencies on the SMPL and MANO models, which are subject to their own [Software Copyright License](https://smpl.is.tue.mpg.de/modellicense) for non-commercial scientific research purposes.
|