Improve model card
Browse filesHi! I'm Niels from the Hugging Face community science team. I noticed this repository didn't have a full model card yet, so I've opened this PR to add a description of the project, including its key features and links to the paper and the official GitHub repository. Providing this information helps researchers and developers understand the model's capabilities and use cases more easily.
README.md
CHANGED
|
@@ -1,7 +1,7 @@
|
|
| 1 |
---
|
| 2 |
-
license: mit
|
| 3 |
language:
|
| 4 |
- en
|
|
|
|
| 5 |
metrics:
|
| 6 |
- recall
|
| 7 |
- precision
|
|
@@ -14,4 +14,45 @@ tags:
|
|
| 14 |
- mesh-reconstruction
|
| 15 |
- pose-aware
|
| 16 |
- icme-2026
|
| 17 |
-
---
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
---
|
|
|
|
| 2 |
language:
|
| 3 |
- en
|
| 4 |
+
license: mit
|
| 5 |
metrics:
|
| 6 |
- recall
|
| 7 |
- precision
|
|
|
|
| 14 |
- mesh-reconstruction
|
| 15 |
- pose-aware
|
| 16 |
- icme-2026
|
| 17 |
+
---
|
| 18 |
+
|
| 19 |
+
# GraphiContact: Pose-aware Human-Scene Robust Contact Perception for Interactive Systems
|
| 20 |
+
|
| 21 |
+
This repository contains the pre-trained checkpoints for **GraphiContact**, a novel framework for monocular vertex-level human-scene contact prediction and 3D human mesh reconstruction.
|
| 22 |
+
|
| 23 |
+
[**Paper (arXiv)**](https://huggingface.co/papers/2603.20310) | [**Official GitHub Repository**](https://github.com/Aveiro-Lin/GraphiContact)
|
| 24 |
+
|
| 25 |
+
## Overview
|
| 26 |
+
|
| 27 |
+
GraphiContact jointly addresses vertex-level contact prediction and single-image 3D human mesh reconstruction. It uses reconstructed body geometry as a scaffold for contact reasoning, integrating pose-aware features with human-scene interaction understanding.
|
| 28 |
+
|
| 29 |
+
### Key Features
|
| 30 |
+
|
| 31 |
+
* **Pose-aware Framework**: Transfers complementary human priors from pretrained Transformer encoders to predict per-vertex human-scene contact on the reconstructed mesh.
|
| 32 |
+
* **SIMU Training Strategy**: Introduces a Single-Image Multi-Infer Uncertainty (SIMU) training strategy with token-level adaptive routing. This simulates occlusion and noisy observations during training while preserving efficient single-branch inference at test time.
|
| 33 |
+
* **Robust Perception**: Specifically designed to handle real-world scenarios with perceptual noise and occlusions, making it suitable for interactive systems like embodied AI and rehabilitation analysis.
|
| 34 |
+
|
| 35 |
+
<p align="center">
|
| 36 |
+
<img src="https://github.com/Aveiro-Lin/GraphiContact/raw/main/docs/Overview.png" width="850">
|
| 37 |
+
</p>
|
| 38 |
+
|
| 39 |
+
## Installation and Usage
|
| 40 |
+
|
| 41 |
+
For detailed instructions on environment setup, downloading model weights, and running inference demos, please refer to the [official GitHub repository](https://github.com/Aveiro-Lin/GraphiContact).
|
| 42 |
+
|
| 43 |
+
## Citation
|
| 44 |
+
|
| 45 |
+
If you find this work useful for your research, please consider citing the paper:
|
| 46 |
+
|
| 47 |
+
```bibtex
|
| 48 |
+
@inproceedings{lin2026graphicontact,
|
| 49 |
+
title={GraphiContact: Pose-aware Human-Scene Robust Contact Perception for Interactive Systems},
|
| 50 |
+
author={Lin, Aveiro and others},
|
| 51 |
+
booktitle={IEEE International Conference on Multimedia and Expo (ICME)},
|
| 52 |
+
year={2026}
|
| 53 |
+
}
|
| 54 |
+
```
|
| 55 |
+
|
| 56 |
+
## License
|
| 57 |
+
|
| 58 |
+
The research code is released under the **MIT license**. Note that the model has dependencies on the SMPL and MANO models, which are subject to their own [Software Copyright License](https://smpl.is.tue.mpg.de/modellicense) for non-commercial scientific research purposes.
|