nielsr HF Staff commited on
Commit
8c6ac42
·
verified ·
1 Parent(s): 1280a43

Improve model card

Browse files

Hi! I'm Niels from the Hugging Face community science team. I noticed this repository didn't have a full model card yet, so I've opened this PR to add a description of the project, including its key features and links to the paper and the official GitHub repository. Providing this information helps researchers and developers understand the model's capabilities and use cases more easily.

Files changed (1) hide show
  1. README.md +43 -2
README.md CHANGED
@@ -1,7 +1,7 @@
1
  ---
2
- license: mit
3
  language:
4
  - en
 
5
  metrics:
6
  - recall
7
  - precision
@@ -14,4 +14,45 @@ tags:
14
  - mesh-reconstruction
15
  - pose-aware
16
  - icme-2026
17
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
 
2
  language:
3
  - en
4
+ license: mit
5
  metrics:
6
  - recall
7
  - precision
 
14
  - mesh-reconstruction
15
  - pose-aware
16
  - icme-2026
17
+ ---
18
+
19
+ # GraphiContact: Pose-aware Human-Scene Robust Contact Perception for Interactive Systems
20
+
21
+ This repository contains the pre-trained checkpoints for **GraphiContact**, a novel framework for monocular vertex-level human-scene contact prediction and 3D human mesh reconstruction.
22
+
23
+ [**Paper (arXiv)**](https://huggingface.co/papers/2603.20310) | [**Official GitHub Repository**](https://github.com/Aveiro-Lin/GraphiContact)
24
+
25
+ ## Overview
26
+
27
+ GraphiContact jointly addresses vertex-level contact prediction and single-image 3D human mesh reconstruction. It uses reconstructed body geometry as a scaffold for contact reasoning, integrating pose-aware features with human-scene interaction understanding.
28
+
29
+ ### Key Features
30
+
31
+ * **Pose-aware Framework**: Transfers complementary human priors from pretrained Transformer encoders to predict per-vertex human-scene contact on the reconstructed mesh.
32
+ * **SIMU Training Strategy**: Introduces a Single-Image Multi-Infer Uncertainty (SIMU) training strategy with token-level adaptive routing. This simulates occlusion and noisy observations during training while preserving efficient single-branch inference at test time.
33
+ * **Robust Perception**: Specifically designed to handle real-world scenarios with perceptual noise and occlusions, making it suitable for interactive systems like embodied AI and rehabilitation analysis.
34
+
35
+ <p align="center">
36
+ <img src="https://github.com/Aveiro-Lin/GraphiContact/raw/main/docs/Overview.png" width="850">
37
+ </p>
38
+
39
+ ## Installation and Usage
40
+
41
+ For detailed instructions on environment setup, downloading model weights, and running inference demos, please refer to the [official GitHub repository](https://github.com/Aveiro-Lin/GraphiContact).
42
+
43
+ ## Citation
44
+
45
+ If you find this work useful for your research, please consider citing the paper:
46
+
47
+ ```bibtex
48
+ @inproceedings{lin2026graphicontact,
49
+ title={GraphiContact: Pose-aware Human-Scene Robust Contact Perception for Interactive Systems},
50
+ author={Lin, Aveiro and others},
51
+ booktitle={IEEE International Conference on Multimedia and Expo (ICME)},
52
+ year={2026}
53
+ }
54
+ ```
55
+
56
+ ## License
57
+
58
+ The research code is released under the **MIT license**. Note that the model has dependencies on the SMPL and MANO models, which are subject to their own [Software Copyright License](https://smpl.is.tue.mpg.de/modellicense) for non-commercial scientific research purposes.