Papers
arxiv:2604.14048

Free Geometry: Refining 3D Reconstruction from Longer Versions of Itself

Published on Apr 15
· Submitted by
Xingyi Yang
on Apr 16
Authors:
,

Abstract

Free Geometry enables feed-forward 3D reconstruction models to self-evolve at test time through self-supervised cross-view feature consistency, improving reconstruction accuracy with lightweight LoRA updates.

AI-generated summary

Feed-forward 3D reconstruction models are efficient but rigid: once trained, they perform inference in a zero-shot manner and cannot adapt to the test scene. As a result, visually plausible reconstructions often contain errors, particularly under occlusions, specularities, and ambiguous cues. To address this, we introduce Free Geometry, a framework that enables feed-forward 3D reconstruction models to self-evolve at test time without any 3D ground truth. Our key insight is that, when the model receives more views, it produces more reliable and view-consistent reconstructions. Leveraging this property, given a testing sequence, we mask a subset of frames to construct a self-supervised task. Free Geometry enforces cross-view feature consistency between representations from full and partial observations, while maintaining the pairwise relations implied by the held-out frames. This self-supervision allows for fast recalibration via lightweight LoRA updates, taking less than 2 minutes per dataset on a single GPU. Our approach consistently improves state-of-the-art foundation models, including Depth Anything 3 and VGGT, across 4 benchmark datasets, yielding an average improvement of 3.73% in camera pose accuracy and 2.88% in point map prediction. Code is available at https://github.com/hiteacherIamhumble/Free-Geometry .

Community

Paper submitter

🚀 Introducing Free Geometry! 🚀

Unlock the next level of 3D reconstruction. Free Geometry empowers feed-forward models to self-evolve at test time—with absolutely NO 3D ground truth required! 🤯✨

Experience unparalleled generalization across diverse models and datasets.

Dive into the details and try it out yourself:
📄 ArXiv: https://arxiv.org/abs/2604.14048
💻 GitHub: https://github.com/hiteacherIamhumble/Free-Geometry

Sign up or log in to comment

Get this paper in your agent:

hf papers read 2604.14048
Don't have the latest CLI?
curl -LsSf https://hf.co/cli/install.sh | bash

Models citing this paper 0

No model linking this paper

Cite arxiv.org/abs/2604.14048 in a model README.md to link it from this page.

Datasets citing this paper 0

No dataset linking this paper

Cite arxiv.org/abs/2604.14048 in a dataset README.md to link it from this page.

Spaces citing this paper 0

No Space linking this paper

Cite arxiv.org/abs/2604.14048 in a Space README.md to link it from this page.

Collections including this paper 0

No Collection including this paper

Add this paper to a collection to link it from this page.