Geometry-Guided Modeling of Foundation Features Enables Generalizable Object Shape Deformation Learning
Not on the map. Why?
Abstract (arXiv)
Monocular 3D shape recovery is fundamental to geometric understanding, yet achieving robust generalization across arbitrary viewpoints and unseen object categories remains a significant challenge. In this paper, we present a generalizable deformation learning framework that reconstructs 3D objects by explicitly deforming a category-level shape template to match the target observation. To address complex shape variations between the template and the target, we introduce a geometry-guided feature modeling mechanism. This process first enriches foundation features with template topology to yield a geometry-aware representation, which is then explicitly correlated with the target observation to guide precise deformation. Furthermore, to bridge the disparity between the fixed template and arbitrary target views, we propose a view-adaptive feature aggregation module. This module leverages multi-view template features and their corresponding camera poses to enrich the canonical template representation, ensuring robust feature alignment regardless of the target's perspective. Extensive experiments demonstrate that our approach significantly outperforms state-of-the-art methods in handling large shape variations and diverse viewpoints, exhibiting strong generalization to novel categories and effectively supporting downstream real-world dexterous robotic manipulation tasks. Project homepage: https://GODeform.github.io/
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 59 of its 73 references that are in the map. First posted on arXiv 28 May 2026.
Builds on
59 of 73 references.
References · 59
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,700
- 2015ShapeNet: An Information-Rich 3D Model Repositorycited by 2,897
- 2018Occupancy Networks: Learning 3D Reconstruction in Function Spacecited by 2,041
- 2025DINOv3cited by 1,414
- 2021Isaac Gym: High Performance GPU-Based Physics Simulation For Robot Learningcited by 998
- 2022Building Normalizing Flows with Stochastic Interpolantscited by 995
- 2025SAM 3: Segment Anything with Conceptscited by 906
- 2023LRM: Large Reconstruction Model for Single Image to 3Dcited by 849
- 2023VoxPoser: Composable 3D Value Maps for Robotic Manipulation with Language Modelscited by 750
- 2023Wonder3D: Single Image to 3D using Cross-Domain Diffusioncited by 689
38 more
- 2018Pixel2Mesh: Generating 3D Mesh Models from Single RGB Imagescited by 651
- 2023Point Transformer V3: Simpler, Faster, Strongercited by 589
- 2023AnyDoor: Zero-shot Object-level Image Customizationcited by 412
- 2021ICON: Implicit Clothed humans Obtained from Normalscited by 283
- 2022ULIP: Learning a Unified Representation of Language, Images, and Point Clouds for 3D Understandingcited by 267
- 2020PaMIR: Parametric Model-Conditioned Implicit Representation for Image-based Human Reconstructioncited by 231
- 2022ECON: Explicit Clothed humans Optimized via Normal integrationcited by 199
- 2023OpenShape: Scaling Up 3D Shape Representation Towards Open-World Understandingcited by 184
- 2025Difix3D+: Improving 3D Reconstructions with Single-Step Diffusion Modelscited by 161
- 20183D-CODED : 3D Correspondences by Deep Deformationcited by 160
- 2022DexGraspNet: A Large-Scale Robotic Dexterous Grasp Dataset for General Objects Based on Simulationcited by 137
- 2022OakInk: A Large-scale Knowledge Repository for Understanding Hand-Object Interactioncited by 131
- 2019Deep Mesh Reconstruction from Single RGB Images via Topology Modification Networkscited by 106
- 2019Neural Cages for Detail-Preserving 3D Deformationscited by 106
- 2019Pixel2Mesh++: Multi-View 3D Mesh Generation via Deformationcited by 103
- 2021Neural Parts: Learning Expressive 3D Shape Abstractions with Invertible Neural Networkscited by 103
- 2021Synthesizing Diverse and Physically Stable Grasps with Arbitrary Hand Structures using Differentiable Force Closure Estimatorcited by 71
- 20193DN: 3D Deformation Networkcited by 60
- 2023FreeZe: Training-free zero-shot 6D pose estimation with geometric and vision foundation modelscited by 57
- 2023ContactGen: Generative Contact Modeling for Grasp Generationcited by 53
- 2021KeypointDeformer: Unsupervised 3D Keypoint Discovery for Shape Controlcited by 51
- 2024Talking to DINO: Bridging Self-Supervised Vision Backbones with Language for Open-Vocabulary Segmentationcited by 44
- 2021Joint Learning of 3D Shape Retrieval and Deformationcited by 42
- 2025SPAR3D: Stable Point-Aware Reconstruction of 3D Objects from Single Imagescited by 42
- 2024Grasp as You Say: Language-guided Dexterous Grasp Generationcited by 40
- 2023Text-Driven Image Editing via Learnable Regionscited by 31
- 2025Rethinking End-to-End 2D to 3D Scene Segmentation in Gaussian Splattingcited by 31
- 2025DINO in the Room: Leveraging 2D Foundation Models for 3D Segmentationcited by 31
- 2023UGG: Unified Generative Graspingcited by 30
- 2017DeformNet: Free-Form Deformation Network for 3D Shape Reconstruction from a Single Imagecited by 25
- 2019Few-Shot Generalization for Single-Image 3D Reconstruction via Priorscited by 25
- 2018Learning Free-Form Deformations for 3D Object Reconstructioncited by 20
- 2024Phidias: A Generative Model for Creating 3D Content from Text, Image, and 3D Conditions with Reference-Augmented Diffusioncited by 19
- 2024PCF-Lift: Panoptic Lifting by Probabilistic Contrastive Fusioncited by 16
- 2023Slice3D: Multi-Slice, Occlusion-Revealing, Single View 3D Reconstructioncited by 13
- 2023U-RED: Unsupervised 3D Shape Retrieval and Deformation for Partial Point Cloudscited by 12
- 2023DeFormer: Integrating Transformers with Deformable Models for 3D Shape Abstraction from a Single Imagecited by 12
- 2025Foundational Models for 3D Point Clouds: A Survey and Outlookcited by 12
50 most cited of 59 All 59 (JSON)
Built on by
Not cited yet.