Category-Specific Object Reconstruction from a Single Image
Not on the map. Why?
Abstract (arXiv)
Object reconstruction from a single image -- in the wild -- is a problem where we can make progress and get meaningful results today. This is the main message of this paper, which introduces an automated pipeline with pixels as inputs and 3D surfaces of various rigid categories as outputs in images of realistic scenes. At the core of our approach are deformable 3D models that can be learned from 2D annotations available in existing object detection datasets, that can be driven by noisy automatic object segmentations and which we complement with a bottom-up module for recovering high-frequency shape details. We perform a comprehensive quantitative analysis and ablation study of our approach using the recently introduced PASCAL 3D+ dataset and show very encouraging automatic reconstructions on PASCAL VOC.
Key facts. Cited by 56 papers in the map (data through 7 Oct 2026). First posted on arXiv 22 Nov 2014.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 18; 2022: 12; 2023: 15; 2024: 5; 2025: 5; 2026: 1.
56 papers.
Sort:
By area:
- 2023Magic123: One Image to High-Quality 3D Object Generation Using Both 2D and 3D Diffusion Priorscited by 395
- 2021ABO: Dataset and Benchmarks for Real-World 3D Object Understandingcited by 360
- 2025SAM 3D: 3Dfy Anything in Imagescited by 230
- 2022Monocular Dynamic View Synthesis: A Reality Checkcited by 199
- 2021NeRS: Neural Reflectance Surfaces for Sparse-view 3D Reconstruction in the Wildcited by 136
- 2022MagicPony: Learning Articulated 3D Animals in the Wildcited by 111
- 2022CHORE: Contact, Human and Object REconstruction from a single RGB imagecited by 95
- 2022What's in your hands? 3D Reconstruction of Generic Objects in Handscited by 90
- 2021FiG-NeRF: Figure-Ground Neural Radiance Fields for 3D Object Category Modellingcited by 47
- 2023Amodal Ground Truth and Completion in the Wildcited by 43
- 2023Farm3D: Learning Articulated 3D Animals by Distilling 2D Diffusioncited by 37
- 2022Text and Image Guided 3D Avatar Generation and Manipulationcited by 35
38 more
- 2021Birds of a Feather: Capturing Avian Shape Models from Imagescited by 30
- 2022Topologically-Aware Deformation Fields for Single-View 3D Reconstructioncited by 29
- 2021Differentiable Stereopsis: Meshes from multiple views using differentiable renderingcited by 26
- 2022SurfGen: Adversarial 3D Shape Synthesis with Explicit Surface Discriminatorscited by 26
- 2022Share With Thy Neighbors: Single-View Reconstruction by Cross-Instance Consistencycited by 26
- 2024Animal Avatars: Reconstructing Animatable 3D Animals from Casual Videoscited by 26
- 2024Real3D: Scaling Up Large Reconstruction Models with Real-World Imagescited by 24
- 2021To The Point: Correspondence-driven monocular 3D category reconstructioncited by 21
- 2021Mending Neural Implicit Modeling for 3D Vehicle Reconstruction in the Wildcited by 19
- 2022FvOR: Robust Joint Shape and Pose Optimization for Few-view Object Reconstructioncited by 19
- 2024Bayesian Diffusion Models for 3D Shape Reconstructioncited by 19
- 2021Learning monocular 3D reconstruction of articulated categories from motioncited by 18
- 2021Fully Understanding Generic Objects: Modeling, Segmentation, and Reconstructioncited by 16
- 2023DDF-HO: Hand-Held Object Reconstruction via Conditional Directed Distance Fieldcited by 16
- 2023SAOR: Single-View Articulated Object Reconstructioncited by 15
- 2021StrobeNet: Category-Level Multiview Reconstruction of Articulated Objectscited by 14
- 2025Feature4X: Bridging Any Monocular Video to 4D Agentic AI with Versatile Gaussian Feature Fieldscited by 13
- 20233D Reconstruction of Objects in Hands without Real World 3D Supervisioncited by 12
- 2023CCD-3DR: Consistent Conditioning in Diffusion for Single-Image 3D Reconstructioncited by 10
- 2025Common3D: Self-Supervised Learning of 3D Morphable Models for Common Objects in Neural Feature Spacecited by 9
- 2022Monocular 3D Object Reconstruction with GAN Inversioncited by 8
- 2021Multi-Category Mesh Reconstruction From Image Collectionscited by 5
- 2024The More You See in 2D, the More You Perceive in 3Dcited by 5
- 2022HM3D-ABO: A Photo-realistic Dataset for Object-centric Multi-view 3D Reconstructioncited by 4
- 2021Single Image 3D Object Estimation with Primitive Graph Networkscited by 3
- 2023A Review of Deep Learning-Powered Mesh Reconstruction Methodscited by 3
- 2024Floating No More: Object-Ground Reconstruction from a Single Imagecited by 3
- 2021Probabilistic Vehicle Reconstruction Using a Multi-Task CNNcited by 2
- 2021Visual Enhanced 3D Point Cloud Reconstruction from A Single Imagecited by 2
- 20233D Surface Reconstruction in the Wild by Deforming Shape Priors from Synthetic Datacited by 2
- 2023D-SCo: Dual-Stream Conditional Diffusion for Monocular Hand-Held Object Reconstructioncited by 2
- 2021Pose Estimation and 3D Reconstruction of Vehicles from Stereo-Images Using a Subcategory-Aware Shape Priorcited by 1
- 2021HyperColor: A HyperNetwork Approach for Synthesizing Auto-colored 3D Models for Game Scenes Populationcited by 1
- 2023Self-supervised learning of object pose estimation using keypoint predictioncited by 1
- 2023SKoPe3D: A Synthetic Dataset for Vehicle Keypoint Perception in 3D from Traffic Monitoring Camerascited by 1
- 2023GOEmbed: Gradient Origin Embeddings for Representation Agnostic 3D Feature Learningcited by 1
- 2021Using Adaptive Gradient for Texture Learning in Single-View 3D Reconstructioncited by 0
- 2021Weak Multi-View Supervision for Surface Mapping Estimationcited by 0
50 most cited of 56 All 56 (JSON)
- 2026SEMAGIC: Learning Semantically Consistent Deformable 3D Representations from In-the-Wild Images27 May 2026
- 2025Radar2Shape: 3D Shape Reconstruction from High-Frequency Radar using Multiresolution Signed Distance Functions21 Nov 2025
- 2025SAM 3D: 3Dfy Anything in Images20 Nov 2025
- 2025Common3D: Self-Supervised Learning of 3D Morphable Models for Common Objects in Neural Feature Space30 Apr 2025
- 2025Feature4X: Bridging Any Monocular Video to 4D Agentic AI with Versatile Gaussian Feature Fields26 Mar 2025
- 2025Glissando-Net: Deep sinGLe vIew category level poSe eStimation ANd 3D recOnstruction24 Jan 2025
- 2024Floating No More: Object-Ground Reconstruction from a Single Image26 Jul 2024
- 2024Real3D: Scaling Up Large Reconstruction Models with Real-World Images12 Jun 2024
- 2024The More You See in 2D, the More You Perceive in 3D4 Apr 2024
- 2024Animal Avatars: Reconstructing Animatable 3D Animals from Casual Videos25 Mar 2024
- 2024Bayesian Diffusion Models for 3D Shape Reconstruction11 Mar 2024
- 2023Amodal Ground Truth and Completion in the Wild28 Dec 2023
38 more
- 2023GOEmbed: Gradient Origin Embeddings for Representation Agnostic 3D Feature Learning14 Dec 2023
- 2023D-SCo: Dual-Stream Conditional Diffusion for Monocular Hand-Held Object Reconstruction23 Nov 2023
- 20233DMiner: Discovering Shapes from Large-Scale Unannotated Image Datasets29 Oct 2023
- 2023SKoPe3D: A Synthetic Dataset for Vehicle Keypoint Perception in 3D from Traffic Monitoring Cameras4 Sep 2023
- 2023DDF-HO: Hand-Held Object Reconstruction via Conditional Directed Distance Field16 Aug 2023
- 2023CCD-3DR: Consistent Conditioning in Diffusion for Single-Image 3D Reconstruction15 Aug 2023
- 2023Magic123: One Image to High-Quality 3D Object Generation Using Both 2D and 3D Diffusion Priors30 Jun 2023
- 20233D Reconstruction of Objects in Hands without Real World 3D Supervision4 May 2023
- 2023OriCon3D: Effective 3D Object Detection using Orientation and Confidence27 Apr 2023
- 2023Farm3D: Learning Articulated 3D Animals by Distilling 2D Diffusion20 Apr 2023
- 2023SAOR: Single-View Articulated Object Reconstruction23 Mar 2023
- 2023A Review of Deep Learning-Powered Mesh Reconstruction Methods6 Mar 2023
- 20233D Surface Reconstruction in the Wild by Deforming Shape Priors from Synthetic Data24 Feb 2023
- 2023Self-supervised learning of object pose estimation using keypoint prediction14 Feb 2023
- 20223D-LatentMapper: View Agnostic Single-View Reconstruction of 3D Shapes5 Dec 2022
- 2022MagicPony: Learning Articulated 3D Animals in the Wild22 Nov 2022
- 2022Monocular Dynamic View Synthesis: A Reality Check24 Oct 2022
- 2022Monocular 3D Object Reconstruction with GAN Inversion20 Jul 2022
- 2022HM3D-ABO: A Photo-realistic Dataset for Object-centric Multi-view 3D Reconstruction24 Jun 2022
- 2022FvOR: Robust Joint Shape and Pose Optimization for Few-view Object Reconstruction16 May 2022
- 2022Topologically-Aware Deformation Fields for Single-View 3D Reconstruction12 May 2022
- 2022Share With Thy Neighbors: Single-View Reconstruction by Cross-Instance Consistency21 Apr 2022
- 2022What's in your hands? 3D Reconstruction of Generic Objects in Hands14 Apr 2022
- 2022CHORE: Contact, Human and Object REconstruction from a single RGB image5 Apr 2022
- 2022Text and Image Guided 3D Avatar Generation and Manipulation12 Feb 2022
- 2022SurfGen: Adversarial 3D Shape Synthesis with Explicit Surface Discriminators1 Jan 2022
- 2021Multi-Category Mesh Reconstruction From Image Collections21 Oct 2021
- 2021NeRS: Neural Reflectance Surfaces for Sparse-view 3D Reconstruction in the Wild14 Oct 2021
- 2021ABO: Dataset and Benchmarks for Real-World 3D Object Understanding12 Oct 2021
- 2021Differentiable Stereopsis: Meshes from multiple views using differentiable rendering11 Oct 2021
- 2021Single Image 3D Object Estimation with Primitive Graph Networks9 Sep 2021
- 2021Visual Enhanced 3D Point Cloud Reconstruction from A Single Image17 Aug 2021
- 2021HyperColor: A HyperNetwork Approach for Synthesizing Auto-colored 3D Models for Game Scenes Population3 Aug 2021
- 2021Pose Estimation and 3D Reconstruction of Vehicles from Stereo-Images Using a Subcategory-Aware Shape Prior22 Jul 2021
- 2021To The Point: Correspondence-driven monocular 3D category reconstruction10 Jun 2021
- 2021Birds of a Feather: Capturing Avian Shape Models from Images19 May 2021
- 2021StrobeNet: Category-Level Multiview Reconstruction of Articulated Objects17 May 2021
- 2021Weak Multi-View Supervision for Surface Mapping Estimation4 May 2021
50 newest of 56 All 56 (JSON)
- 2023Magic123: One Image to High-Quality 3D Object Generation Using Both 2D and 3D Diffusion Priorscited by 395
- 2023Farm3D: Learning Articulated 3D Animals by Distilling 2D Diffusioncited by 37
- 2024Bayesian Diffusion Models for 3D Shape Reconstructioncited by 19
- 2023CCD-3DR: Consistent Conditioning in Diffusion for Single-Image 3D Reconstructioncited by 10
- 2024The More You See in 2D, the More You Perceive in 3Dcited by 5
- 2024The More You See in 2D, the More You Perceive in 3D4 Apr 2024
- 2024Bayesian Diffusion Models for 3D Shape Reconstruction11 Mar 2024
- 2023CCD-3DR: Consistent Conditioning in Diffusion for Single-Image 3D Reconstruction15 Aug 2023
- 2023Magic123: One Image to High-Quality 3D Object Generation Using Both 2D and 3D Diffusion Priors30 Jun 2023
- 2023Farm3D: Learning Articulated 3D Animals by Distilling 2D Diffusion20 Apr 2023
- 2021ABO: Dataset and Benchmarks for Real-World 3D Object Understandingcited by 360
- 2025SAM 3D: 3Dfy Anything in Imagescited by 230
- 2022Monocular Dynamic View Synthesis: A Reality Checkcited by 199
- 2021NeRS: Neural Reflectance Surfaces for Sparse-view 3D Reconstruction in the Wildcited by 136
- 2022MagicPony: Learning Articulated 3D Animals in the Wildcited by 111
- 2022CHORE: Contact, Human and Object REconstruction from a single RGB imagecited by 95
- 2022What's in your hands? 3D Reconstruction of Generic Objects in Handscited by 90
- 2021FiG-NeRF: Figure-Ground Neural Radiance Fields for 3D Object Category Modellingcited by 47
- 2023Amodal Ground Truth and Completion in the Wildcited by 43
- 2022Text and Image Guided 3D Avatar Generation and Manipulationcited by 35
- 2021Birds of a Feather: Capturing Avian Shape Models from Imagescited by 30
- 2022Topologically-Aware Deformation Fields for Single-View 3D Reconstructioncited by 29
12 most cited of 51 All 51 (JSON)
- 2026SEMAGIC: Learning Semantically Consistent Deformable 3D Representations from In-the-Wild Images27 May 2026
- 2025Radar2Shape: 3D Shape Reconstruction from High-Frequency Radar using Multiresolution Signed Distance Functions21 Nov 2025
- 2025SAM 3D: 3Dfy Anything in Images20 Nov 2025
- 2025Common3D: Self-Supervised Learning of 3D Morphable Models for Common Objects in Neural Feature Space30 Apr 2025
- 2025Feature4X: Bridging Any Monocular Video to 4D Agentic AI with Versatile Gaussian Feature Fields26 Mar 2025
- 2025Glissando-Net: Deep sinGLe vIew category level poSe eStimation ANd 3D recOnstruction24 Jan 2025
- 2024Floating No More: Object-Ground Reconstruction from a Single Image26 Jul 2024
- 2024Real3D: Scaling Up Large Reconstruction Models with Real-World Images12 Jun 2024
- 2024Animal Avatars: Reconstructing Animatable 3D Animals from Casual Videos25 Mar 2024
- 2023Amodal Ground Truth and Completion in the Wild28 Dec 2023
- 2023GOEmbed: Gradient Origin Embeddings for Representation Agnostic 3D Feature Learning14 Dec 2023
- 2023D-SCo: Dual-Stream Conditional Diffusion for Monocular Hand-Held Object Reconstruction23 Nov 2023
12 newest of 51 All 51 (JSON)