Learning to Reconstruct Shapes from Unseen Classes
Not on the map. Why?
Abstract (arXiv)
From a single image, humans are able to perceive the full 3D shape of an object by exploiting learned shape priors from everyday life. Contemporary single-image 3D reconstruction algorithms aim to solve this task in a similar fashion, but often end up with priors that are highly biased by training classes. Here we present an algorithm, Generalizable Reconstruction (GenRe), designed to capture more generic, class-agnostic shape priors. We achieve this with an inference network and training procedure that combine 2.5D representations of visible surfaces (depth and silhouette), spherical shape representations of both visible and non-visible surfaces, and 3D voxel-based representations, in a principled manner that exploits the causal structure of how 3D shapes give rise to 2D images. Experiments demonstrate that GenRe performs well on single-view shape reconstruction, and generalizes to diverse novel objects from categories not seen during training.
Key facts. Cited by 60 papers in the map (data through 7 Oct 2026). First posted on arXiv 28 Dec 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 14; 2022: 16; 2023: 12; 2024: 12; 2025: 6.
60 papers.
Sort:
By area:
- 20213D Shape Generation and Completion through Point-Voxel Diffusioncited by 516
- 2021Zero-Shot Text-Guided Object Generation with Dream Fieldscited by 513
- 2021ABO: Dataset and Benchmarks for Real-World 3D Object Understandingcited by 360
- 2024TripoSR: Fast 3D Object Reconstruction from a Single Imagecited by 227
- 2022CHORE: Contact, Human and Object REconstruction from a single RGB imagecited by 95
- 2022Fast Point Cloud Generation with Straight Flowscited by 56
- 2024Human-3Diffusion: Realistic Avatar Creation via Explicit 3D Consistent Diffusion Modelscited by 44
- 2022Autoregressive 3D Shape Generation via Canonical Mappingcited by 37
- 2023Template Free Reconstruction of Human-object Interaction with Procedural Interaction Generationcited by 37
- 2022ConDor: Self-Supervised Canonicalization of 3D Pose for Partial Shapescited by 31
- 2022GenSDF: Two-Stage Learning of Generalizable Signed Distance Functionscited by 30
- 2023ZeroShape: Regression-based Zero-shot Shape Reconstructioncited by 30
38 more
- 2023HarmonyView: Harmonizing Consistency and Diversity in One-Image-to-3Dcited by 27
- 2022SurfGen: Adversarial 3D Shape Synthesis with Explicit Surface Discriminatorscited by 26
- 2022PatchComplete: Learning Multi-Resolution Patch Priors for 3D Shape Completion on Unseen Categoriescited by 21
- 2025Not-So-Optimal Transport Flows for 3D Point Cloud Generationcited by 17
- 2021Fully Understanding Generic Objects: Modeling, Segmentation, and Reconstructioncited by 16
- 2022Your Out-of-Distribution Detection Method is Not Robust!cited by 16
- 2024Gen-3Diffusion: Realistic Image-to-3D Generation via 2D & 3D Diffusion Synergycited by 16
- 2021StrobeNet: Category-Level Multiview Reconstruction of Articulated Objectscited by 14
- 2022Semi-Supervised Single-View 3D Reconstruction via Prototype Shape Priorscited by 14
- 2023Iterative Superquadric Recomposition of 3D Objects from Multiple Viewscited by 13
- 2021DeepCurrents: Learning Implicit Representations of Shapes with Boundariescited by 12
- 2021A Geometry-Informed Deep Learning Framework for Ultra-Sparse 3D Tomographic Image Reconstructioncited by 11
- 2022Neural Vector Fields for Implicit Surface Representation and Inferencecited by 10
- 2022Single-view 3D Mesh Reconstruction for Seen and Unseen Categoriescited by 10
- 2023CCD-3DR: Consistent Conditioning in Diffusion for Single-Image 3D Reconstructioncited by 10
- 2023MVDD: Multi-View Depth Diffusion Modelscited by 10
- 2024RHOBIN Challenge: Reconstruction of Human Object Interactioncited by 10
- 2021Fostering Generalization in Single-view 3D Reconstruction by Learning a Hierarchy of Local and Global Shape Priorscited by 9
- 2022Planes vs. Chairs: Category-guided 3D shape learning without any 3D cuescited by 9
- 2023SENS: Part-Aware Sketch-based Implicit Neural Shape Modelingcited by 8
- 2023NAISR: A 3D Neural Additive Model for Interpretable Shape Representationcited by 7
- 2024Robust 3D Shape Reconstruction in Zero-Shot from a Single Image in the Wildcited by 7
- 2022Neural Shape Compiler: A Unified Framework for Transforming between Text, Point Cloud, and Programcited by 6
- 2024The More You See in 2D, the More You Perceive in 3Dcited by 5
- 2025SPGen: Spherical Projection as Consistent and Flexible Representation for Single Image 3D Shape Generationcited by 5
- 2021SIMstack: A Generative Shape and Instance Model for Unordered Object Stackscited by 4
- 2021Monocular Depth Estimation for Soft Visuotactile Sensorscited by 3
- 2021Towards Panoptic 3D Parsing for Single Image in the Wildcited by 3
- 2023A Review of Deep Learning-Powered Mesh Reconstruction Methodscited by 3
- 2024Learning Local Pattern Modularization for Point Cloud Reconstruction from Unseen Classescited by 3
- 2021The Surprising Positive Knowledge Transfer in Continual 3D Object Shape Reconstructioncited by 2
- 2022Improved α-GAN architecture for generating 3D connected volumes with an application to radiosurgery treatment planningcited by 2
- 2024Point Cloud Synthesis Using Inner Product Transformscited by 2
- 2021DDR-Net: Learning Multi-Stage Multi-View Stereo With Dynamic Depth Rangecited by 1
- 2022SingleSketch2Mesh : Generating 3D Mesh model from Sketchcited by 1
- 2023Single-view 3D reconstruction via inverse procedural modelingcited by 1
- 2024MeTTA: Single-View to 3D Textured Mesh Reconstruction with Test-Time Adaptationcited by 1
- 2025PCF-Grasp: Converting Point Completion to Geometry Feature to Enhance 6-DoF Graspcited by 1
50 most cited of 60 All 60 (JSON)
- 2025OT-MeanFlow3D: Bridging Optimal Transport and Meanflow for Efficient 3D Point Cloud Generation26 Sep 2025
- 2025SPGen: Spherical Projection as Consistent and Flexible Representation for Single Image 3D Shape Generation16 Sep 2025
- 2025PCF-Grasp: Converting Point Completion to Geometry Feature to Enhance 6-DoF Grasp22 Apr 2025
- 2025Not-So-Optimal Transport Flows for 3D Point Cloud Generation18 Feb 2025
- 2025LucidAtlas: Learning Uncertainty-Aware, Covariate-Disentangled, Individualized Atlas Representations12 Feb 2025
- 2025Glissando-Net: Deep sinGLe vIew category level poSe eStimation ANd 3D recOnstruction24 Jan 2025
- 2024Gen-3Diffusion: Realistic Image-to-3D Generation via 2D & 3D Diffusion Synergy9 Dec 2024
- 2024Revisiting Marr in Face: The Building of 2D--2.5D--3D Representations in Deep Neural Networks25 Nov 2024
- 2024Point Cloud Synthesis Using Inner Product Transforms9 Oct 2024
- 2024Learning Local Pattern Modularization for Point Cloud Reconstruction from Unseen Classes26 Aug 2024
- 2024MeTTA: Single-View to 3D Textured Mesh Reconstruction with Test-Time Adaptation21 Aug 2024
- 2024Deformable 3D Shape Diffusion Model31 Jul 2024
38 more
- 2024Human-3Diffusion: Realistic Avatar Creation via Explicit 3D Consistent Diffusion Models12 Jun 2024
- 2024The More You See in 2D, the More You Perceive in 3D4 Apr 2024
- 2024Robust 3D Shape Reconstruction in Zero-Shot from a Single Image in the Wild21 Mar 2024
- 2024TripoSR: Fast 3D Object Reconstruction from a Single Image4 Mar 2024
- 2024Geometry aware 3D generation from in-the-wild images in ImageNet31 Jan 2024
- 2024RHOBIN Challenge: Reconstruction of Human Object Interaction7 Jan 2024
- 2023HarmonyView: Harmonizing Consistency and Diversity in One-Image-to-3D26 Dec 2023
- 2023ZeroShape: Regression-based Zero-shot Shape Reconstruction21 Dec 2023
- 2023Template Free Reconstruction of Human-object Interaction with Procedural Interaction Generation12 Dec 2023
- 2023MVDD: Multi-View Depth Diffusion Models8 Dec 2023
- 2023Single-view 3D reconstruction via inverse procedural modeling20 Oct 2023
- 2023Sketch2CAD: 3D CAD Model Reconstruction from 2D Sketch using Visual Transformer28 Sep 2023
- 2023Iterative Superquadric Recomposition of 3D Objects from Multiple Views5 Sep 2023
- 2023A Fusion of Variational Distribution Priors and Saliency Map Replay for Continual 3D Reconstruction17 Aug 2023
- 2023CCD-3DR: Consistent Conditioning in Diffusion for Single-Image 3D Reconstruction15 Aug 2023
- 2023SENS: Part-Aware Sketch-based Implicit Neural Shape Modeling9 Jun 2023
- 2023NAISR: A 3D Neural Additive Model for Interpretable Shape Representation16 Mar 2023
- 2023A Review of Deep Learning-Powered Mesh Reconstruction Methods6 Mar 2023
- 2022Neural Shape Compiler: A Unified Framework for Transforming between Text, Point Cloud, and Program25 Dec 2022
- 2022Fast Point Cloud Generation with Straight Flows4 Dec 2022
- 2022Semi-Supervised Single-View 3D Reconstruction via Prototype Shape Priors30 Sep 2022
- 2022Your Out-of-Distribution Detection Method is Not Robust!30 Sep 2022
- 2022Single-view 3D Mesh Reconstruction for Seen and Unseen Categories4 Aug 2022
- 2022Improved α-GAN architecture for generating 3D connected volumes with an application to radiosurgery treatment planning13 Jul 2022
- 2022Recovering Detail in 3D Shapes Using Disparity Maps1 Jul 2022
- 2022PatchComplete: Learning Multi-Resolution Patch Priors for 3D Shape Completion on Unseen Categories10 Jun 2022
- 2022GenSDF: Two-Stage Learning of Generalizable Signed Distance Functions6 Jun 2022
- 2022Planes vs. Chairs: Category-guided 3D shape learning without any 3D cues21 Apr 2022
- 2022Neural Vector Fields for Implicit Surface Representation and Inference13 Apr 2022
- 2022CHORE: Contact, Human and Object REconstruction from a single RGB image5 Apr 2022
- 2022Autoregressive 3D Shape Generation via Canonical Mapping5 Apr 2022
- 2022SingleSketch2Mesh : Generating 3D Mesh model from Sketch7 Mar 2022
- 2022ConDor: Self-Supervised Canonicalization of 3D Pose for Partial Shapes19 Jan 2022
- 2022SurfGen: Adversarial 3D Shape Synthesis with Explicit Surface Discriminators1 Jan 2022
- 2021Zero-Shot Text-Guided Object Generation with Dream Fields2 Dec 2021
- 2021DeepCurrents: Learning Implicit Representations of Shapes with Boundaries17 Nov 2021
- 2021Towards Panoptic 3D Parsing for Single Image in the Wild4 Nov 2021
- 2021ABO: Dataset and Benchmarks for Real-World 3D Object Understanding12 Oct 2021
50 newest of 60 All 60 (JSON)
- 2022Fast Point Cloud Generation with Straight Flowscited by 56
- 2024Human-3Diffusion: Realistic Avatar Creation via Explicit 3D Consistent Diffusion Modelscited by 44
- 2023Template Free Reconstruction of Human-object Interaction with Procedural Interaction Generationcited by 37
- 2023HarmonyView: Harmonizing Consistency and Diversity in One-Image-to-3Dcited by 27
- 2024Gen-3Diffusion: Realistic Image-to-3D Generation via 2D & 3D Diffusion Synergycited by 16
- 2023CCD-3DR: Consistent Conditioning in Diffusion for Single-Image 3D Reconstructioncited by 10
- 2023MVDD: Multi-View Depth Diffusion Modelscited by 10
- 2024The More You See in 2D, the More You Perceive in 3Dcited by 5
- 2025SPGen: Spherical Projection as Consistent and Flexible Representation for Single Image 3D Shape Generationcited by 5
- 2024Deformable 3D Shape Diffusion Modelcited by 0
- 2025OT-MeanFlow3D: Bridging Optimal Transport and Meanflow for Efficient 3D Point Cloud Generationcited by 0
- 2025OT-MeanFlow3D: Bridging Optimal Transport and Meanflow for Efficient 3D Point Cloud Generation26 Sep 2025
- 2025SPGen: Spherical Projection as Consistent and Flexible Representation for Single Image 3D Shape Generation16 Sep 2025
- 2024Gen-3Diffusion: Realistic Image-to-3D Generation via 2D & 3D Diffusion Synergy9 Dec 2024
- 2024Deformable 3D Shape Diffusion Model31 Jul 2024
- 2024Human-3Diffusion: Realistic Avatar Creation via Explicit 3D Consistent Diffusion Models12 Jun 2024
- 2024The More You See in 2D, the More You Perceive in 3D4 Apr 2024
- 2023HarmonyView: Harmonizing Consistency and Diversity in One-Image-to-3D26 Dec 2023
- 2023Template Free Reconstruction of Human-object Interaction with Procedural Interaction Generation12 Dec 2023
- 2023MVDD: Multi-View Depth Diffusion Models8 Dec 2023
- 2023CCD-3DR: Consistent Conditioning in Diffusion for Single-Image 3D Reconstruction15 Aug 2023
- 2022Fast Point Cloud Generation with Straight Flows4 Dec 2022
- 20213D Shape Generation and Completion through Point-Voxel Diffusioncited by 516
- 2021Zero-Shot Text-Guided Object Generation with Dream Fieldscited by 513
- 2021ABO: Dataset and Benchmarks for Real-World 3D Object Understandingcited by 360
- 2024TripoSR: Fast 3D Object Reconstruction from a Single Imagecited by 227
- 2022CHORE: Contact, Human and Object REconstruction from a single RGB imagecited by 95
- 2022Autoregressive 3D Shape Generation via Canonical Mappingcited by 37
- 2022ConDor: Self-Supervised Canonicalization of 3D Pose for Partial Shapescited by 31
- 2022GenSDF: Two-Stage Learning of Generalizable Signed Distance Functionscited by 30
- 2023ZeroShape: Regression-based Zero-shot Shape Reconstructioncited by 30
- 2022SurfGen: Adversarial 3D Shape Synthesis with Explicit Surface Discriminatorscited by 26
- 2022PatchComplete: Learning Multi-Resolution Patch Priors for 3D Shape Completion on Unseen Categoriescited by 21
- 2025Not-So-Optimal Transport Flows for 3D Point Cloud Generationcited by 17
12 most cited of 49 All 49 (JSON)
- 2025PCF-Grasp: Converting Point Completion to Geometry Feature to Enhance 6-DoF Grasp22 Apr 2025
- 2025Not-So-Optimal Transport Flows for 3D Point Cloud Generation18 Feb 2025
- 2025LucidAtlas: Learning Uncertainty-Aware, Covariate-Disentangled, Individualized Atlas Representations12 Feb 2025
- 2025Glissando-Net: Deep sinGLe vIew category level poSe eStimation ANd 3D recOnstruction24 Jan 2025
- 2024Revisiting Marr in Face: The Building of 2D--2.5D--3D Representations in Deep Neural Networks25 Nov 2024
- 2024Point Cloud Synthesis Using Inner Product Transforms9 Oct 2024
- 2024Learning Local Pattern Modularization for Point Cloud Reconstruction from Unseen Classes26 Aug 2024
- 2024MeTTA: Single-View to 3D Textured Mesh Reconstruction with Test-Time Adaptation21 Aug 2024
- 2024Robust 3D Shape Reconstruction in Zero-Shot from a Single Image in the Wild21 Mar 2024
- 2024TripoSR: Fast 3D Object Reconstruction from a Single Image4 Mar 2024
- 2024Geometry aware 3D generation from in-the-wild images in ImageNet31 Jan 2024
- 2024RHOBIN Challenge: Reconstruction of Human Object Interaction7 Jan 2024
12 newest of 49 All 49 (JSON)