3D Shape Induction from 2D Views of Multiple Objects
Not on the map. Why?
Cited by 21 in Diffusion models, but placed by its own abstract, which didn’t fit.
Abstract (arXiv)
In this paper we investigate the problem of inducing a distribution over three-dimensional structures given two-dimensional views of multiple objects taken from unknown viewpoints. Our approach called "projective generative adversarial networks" (PrGANs) trains a deep generative model of 3D shapes whose projections match the distributions of the input 2D views. The addition of a projection module allows us to infer the underlying 3D shape distribution without using any 3D, viewpoint information, or annotation during the learning phase. We show that our approach produces 3D shapes of comparable quality to GANs trained on 3D data for a number of shape categories including chairs, airplanes, and cars. Experiments also show that the disentangled representation of 2D shapes into geometry and viewpoint leads to a good generative model of 2D shapes. The key advantage is that our model allows us to predict 3D, viewpoint, and generate novel views from an input image in a completely unsupervised manner.
Key facts. Cited by 121 papers in the map (data through 14 Oct 2026). First posted on arXiv 18 Dec 2016.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 17; 2022: 36; 2023: 40; 2024: 18; 2025: 5; 2026: 5.
121 papers.
Sort:
By area:
- 2022Magic3D: High-Resolution Text-to-3D Content Creationcited by 1,290
- 2021Efficient Geometry-aware 3D Generative Adversarial Networkscited by 1,205
- 2021Common Objects in 3D: Large-Scale Learning and Evaluation of Real-life 3D Category Reconstructioncited by 652
- 2022GET3D: A Generative Model of High Quality 3D Textured Shapes Learned from Imagescited by 446
- 2023Instant3D: Fast Text-to-3D with Sparse-View Generation and Large Reconstruction Modelcited by 378
- 2023OmniObject3D: Large-Vocabulary 3D Object Dataset for Realistic Perception, Reconstruction and Generationcited by 326
- 2023ReconFusion: 3D Reconstruction with Diffusion Priorscited by 318
- 2023RealFusion: 360deg Reconstruction of Any Object from a Single Imagecited by 306
- 2021StyleSDF: High-Resolution 3D-Consistent Image and Geometry Generationcited by 289
- 20223D Neural Field Generation using Triplane Diffusioncited by 274
- 2023DreamAvatar: Text-and-Shape Guided 3D Human Avatar Generation via Diffusion Modelscited by 154
- 2023Let 2D Diffusion Model Know 3D-Consistency for Robust Text-to-3D Generationcited by 133
38 more
- 2022Next3D: Generative Neural Texture Rasterization for 3D-Aware Head Avatarscited by 124
- 2021FENeRF: Face Editing in Neural Radiance Fieldscited by 112
- 2022EpiGRAF: Rethinking training of 3D GANscited by 108
- 2023HoloDiffusion: Training a 3D Diffusion Model using 2D Imagescited by 106
- 2021Neural Parts: Learning Expressive 3D Shape Abstractions with Invertible Neural Networkscited by 103
- 2022Generative Neural Articulated Radiance Fieldscited by 101
- 2023Compositional 3D Scene Generation using Locally Conditioned Diffusioncited by 101
- 2024V3D: Video Diffusion Models are Effective 3D Generatorscited by 89
- 2023CityDreamer: Compositional Generative Model of Unbounded 3D Citiescited by 76
- 2023SceneDreamer: Unbounded 3D Scene Generation from 2D Image Collectionscited by 72
- 2021Unsupervised Learning of 3D Object Categories from Videos in the Wildcited by 67
- 2021Shelf-Supervised Mesh Prediction in the Wildcited by 65
- 2022Texturify: Generating Textures on 3D Shape Surfacescited by 65
- 2022Unsupervised Learning of Efficient Geometry-Aware Neural Articulated Representationscited by 65
- 2024Advances in 3D Generation: A Surveycited by 63
- 2022Generative Multiplane Images: Making a 2D GAN 3D-Awarecited by 57
- 2021CAMPARI: Camera-Aware Decomposed Generative Neural Radiance Fieldscited by 55
- 20223D GAN Inversion for Controllable Portrait Image Animationcited by 53
- 2023Instruct 3D-to-3D: Text Instruction Guided 3D-to-3D conversioncited by 48
- 2021FiG-NeRF: Figure-Ground Neural Radiance Fields for 3D Object Category Modellingcited by 47
- 2023DITTO-NeRF: Diffusion-based Iterative Text To Omni-directional 3D Modelcited by 43
- 2024Where Do We Stand with Implicit Neural Representations? A Technical and Performance Surveycited by 42
- 2022VoLux-GAN: A Generative Model for 3D Face Synthesis with HDRI Relightingcited by 37
- 2022Controllable 3D Face Synthesis with Conditional Generative Occupancy Fieldscited by 37
- 2021Learning Anchored Unsigned Distance Functions with Gradient Direction Alignment for Single-view Garment Reconstructioncited by 36
- 2023PartNeRF: Generating Part-Aware Editable 3D Shapes without 3D Supervisioncited by 36
- 2022HumanGen: Generating Human Radiance Fields with Explicit Priorscited by 33
- 2022DATID-3D: Diversity-Preserved Domain Adaptation Using Text-to-Image Diffusion for 3D Generative Modelcited by 32
- 2023HoloFusion: Towards Photo-realistic 3D Generative Modelingcited by 32
- 20213D-Aware Semantic-Guided Generative Model for Human Synthesiscited by 31
- 2024SphereHead: Stable 3D Full-head Synthesis with Spherical Tri-plane Representationcited by 30
- 2024Motion2VecSets: 4D Latent Vector Set Diffusion for Non-rigid Shape Reconstruction and Trackingcited by 29
- 2021Indoor Scene Generation from a Collection of Semantic-Segmented Depth Imagescited by 27
- 2021Unsupervised Learning of Fine Structure Generation for 3D Point Clouds by 2D Projection Matchingcited by 26
- 2021Differentiable Stereopsis: Meshes from multiple views using differentiable renderingcited by 26
- 2022Share With Thy Neighbors: Single-View Reconstruction by Cross-Instance Consistencycited by 26
- 2024Controllable Text-to-3D Generation via Surface-Aligned Gaussian Splattingcited by 26
- 2023GINA-3D: Learning to Generate Implicit Neural Assets in the Wildcited by 25
50 most cited of 121 All 121 (JSON)
- 2026Bottom-up Modeling of Repeated Elements via Single Image Analysis-by-Synthesis7 Sep 2026
- 2026ToW3D: Consistency-aware Interactive Point-based Mesh Editing on GANs3 Aug 2026
- 2026SketchFaceGS: Real-Time Sketch-Driven Face Editing and Generation with Gaussian Splatting21 Apr 2026
- 2026High-Fidelity 3D Facial Avatar Synthesis with Controllable Fine-Grained Expressions16 Mar 2026
- 2026Condition Matters in Full-head 3D GANs6 Feb 2026
- 2025PanoLAM: Large Avatar Model for Gaussian Full-Head Synthesis from One-shot Unposed Image9 Sep 2025
- 2025CGS-GAN: 3D Consistent Gaussian Splatting GANs for High Resolution Human Head Synthesis23 May 2025
- 2025Next-Scale Autoregressive Models are Zero-Shot Single-Image Object View Synthesizers17 Mar 2025
- 2025DivCon-NeRF: Diverse and Consistent Ray Augmentation for Few-Shot NeRF17 Mar 2025
- 2025Compositional Generative Model of Unbounded 4D Cities15 Jan 2025
- 2024Where Do We Stand with Implicit Neural Representations? A Technical and Performance Survey6 Nov 2024
- 2024PASTA: Controllable Part-Aware Shape Generation with Autoregressive Transformers18 Jul 2024
38 more
- 2024Efficient 3D-Aware Facial Image Editing via Attribute-Specific Prompt Learning6 Jun 2024
- 2024DIRECT-3D: Learning Direct Text-to-3D Generation on Massive Noisy 3D Data6 Jun 2024
- 2024GeoGen: Geometry-Aware Generative Modeling via Signed Distance Functions6 Jun 2024
- 2024Lightplane: Highly-Scalable Components for Neural 3D Fields30 Apr 2024
- 2024Interactive3D: Create What You Want by Interactive 3D Generation25 Apr 2024
- 2024MaterialSeg3D: Segmenting Dense Materials from 2D Priors for 3D Assets22 Apr 2024
- 2024SphereHead: Stable 3D Full-head Synthesis with Spherical Tri-plane Representation8 Apr 2024
- 2024Controllable Text-to-3D Generation via Surface-Aligned Gaussian Splatting15 Mar 2024
- 2024Bayesian Diffusion Models for 3D Shape Reconstruction11 Mar 2024
- 2024V3D: Video Diffusion Models are Effective 3D Generators11 Mar 2024
- 2024AvatarMMC: 3D Head Avatar Generation and Editing with Multi-Modal Conditioning8 Feb 2024
- 2024Geometry aware 3D generation from in-the-wild images in ImageNet31 Jan 2024
- 2024Advances in 3D Generation: A Survey31 Jan 2024
- 2024Motion2VecSets: 4D Latent Vector Set Diffusion for Non-rigid Shape Reconstruction and Tracking12 Jan 2024
- 2024RAVEN: Rethinking Adversarial Video Generation with Efficient Tri-plane Networks11 Jan 2024
- 2024See360: Novel Panoramic View Interpolation7 Jan 2024
- 2023DiffusionGAN3D: Boosting Text-guided 3D Generation and Domain Adaptation by Combining 3D GANs and Diffusion Priors28 Dec 2023
- 2023GOEmbed: Gradient Origin Embeddings for Representation Agnostic 3D Feature Learning14 Dec 2023
- 2023CAD: Photorealistic 3D Generation via Adversarial Distillation11 Dec 2023
- 2023ReconFusion: 3D Reconstruction with Diffusion Priors5 Dec 2023
- 2023Consistent Mesh Diffusion1 Dec 2023
- 2023ET3D: Efficient Text-to-3D Generation via Multi-View Distillation27 Nov 2023
- 2023MVControl: Adding Conditional Control to Multi-view Diffusion for Controllable Text-to-3D Generation24 Nov 2023
- 2023DatasetNeRF: Efficient 3D-aware Data Factory with Generative Radiance Fields18 Nov 2023
- 2023Instant3D: Fast Text-to-3D with Sparse-View Generation and Large Reconstruction Model10 Nov 2023
- 20233DMiner: Discovering Shapes from Large-Scale Unannotated Image Datasets29 Oct 2023
- 2023Learning Effective NeRFs and SDFs Representations with 3D Generative Adversarial Networks for 3D Object Generation28 Sep 2023
- 2023OrthoPlanes: A Novel Representation for Better 3D-Awareness of GANs27 Sep 2023
- 2023DeFormer: Integrating Transformers with Deformable Models for 3D Shape Abstraction from a Single Image22 Sep 2023
- 2023Exploiting Multiple Priors for Neural 3D Indoor Reconstruction13 Sep 2023
- 2023CityDreamer: Compositional Generative Model of Unbounded 3D Cities1 Sep 2023
- 2023HoloFusion: Towards Photo-realistic 3D Generative Modeling28 Aug 2023
- 2023Efficient 3D Articulated Human Generation with Layered Surface Volumes11 Jul 2023
- 2023Hybrid Neural Diffeomorphic Flow for Shape Representation and Generation via Triplane4 Jul 2023
- 2023Toward Mesh-Invariant 3D Generative Deep Learning with Geometric Measures27 Jun 2023
- 2023Benchmarking and Analyzing 3D-aware Image Synthesis with a Modularized Codebase21 Jun 2023
- 2023Few-shot 3D Shape Generation19 May 2023
- 2023MultiPlaneNeRF: Neural Radiance Field with Non-Trainable Representation17 May 2023
50 newest of 121 All 121 (JSON)
- 2022Magic3D: High-Resolution Text-to-3D Content Creationcited by 1,290
- 2023Instant3D: Fast Text-to-3D with Sparse-View Generation and Large Reconstruction Modelcited by 378
- 2023ReconFusion: 3D Reconstruction with Diffusion Priorscited by 318
- 20223D Neural Field Generation using Triplane Diffusioncited by 274
- 2023DreamAvatar: Text-and-Shape Guided 3D Human Avatar Generation via Diffusion Modelscited by 154
- 2023Let 2D Diffusion Model Know 3D-Consistency for Robust Text-to-3D Generationcited by 133
- 2023HoloDiffusion: Training a 3D Diffusion Model using 2D Imagescited by 106
- 2024V3D: Video Diffusion Models are Effective 3D Generatorscited by 89
- 2022DATID-3D: Diversity-Preserved Domain Adaptation Using Text-to-Image Diffusion for 3D Generative Modelcited by 32
- 2023HoloFusion: Towards Photo-realistic 3D Generative Modelingcited by 32
- 2024Motion2VecSets: 4D Latent Vector Set Diffusion for Non-rigid Shape Reconstruction and Trackingcited by 29
- 2024Controllable Text-to-3D Generation via Surface-Aligned Gaussian Splattingcited by 26
12 most cited of 21 All 21 (JSON)
- 2024DIRECT-3D: Learning Direct Text-to-3D Generation on Massive Noisy 3D Data6 Jun 2024
- 2024MaterialSeg3D: Segmenting Dense Materials from 2D Priors for 3D Assets22 Apr 2024
- 2024Controllable Text-to-3D Generation via Surface-Aligned Gaussian Splatting15 Mar 2024
- 2024Bayesian Diffusion Models for 3D Shape Reconstruction11 Mar 2024
- 2024V3D: Video Diffusion Models are Effective 3D Generators11 Mar 2024
- 2024AvatarMMC: 3D Head Avatar Generation and Editing with Multi-Modal Conditioning8 Feb 2024
- 2024Motion2VecSets: 4D Latent Vector Set Diffusion for Non-rigid Shape Reconstruction and Tracking12 Jan 2024
- 2023DiffusionGAN3D: Boosting Text-guided 3D Generation and Domain Adaptation by Combining 3D GANs and Diffusion Priors28 Dec 2023
- 2023CAD: Photorealistic 3D Generation via Adversarial Distillation11 Dec 2023
- 2023ReconFusion: 3D Reconstruction with Diffusion Priors5 Dec 2023
- 2023ET3D: Efficient Text-to-3D Generation via Multi-View Distillation27 Nov 2023
- 2023MVControl: Adding Conditional Control to Multi-view Diffusion for Controllable Text-to-3D Generation24 Nov 2023
12 newest of 21 All 21 (JSON)
- 2021Efficient Geometry-aware 3D Generative Adversarial Networkscited by 1,205
- 2021Common Objects in 3D: Large-Scale Learning and Evaluation of Real-life 3D Category Reconstructioncited by 652
- 2022GET3D: A Generative Model of High Quality 3D Textured Shapes Learned from Imagescited by 446
- 2023OmniObject3D: Large-Vocabulary 3D Object Dataset for Realistic Perception, Reconstruction and Generationcited by 326
- 2023RealFusion: 360deg Reconstruction of Any Object from a Single Imagecited by 306
- 2021StyleSDF: High-Resolution 3D-Consistent Image and Geometry Generationcited by 289
- 2022Next3D: Generative Neural Texture Rasterization for 3D-Aware Head Avatarscited by 124
- 2021FENeRF: Face Editing in Neural Radiance Fieldscited by 112
- 2022EpiGRAF: Rethinking training of 3D GANscited by 108
- 2021Neural Parts: Learning Expressive 3D Shape Abstractions with Invertible Neural Networkscited by 103
- 2022Generative Neural Articulated Radiance Fieldscited by 101
- 2023Compositional 3D Scene Generation using Locally Conditioned Diffusioncited by 101
12 most cited of 100 All 100 (JSON)
- 2026Bottom-up Modeling of Repeated Elements via Single Image Analysis-by-Synthesis7 Sep 2026
- 2026ToW3D: Consistency-aware Interactive Point-based Mesh Editing on GANs3 Aug 2026
- 2026SketchFaceGS: Real-Time Sketch-Driven Face Editing and Generation with Gaussian Splatting21 Apr 2026
- 2026High-Fidelity 3D Facial Avatar Synthesis with Controllable Fine-Grained Expressions16 Mar 2026
- 2026Condition Matters in Full-head 3D GANs6 Feb 2026
- 2025PanoLAM: Large Avatar Model for Gaussian Full-Head Synthesis from One-shot Unposed Image9 Sep 2025
- 2025CGS-GAN: 3D Consistent Gaussian Splatting GANs for High Resolution Human Head Synthesis23 May 2025
- 2025Next-Scale Autoregressive Models are Zero-Shot Single-Image Object View Synthesizers17 Mar 2025
- 2025DivCon-NeRF: Diverse and Consistent Ray Augmentation for Few-Shot NeRF17 Mar 2025
- 2025Compositional Generative Model of Unbounded 4D Cities15 Jan 2025
- 2024Where Do We Stand with Implicit Neural Representations? A Technical and Performance Survey6 Nov 2024
- 2024PASTA: Controllable Part-Aware Shape Generation with Autoregressive Transformers18 Jul 2024
12 newest of 100 All 100 (JSON)