Learning View Priors for Single-view 3D Reconstruction
Not on the map. Why?
Abstract (arXiv)
There is some ambiguity in the 3D shape of an object when the number of observed views is small. Because of this ambiguity, although a 3D object reconstructor can be trained using a single view or a few views per object, reconstructed shapes only fit the observed views and appear incorrect from the unobserved viewpoints. To reconstruct shapes that look reasonable from any viewpoint, we propose to train a discriminator that learns prior knowledge regarding possible views. The discriminator is trained to distinguish the reconstructed views of the observed viewpoints from those of the unobserved viewpoints. The reconstructor is trained to correct unobserved views by fooling the discriminator. Our method outperforms current state-of-the-art methods on both synthetic and natural image datasets; this validates the effectiveness of our method.
Key facts. Cited by 35 papers in the map (data through 14 Oct 2026). First posted on arXiv 26 Nov 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 10; 2022: 9; 2023: 8; 2024: 5; 2025: 1; 2026: 2.
35 papers.
Sort:
By area:
- 2023SyncDreamer: Generating Multiview-consistent Images from a Single-view Imagecited by 645
- 2022MagicPony: Learning Articulated 3D Animals in the Wildcited by 112
- 2024LN3DIFF++: Scalable Latent Neural Fields Diffusion for Speedy 3D Generationcited by 92
- 2023PC2: Projection-Conditioned Point Cloud Diffusion for Single-Image 3D Reconstructioncited by 84
- 2021Shelf-Supervised Mesh Prediction in the Wildcited by 65
- 2021DOVE: Learning Deformable 3D Objects by Watching Videoscited by 61
- 2022Category-Level 6D Object Pose Estimation in the Wild: A Semi-Supervised Learning Approach and A New Datasetcited by 59
- 2024When LLMs step into the 3D World: A Survey and Meta-Analysis of 3D Tasks via Multi-modal Large Language Modelscited by 43
- 2022Surface-Aligned Neural Radiance Fields for Controllable 3D Human Synthesiscited by 41
- 2024EasyHOI: Unleashing the Power of Large Models for Reconstructing Hand-Object Interactions in the Wildcited by 36
- 2023VQ3D: Learning a 3D-Aware Generative Model on ImageNetcited by 32
- 2022Pre-train, Self-train, Distill: A simple recipe for Supersizing 3D Reconstructioncited by 26
23 more
- 2022Share With Thy Neighbors: Single-View Reconstruction by Cross-Instance Consistencycited by 26
- 2023ShapeClipper: Scalable 3D Shape Learning from Single-View Images via Geometric and CLIP-based Consistencycited by 16
- 2024ViewFusion: Towards Multi-View Consistency via Interpolated Denoisingcited by 14
- 2021Discovering 3D Parts from Image Collectionscited by 13
- 2022Structural Causal 3D Reconstructioncited by 12
- 2021Efficient and Differentiable Shadow Computation for Inverse Problemscited by 11
- 2021ADOP: Approximate Differentiable One-Pixel Point Renderingcited by 9
- 2022Test-time Adaptation with Slot-Centric Modelscited by 9
- 2022Planes vs. Chairs: Category-guided 3D shape learning without any 3D cuescited by 9
- 2023Creative Birds: Self-Supervised Single-View 3D Style Transfercited by 9
- 2021Multi-Category Mesh Reconstruction From Image Collectionscited by 5
- 2021Pose Adaptive Dual Mixup for Few-Shot Single-View 3D Reconstructioncited by 5
- 20223D Magic Mirror: Clothing Reconstruction from a Single Image via a Causal Perspectivecited by 5
- 2025LIM: Large Interpolator Model for Dynamic Reconstructioncited by 5
- 2021Fine-Grained Adversarial Semi-supervised Learningcited by 4
- 2021ContourRender: Detecting Arbitrary Contour Shape For Instance Segmentation In One Passcited by 1
- 2023Efficient Multi-View Inverse Rendering Using a Hybrid Differentiable Rendering Methodcited by 1
- 2024PILA: Physics-Informed Low Rank Augmentation for Interpretable Earth Observationcited by 1
- 2021Using Adaptive Gradient for Texture Learning in Single-View 3D Reconstructioncited by 0
- 20233DMiner: Discovering Shapes from Large-Scale Unannotated Image Datasetscited by 0
- 2023Two-stage Synthetic Supervising and Multi-view Consistency Self-supervising based Animal 3D Reconstruction by Single Imagecited by 0
- 2026A Comparison of Multi-View Stereo Methods for Photogrammetric 3D Reconstruction: From Traditional to Learning-Based Approachescited by 0
- 2026CORGI: Consistency-Aware 3D Dog Reconstruction from a Single Image in the Wildcited by 0
- 2026CORGI: Consistency-Aware 3D Dog Reconstruction from a Single Image in the Wild1 Jul 2026
- 2026A Comparison of Multi-View Stereo Methods for Photogrammetric 3D Reconstruction: From Traditional to Learning-Based Approaches11 Apr 2026
- 2025LIM: Large Interpolator Model for Dynamic Reconstruction28 Mar 2025
- 2024EasyHOI: Unleashing the Power of Large Models for Reconstructing Hand-Object Interactions in the Wild21 Nov 2024
- 2024PILA: Physics-Informed Low Rank Augmentation for Interpretable Earth Observation29 May 2024
- 2024When LLMs step into the 3D World: A Survey and Meta-Analysis of 3D Tasks via Multi-modal Large Language Models16 May 2024
- 2024LN3DIFF++: Scalable Latent Neural Fields Diffusion for Speedy 3D Generation18 Mar 2024
- 2024ViewFusion: Towards Multi-View Consistency via Interpolated Denoising29 Feb 2024
- 2023Two-stage Synthetic Supervising and Multi-view Consistency Self-supervising based Animal 3D Reconstruction by Single Image22 Nov 2023
- 20233DMiner: Discovering Shapes from Large-Scale Unannotated Image Datasets29 Oct 2023
- 2023SyncDreamer: Generating Multiview-consistent Images from a Single-view Image7 Sep 2023
- 2023Efficient Multi-View Inverse Rendering Using a Hybrid Differentiable Rendering Method19 Aug 2023
23 more
- 2023Creative Birds: Self-Supervised Single-View 3D Style Transfer26 Jul 2023
- 2023ShapeClipper: Scalable 3D Shape Learning from Single-View Images via Geometric and CLIP-based Consistency13 Apr 2023
- 2023PC2: Projection-Conditioned Point Cloud Diffusion for Single-Image 3D Reconstruction21 Feb 2023
- 2023VQ3D: Learning a 3D-Aware Generative Model on ImageNet14 Feb 2023
- 2022MagicPony: Learning Articulated 3D Animals in the Wild22 Nov 2022
- 2022Structural Causal 3D Reconstruction20 Jul 2022
- 2022Category-Level 6D Object Pose Estimation in the Wild: A Semi-Supervised Learning Approach and A New Dataset30 Jun 2022
- 20223D Magic Mirror: Clothing Reconstruction from a Single Image via a Causal Perspective27 Apr 2022
- 2022Share With Thy Neighbors: Single-View Reconstruction by Cross-Instance Consistency21 Apr 2022
- 2022Planes vs. Chairs: Category-guided 3D shape learning without any 3D cues21 Apr 2022
- 2022Pre-train, Self-train, Distill: A simple recipe for Supersizing 3D Reconstruction7 Apr 2022
- 2022Test-time Adaptation with Slot-Centric Models21 Mar 2022
- 2022Surface-Aligned Neural Radiance Fields for Controllable 3D Human Synthesis5 Jan 2022
- 2021Pose Adaptive Dual Mixup for Few-Shot Single-View 3D Reconstruction23 Dec 2021
- 2021Multi-Category Mesh Reconstruction From Image Collections21 Oct 2021
- 2021ADOP: Approximate Differentiable One-Pixel Point Rendering13 Oct 2021
- 2021Fine-Grained Adversarial Semi-supervised Learning12 Oct 2021
- 2021Discovering 3D Parts from Image Collections28 Jul 2021
- 2021DOVE: Learning Deformable 3D Objects by Watching Videos22 Jul 2021
- 2021ContourRender: Detecting Arbitrary Contour Shape For Instance Segmentation In One Pass7 Jun 2021
- 2021Using Adaptive Gradient for Texture Learning in Single-View 3D Reconstruction29 Apr 2021
- 2021Efficient and Differentiable Shadow Computation for Inverse Problems1 Apr 2021
- 2021Shelf-Supervised Mesh Prediction in the Wild11 Feb 2021
- 2022MagicPony: Learning Articulated 3D Animals in the Wildcited by 112
- 2024LN3DIFF++: Scalable Latent Neural Fields Diffusion for Speedy 3D Generationcited by 92
- 2023PC2: Projection-Conditioned Point Cloud Diffusion for Single-Image 3D Reconstructioncited by 84
- 2021Shelf-Supervised Mesh Prediction in the Wildcited by 65
- 2021DOVE: Learning Deformable 3D Objects by Watching Videoscited by 61
- 2022Category-Level 6D Object Pose Estimation in the Wild: A Semi-Supervised Learning Approach and A New Datasetcited by 59
- 2022Surface-Aligned Neural Radiance Fields for Controllable 3D Human Synthesiscited by 41
- 2024EasyHOI: Unleashing the Power of Large Models for Reconstructing Hand-Object Interactions in the Wildcited by 36
- 2023VQ3D: Learning a 3D-Aware Generative Model on ImageNetcited by 32
- 2022Pre-train, Self-train, Distill: A simple recipe for Supersizing 3D Reconstructioncited by 26
- 2022Share With Thy Neighbors: Single-View Reconstruction by Cross-Instance Consistencycited by 26
- 2023ShapeClipper: Scalable 3D Shape Learning from Single-View Images via Geometric and CLIP-based Consistencycited by 16
12 most cited of 32 All 32 (JSON)
- 2026CORGI: Consistency-Aware 3D Dog Reconstruction from a Single Image in the Wild1 Jul 2026
- 2026A Comparison of Multi-View Stereo Methods for Photogrammetric 3D Reconstruction: From Traditional to Learning-Based Approaches11 Apr 2026
- 2025LIM: Large Interpolator Model for Dynamic Reconstruction28 Mar 2025
- 2024EasyHOI: Unleashing the Power of Large Models for Reconstructing Hand-Object Interactions in the Wild21 Nov 2024
- 2024PILA: Physics-Informed Low Rank Augmentation for Interpretable Earth Observation29 May 2024
- 2024LN3DIFF++: Scalable Latent Neural Fields Diffusion for Speedy 3D Generation18 Mar 2024
- 2023Two-stage Synthetic Supervising and Multi-view Consistency Self-supervising based Animal 3D Reconstruction by Single Image22 Nov 2023
- 20233DMiner: Discovering Shapes from Large-Scale Unannotated Image Datasets29 Oct 2023
- 2023Efficient Multi-View Inverse Rendering Using a Hybrid Differentiable Rendering Method19 Aug 2023
- 2023Creative Birds: Self-Supervised Single-View 3D Style Transfer26 Jul 2023
- 2023ShapeClipper: Scalable 3D Shape Learning from Single-View Images via Geometric and CLIP-based Consistency13 Apr 2023
- 2023PC2: Projection-Conditioned Point Cloud Diffusion for Single-Image 3D Reconstruction21 Feb 2023
12 newest of 32 All 32 (JSON)