Single-View View Synthesis with Multiplane Images
Not on the map. Why?
Cited by 25 in Diffusion models, but placed by its own abstract, which didn’t fit.
Abstract (arXiv)
A recent strand of work in view synthesis uses deep learning to generate multiplane images (a camera-centric, layered 3D representation) given two or more input images at known viewpoints. We apply this representation to single-view view synthesis, a problem which is more challenging but has potentially much wider application. Our method learns to predict a multiplane image directly from a single image input, and we introduce scale-invariant view synthesis for supervision, enabling us to train on online video. We show this approach is applicable to several different datasets, that it additionally generates reasonable depth maps, and that it learns to fill in content behind the edges of foreground objects in background layers. Project page at https://single-view-mpi.github.io/.
Key facts. Cited by 263 papers in the map (data through 7 Oct 2026). First posted on arXiv 23 Apr 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 44; 2022: 56; 2023: 66; 2024: 41; 2025: 42; 2026: 14.
263 papers.
Sort:
By area:
- 2023Zero-1-to-3: Zero-shot One Image to 3D Objectcited by 1,483
- 2021Direct Voxel Grid Optimization: Super-fast Convergence for Radiance Fields Reconstructioncited by 961
- 2021Depth-supervised NeRF: Fewer Views and Faster Training for Freecited by 732
- 2021KiloNeRF: Speeding up Neural Radiance Fields with Thousands of Tiny MLPscited by 672
- 2023pixelSplat: 3D Gaussian Splats from Image Pairs for Scalable Generalizable 3D Reconstructioncited by 668
- 2021BARF: Bundle-Adjusting Neural Radiance Fieldscited by 641
- 2021Dynamic View Synthesis from Dynamic Monocular Videocited by 420
- 2024ViewCrafter: Taming Video Diffusion Models for High-fidelity Novel View Synthesiscited by 392
- 2021GAN Inversion: A Surveycited by 366
- 2021Advances in Neural Renderingcited by 365
- 2023Make-It-3D: High-Fidelity 3D Creation from A Single Image with Diffusion Priorcited by 341
- 2023ReconFusion: 3D Reconstruction with Diffusion Priorscited by 317
38 more
- 2021Mixture of Volumetric Primitives for Efficient Neural Renderingcited by 277
- 2023Generative Novel View Synthesis with 3D-Aware Diffusion Modelscited by 273
- 2022NoPe-NeRF: Optimising Neural Radiance Field with No Pose Priorcited by 235
- 2021GRAM: Generative Radiance Manifolds for 3D-Aware Image Generationcited by 216
- 2021NeX: Real-time View Synthesis with Neural Basis Expansioncited by 215
- 2024WonderWorld: Interactive 3D Scene Generation from a Single Imagecited by 197
- 2023Robust Dynamic Radiance Fieldscited by 193
- 2023COLMAP-Free 3D Gaussian Splattingcited by 193
- 2021InfoNeRF: Ray Entropy Minimization for Few-Shot Neural Volume Renderingcited by 180
- 2023SceneScape: Text-Driven Consistent Scene Generationcited by 160
- 2021NeRF--: Neural Radiance Fields Without Known Camera Parameterscited by 155
- 2022StylizedNeRF: Consistent 3D Scene Stylization as Stylized NeRF via 2D-3D Mutual Learningcited by 140
- 2023SparseGS: Sparse View Synthesis using 3D Gaussian Splattingcited by 134
- 2021MINE: Towards Continuous Depth MPI with NeRF for Novel View Synthesiscited by 133
- 2021Hallucinated Neural Radiance Fields in the Wildcited by 130
- 2022Mixed Neural Voxels for Fast Multi-view Video Synthesiscited by 126
- 2023Text2NeRF: Text-Driven 3D Scene Generation with Neural Radiance Fieldscited by 122
- 2022Streaming Radiance Fields for 3D Video Synthesiscited by 118
- 2023F2-NeRF: Fast Neural Radiance Field Training with Free Camera Trajectoriescited by 118
- 2023Consistent View Synthesis with Pose-Guided Diffusion Modelscited by 117
- 2024latentSplat: Autoencoding Variational Gaussians for Fast Generalizable 3D Reconstructioncited by 114
- 2024Flash3D: Feed-Forward Generalisable 3D Scene Reconstruction from a Single Imagecited by 113
- 2023Learning to Render Novel Views from Wide-Baseline Stereo Pairscited by 103
- 2021Geometry-Free View Synthesis: Transformers and no 3D Priorscited by 99
- 2021NeRF-SR: High-Quality Neural Radiance Fields using Supersamplingcited by 95
- 2021T"oRF: Time-of-Flight Radiance Fields for Dynamic Scene View Synthesiscited by 88
- 2024V3D: Video Diffusion Models are Effective 3D Generatorscited by 88
- 2021Neural Trajectory Fields for Dynamic Novel View Synthesiscited by 85
- 2021PixelSynth: Generating a 3D-Consistent Experience from a Single Imagecited by 82
- 2022InfiniteNature-Zero: Learning Perpetual View Generation of Natural Scenes from Single Imagescited by 82
- 2021Learning to Stylize Novel Viewscited by 76
- 2023Behind the Scenes: Density Fields for Single View Reconstructioncited by 63
- 2023NeRFiller: Completing Scenes via Generative 3D Inpaintingcited by 62
- 2022Interactive Segmentation of Radiance Fieldscited by 60
- 2022Single-View View Synthesis in the Wild with Learned Adaptive Multiplane Imagescited by 59
- 2022Generative Multiplane Images: Making a 2D GAN 3D-Awarecited by 57
- 2023ViVid-1-to-3: Novel View Synthesis with Video Diffusion Modelscited by 57
- 2022Look Outside the Room: Synthesizing A Consistent Long-Term 3D Scene Video from A Single Imagecited by 55
50 most cited of 263 All 263 (JSON)
- 2026Remote Sensing Sparse-View 3D Gaussian Splatting via Depth Image-Based Rendering28 Sep 2026
- 2026Spackle: Completing Large View Single Image NVS with Adaptive Gaussians25 Sep 2026
- 2026InfiniSplat: Implicit Gaussian Decoding for Large-Baseline Monocular View Synthesis3 Aug 2026
- 2026PRISM: Feed-Forward Single-Image 3D Reconstruction via Geometric Warp-Residual Modeling24 Jun 2026
- 2026MB-Loc: Multi-planar Bird's-eye-view Localization in outdoor LiDAR scenes7 Jun 2026
- 2026UniSHARP: Universal Sharp Monocular View Synthesis5 Jun 2026
- 2026Fast and Lightweight Novel View Synthesis with Differentiable Multiplane Image1 Jun 2026
- 2026Cross-View Splatter: Feed-Forward View Synthesis with Georeferenced Images19 May 2026
- 2026DreamStereo: Towards Real-Time Stereo Inpainting for HD Videos14 Apr 2026
- 2026GRVS: a Generalizable and Recurrent Approach to Monocular Dynamic View Synthesis31 Mar 2026
- 2026One View Is Enough: In-the-Wild Monocular Pretraining for Novel View Generation24 Mar 2026
- 2026PackUV: Packed Gaussian UV Maps for 4D Volumetric Video26 Feb 2026
38 more
- 2026FreeFix: Boosting 3D Gaussian Splatting via Fine-Tuning-Free Diffusion Models28 Jan 2026
- 2026Guardians of the Hair: Rescuing Soft Boundaries in Depth, Stereo, and Novel Views6 Jan 2026
- 2025Sharp Monocular View Synthesis in Less Than a Second11 Dec 2025
- 2025WonderZoom: Multi-Scale 3D World Generation9 Dec 2025
- 2025Selfi: Self Improving Reconstruction Engine via 3D Geometric Feature Alignment9 Dec 2025
- 2025Novel View Synthesis from A Few Glimpses via Test-Time Natural Video Completion22 Nov 2025
- 2025NoPe-NeRF++: Local-to-Global Optimization of NeRF with No Pose Prior21 Nov 2025
- 2025CPSL: Representing Volumetric Video via Content-Promoted Scene Layers18 Nov 2025
- 2025RelightMaster: Precise Video Relighting with Multi-plane Light Images9 Nov 2025
- 2025Positional Encoding Field23 Oct 2025
- 2025Inverse Image-Based Rendering for Light Field Generation from Single Images23 Oct 2025
- 2025LongSplat: Robust Unposed 3D Gaussian Splatting for Casual Long Videos19 Aug 2025
- 2025S^2VG: 3D Stereoscopic and Spatial Video Generation via Denoising Frame Matrix11 Aug 2025
- 2025Advances in Feed-Forward 3D Reconstruction and View Synthesis: A Survey19 Jul 2025
- 2025PCR-GS: COLMAP-Free 3D Gaussian Splatting via Pose Co-Regularizations18 Jul 2025
- 2025Masks make discriminative models great again!1 Jul 2025
- 2025GaVS: 3D-Grounded Video Stabilization via Temporally-Consistent Local Reconstruction and Rendering30 Jun 2025
- 2025GViT: Representing Images as Gaussians for Visual Recognition30 Jun 2025
- 2025SemFaceEdit: Semantic Face Editing on Generative Radiance Manifolds28 Jun 2025
- 2025User-in-the-Loop View Sampling with Error Peaking Visualization26 Jun 2025
- 2025WonderFree: Enhancing Novel View Quality and Cross-View Consistency for 3D Scene Exploration25 Jun 2025
- 2025BulletGen: Improving 4D Reconstruction with Bullet-Time Generation23 Jun 2025
- 2025Flow-Anything: Learning Real-World Optical Flow Estimation from Large-Scale Single-view Images9 Jun 2025
- 2025Text2Stereo: Repurposing Stable Diffusion for Stereo Generation with Consistency Rewards27 May 2025
- 2025M2SVid: End-to-End Inpainting and Refinement for Monocular-to-Stereo Video Conversion22 May 2025
- 20253D Scene Generation: A Survey8 May 2025
- 2025IM-Portrait: Learning 3D-aware Video Diffusion for Photorealistic Talking Heads from Monocular Videos27 Apr 2025
- 2025MP-Mat: A 3D-and-Instance-Aware Human Matting and Editing Framework with Multiplane Representation20 Apr 2025
- 2025Video4DGen: Enhancing Video and 4D Generation through Mutual Optimization5 Apr 2025
- 2025Optimizing 4D Gaussians for Dynamic Scene Video from Single Landscape Images4 Apr 2025
- 2025WonderTurbo: Generating Interactive 3D World in 0.72 Seconds3 Apr 2025
- 2025CoGen: 3D Consistent Video Generation via Adaptive Conditioning for Autonomous Driving28 Mar 2025
- 2025SynCity: Training-Free Generation of 3D Worlds20 Mar 2025
- 2025Uncertainty-Aware Diffusion Guided Refinement of 3D Scenes19 Mar 2025
- 2025Learn Your Scales: Towards Scale-Consistent Generative Novel View Synthesis19 Mar 2025
- 2025Learning Efficient Fuse-and-Refine for Feed-Forward 3D Gaussian Splatting18 Mar 2025
- 2025Niagara: Normal-Integrated Geometric Affine Field for Scene Reconstruction from a Single View16 Mar 2025
- 2025Morpheus: Text-Driven 3D Gaussian Splat Shape and Color Stylization3 Mar 2025
50 newest of 263 All 263 (JSON)
- 2023Zero-1-to-3: Zero-shot One Image to 3D Objectcited by 1,483
- 2024ViewCrafter: Taming Video Diffusion Models for High-fidelity Novel View Synthesiscited by 392
- 2023Make-It-3D: High-Fidelity 3D Creation from A Single Image with Diffusion Priorcited by 341
- 2023ReconFusion: 3D Reconstruction with Diffusion Priorscited by 317
- 2023Generative Novel View Synthesis with 3D-Aware Diffusion Modelscited by 273
- 2023Text2NeRF: Text-Driven 3D Scene Generation with Neural Radiance Fieldscited by 122
- 2023Consistent View Synthesis with Pose-Guided Diffusion Modelscited by 117
- 2024V3D: Video Diffusion Models are Effective 3D Generatorscited by 88
- 2023ViVid-1-to-3: Novel View Synthesis with Video Diffusion Modelscited by 57
- 2023DreamSparse: Escaping from Plato's Cave with 2D Frozen Diffusion Model Given Sparse Viewscited by 31
- 20253D Scene Generation: A Surveycited by 24
- 2025Positional Encoding Fieldcited by 20
12 most cited of 24 All 24 (JSON)
- 2026PRISM: Feed-Forward Single-Image 3D Reconstruction via Geometric Warp-Residual Modeling24 Jun 2026
- 2026FreeFix: Boosting 3D Gaussian Splatting via Fine-Tuning-Free Diffusion Models28 Jan 2026
- 2025RelightMaster: Precise Video Relighting with Multi-plane Light Images9 Nov 2025
- 2025Positional Encoding Field23 Oct 2025
- 2025Text2Stereo: Repurposing Stable Diffusion for Stereo Generation with Consistency Rewards27 May 2025
- 20253D Scene Generation: A Survey8 May 2025
- 2025IM-Portrait: Learning 3D-aware Video Diffusion for Photorealistic Talking Heads from Monocular Videos27 Apr 2025
- 2025High-Fidelity Novel View Synthesis via Splatting-Guided Diffusion18 Feb 2025
- 2024A Lesson in Splats: Teacher-Guided Diffusion for 3D Gaussian Splats Generation with 2D Supervision1 Dec 2024
- 2024Novel View Synthesis with Pixel-Space Diffusion Models12 Nov 2024
- 2024ViewCrafter: Taming Video Diffusion Models for High-fidelity Novel View Synthesis3 Sep 2024
- 2024ExtraNeRF: Visibility-Aware View Extrapolation of Neural Radiance Fields with Diffusion Models10 Jun 2024
12 newest of 24 All 24 (JSON)
- 2021Direct Voxel Grid Optimization: Super-fast Convergence for Radiance Fields Reconstructioncited by 961
- 2021Depth-supervised NeRF: Fewer Views and Faster Training for Freecited by 732
- 2021KiloNeRF: Speeding up Neural Radiance Fields with Thousands of Tiny MLPscited by 672
- 2023pixelSplat: 3D Gaussian Splats from Image Pairs for Scalable Generalizable 3D Reconstructioncited by 668
- 2021BARF: Bundle-Adjusting Neural Radiance Fieldscited by 641
- 2021Dynamic View Synthesis from Dynamic Monocular Videocited by 420
- 2021GAN Inversion: A Surveycited by 366
- 2021Advances in Neural Renderingcited by 365
- 2021Mixture of Volumetric Primitives for Efficient Neural Renderingcited by 277
- 2022NoPe-NeRF: Optimising Neural Radiance Field with No Pose Priorcited by 235
- 2021GRAM: Generative Radiance Manifolds for 3D-Aware Image Generationcited by 216
- 2021NeX: Real-time View Synthesis with Neural Basis Expansioncited by 215
12 most cited of 237 All 237 (JSON)
- 2026Remote Sensing Sparse-View 3D Gaussian Splatting via Depth Image-Based Rendering28 Sep 2026
- 2026Spackle: Completing Large View Single Image NVS with Adaptive Gaussians25 Sep 2026
- 2026InfiniSplat: Implicit Gaussian Decoding for Large-Baseline Monocular View Synthesis3 Aug 2026
- 2026MB-Loc: Multi-planar Bird's-eye-view Localization in outdoor LiDAR scenes7 Jun 2026
- 2026UniSHARP: Universal Sharp Monocular View Synthesis5 Jun 2026
- 2026Fast and Lightweight Novel View Synthesis with Differentiable Multiplane Image1 Jun 2026
- 2026Cross-View Splatter: Feed-Forward View Synthesis with Georeferenced Images19 May 2026
- 2026DreamStereo: Towards Real-Time Stereo Inpainting for HD Videos14 Apr 2026
- 2026GRVS: a Generalizable and Recurrent Approach to Monocular Dynamic View Synthesis31 Mar 2026
- 2026One View Is Enough: In-the-Wild Monocular Pretraining for Novel View Generation24 Mar 2026
- 2026PackUV: Packed Gaussian UV Maps for 4D Volumetric Video26 Feb 2026
- 2026Guardians of the Hair: Rescuing Soft Boundaries in Depth, Stereo, and Novel Views6 Jan 2026
12 newest of 237 All 237 (JSON)