Local Light Field Fusion: Practical View Synthesis with Prescriptive Sampling Guidelines
Not on the map. Why?
Cited by 34 in Diffusion models, but placed by its own abstract, which didn’t fit.
Abstract (arXiv)
We present a practical and robust deep learning solution for capturing and rendering novel views of complex real world scenes for virtual exploration. Previous approaches either require intractably dense view sampling or provide little to no guidance for how users should sample views of a scene to reliably render high-quality novel views. Instead, we propose an algorithm for view synthesis from an irregular grid of sampled views that first expands each sampled view into a local light field via a multiplane image (MPI) scene representation, then renders novel views by blending adjacent local light fields. We extend traditional plenoptic sampling theory to derive a bound that specifies precisely how densely users should sample views of a given scene when using our algorithm. In practice, we apply this bound to capture and render views of real world scenes that achieve the perceptual quality of Nyquist rate view sampling while using up to 4000x fewer views. We demonstrate our approach's practicality with an augmented reality smartphone app that guides users to capture input images of a scene and viewers that enable realtime virtual exploration on desktop and mobile platforms.
Key facts. Cited by 672 papers in the map (data through 14 Oct 2026). First posted on arXiv 2 May 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 66; 2022: 109; 2023: 208; 2024: 193; 2025: 92; 2026: 4.
672 papers.
Sort:
By area:
- 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,723
- 2021Mip-NeRF 360: Unbounded Anti-Aliased Neural Radiance Fieldscited by 2,032
- 2021PlenOctrees for Real-time Rendering of Neural Radiance Fieldscited by 905
- 2023ScanNet++: A High-Fidelity Dataset of 3D Indoor Scenescited by 764
- 2023K-Planes: Explicit Radiance Fields in Space, Time, and Appearancecited by 746
- 2021MVSNeRF: Fast Generalizable Radiance Field Reconstruction from Multi-View Stereocited by 740
- 2021KiloNeRF: Speeding up Neural Radiance Fields with Thousands of Tiny MLPscited by 673
- 2021UNISURF: Unifying Neural Implicit Surfaces and Radiance Fields for Multi-View Reconstructioncited by 646
- 2021BARF: Bundle-Adjusting Neural Radiance Fieldscited by 642
- 2021RegNeRF: Regularizing Neural Radiance Fields for View Synthesis from Sparse Inputscited by 615
- 2023Nerfstudio: A Modular Framework for Neural Radiance Field Developmentcited by 600
- 2023HexPlane: A Fast Representation for Dynamic Scenescited by 587
38 more
- 2023DL3DV-10K: A Large-Scale Scene Dataset for Deep Learning-based 3D Visioncited by 537
- 2021Zero-Shot Text-Guided Object Generation with Dream Fieldscited by 513
- 2021FastNeRF: High-Fidelity Neural Rendering at 200FPScited by 511
- 2023Real-time Photorealistic Dynamic Scene Representation and Rendering with 4D Gaussian Splattingcited by 476
- 2021Baking Neural Radiance Fields for Real-Time View Synthesiscited by 468
- 2021Putting NeRF on a Diet: Semantically Consistent Few-Shot View Synthesiscited by 464
- 2024CAT3D: Create Anything in 3D with Multi-View Diffusion Modelscited by 432
- 2021Mega-NeRF: Scalable Construction of Large-Scale NeRFs for Virtual Fly-Throughscited by 398
- 2023Gaussian Grouping: Segment and Edit Anything in 3D Scenescited by 393
- 2022Decomposing NeRF for Editing via Feature Field Distillationcited by 371
- 2021Advances in Neural Renderingcited by 365
- 2023Feature 3DGS: Supercharging 3D Gaussian Splatting to Enable Distilled Feature Fieldscited by 364
- 2024GS-LRM: Large Reconstruction Model for 3D Gaussian Splattingcited by 349
- 2023Spacetime Gaussian Feature Splatting for Real-Time Dynamic View Synthesiscited by 344
- 2021Light Field Networks: Neural Scene Representations with Single-Evaluation Renderingcited by 332
- 2023ReconFusion: 3D Reconstruction with Diffusion Priorscited by 318
- 2022MobileNeRF: Exploiting the Polygon Rasterization Pipeline for Efficient Neural Field Rendering on Mobile Architecturescited by 311
- 2023FreeNeRF: Improving Few-shot Neural Rendering with Free Frequency Regularizationcited by 311
- 2023FSGS: Real-Time Few-shot View Synthesis using Gaussian Splattingcited by 279
- 2021Mixture of Volumetric Primitives for Efficient Neural Renderingcited by 277
- 2021Urban Radiance Fieldscited by 263
- 2024DNGaussian: Optimizing Sparse-View 3D Gaussian Radiance Fields with Global-Local Depth Normalizationcited by 256
- 2023SparseNeRF: Distilling Depth Ranking for Few-shot Novel View Synthesiscited by 247
- 2025AnySplat: Feed-forward 3D Gaussian Splatting from Unconstrained Viewscited by 243
- 2022NoPe-NeRF: Optimising Neural Radiance Field with No Pose Priorcited by 235
- 2021DONeRF: Towards Real-Time Rendering of Compact Neural Radiance Fields using Depth Oracle Networkscited by 232
- 2024A Survey on 3D Gaussian Splattingcited by 224
- 2021Editing Conditional Radiance Fieldscited by 222
- 2023MVImgNet: A Large-scale Dataset of Multi-view Imagescited by 220
- 2023MERF: Memory-Efficient Radiance Fields for Real-time View Synthesis in Unbounded Scenescited by 218
- 2023Gaussian-Flow: 4D Reconstruction with Dynamic 3D Gaussian Particlecited by 211
- 2021Self-Calibrating Neural Radiance Fieldscited by 204
- 2021Neural Articulated Radiance Fieldcited by 196
- 2022Neural Feature Fusion Fields: 3D Distillation of Self-Supervised 2D Image Representationscited by 196
- 2021NerfingMVS: Guided Optimization of Neural Radiance Fields for Indoor Multi-view Stereocited by 192
- 2021Stereo Radiance Fields (SRF): Learning View Synthesis for Sparse Views of Novel Scenescited by 190
- 2021Point-Based Neural Rendering with Per-View Optimizationcited by 190
- 20244D-Rotor Gaussian Splatting: Towards Efficient Novel View Synthesis for Dynamic Scenescited by 189
50 most cited of 672 All 672 (JSON)
- 2026Recent Advances and Trends in Learning-based 3D Representations3 Jun 2026
- 2026Boosting Zero-Shot 3D Style Transfer with 2D Pre-trained Priors28 May 2026
- 2026Multimodal-Prior-Guided Importance Sampling for Hierarchical Gaussian Splatting in Sparse-View Novel View Synthesis3 Mar 2026
- 2026FreeFix: Boosting 3D Gaussian Splatting via Fine-Tuning-Free Diffusion Models28 Jan 2026
- 2025Content-Aware Texturing for Gaussian Splatting2 Dec 2025
- 2025Clustered Error Correction with Grouped 4D Gaussian Splatting20 Nov 2025
- 2025Initialize to Generalize: A Stronger Initialization Pipeline for Sparse-View 3DGS20 Oct 2025
- 2025Multi-Agent Pose Uncertainty: A Differentiable Rendering Cram'er-Rao Bound18 Oct 2025
- 2025Opacity-Gradient Driven Density Control for Compact and Efficient Few-Shot 3D Gaussian Splatting11 Oct 2025
- 2025Gesplat: Robust Pose-Free 3D Reconstruction via Geometry-Guided Gaussian Splatting11 Oct 2025
- 2025Geometry-Aware Scene Configurations for Novel View Synthesis10 Oct 2025
- 2025D2GS: Depth-and-Density Guided Gaussian Splatting for Stable and Accurate Sparse-View Reconstruction9 Oct 2025
38 more
- 2025Learning Neural Exposure Fields for View Synthesis9 Oct 2025
- 2025Multi-level Dynamic Style Transfer for NeRFs1 Oct 2025
- 2025LVT: Large-Scale Scene Reconstruction via Local View Transformers29 Sep 2025
- 2025AD-GS: Alternating Densification for Sparse-Input 3D Gaussian Splatting13 Sep 2025
- 2025CausNVS: Autoregressive Multi-view Diffusion for Flexible 3D Novel View Synthesis8 Sep 2025
- 2025SSGaussian: Semantic-Aware and Structure-Preserving 3D Style Transfer4 Sep 2025
- 2025C3-GS: Learning Context-aware, Cross-dimension, Cross-scale Feature for Generalizable Gaussian Splatting28 Aug 2025
- 2025Distilled-3DGS:Distilled 3D Gaussian Splatting19 Aug 2025
- 2025IntelliCap: Intelligent Guidance for Consistent View Sampling18 Aug 2025
- 2025Quantifying and Alleviating Co-Adaptation in Sparse-View 3D Gaussian Splatting18 Aug 2025
- 2025DIP-GS: Deep Image Prior For Gaussian Splatting Sparse View Recovery10 Aug 2025
- 2025CoDe-NeRF: Neural Rendering via Dynamic Coefficient Decomposition8 Aug 2025
- 2025H3R: Hybrid Multi-view Correspondence for Generalizable 3D Reconstruction5 Aug 2025
- 2025MonoFusion: Sparse-View 4D Reconstruction via Monocular Fusion31 Jul 2025
- 2025Sparse-View 3D Reconstruction: Recent Advances and Open Challenges22 Jul 2025
- 2025DWTGS: Rethinking Frequency Regularization for Sparse-view 3D Gaussian Splatting21 Jul 2025
- 2025TimeNeRF: Building Generalizable Neural Radiance Fields across Time from Few-Shot Input Views18 Jul 2025
- 2025Stable Score Distillation12 Jul 2025
- 2025Mastering Regional 3DGS: Locating, Initializing, and Editing with Diverse 2D Priors7 Jul 2025
- 2025Dynamic View Synthesis from Small Camera Motion Videos29 Jun 2025
- 2025From Coarse to Fine: Learnable Discrete Wavelet Transforms for Efficient 3D Gaussian Splatting29 Jun 2025
- 2025User-in-the-Loop View Sampling with Error Peaking Visualization26 Jun 2025
- 2025MCN-SLAM: Multi-Agent Collaborative Neural SLAM with Hybrid Implicit Neural Scene Representation23 Jun 2025
- 20254Real-Video-V2: Fused View-Time Attention and Feedforward Reconstruction for 4D Scene Generation18 Jun 2025
- 2025RA-NeRF: Robust Neural Radiance Field Reconstruction with Accurate Camera Pose Estimation under Complex Trajectories18 Jun 2025
- 2025InstaInpaint: Instant 3D-Scene Inpainting with Masked Large Reconstruction Model12 Jun 2025
- 2025PointGS: Point Attention-Aware Sparse View Synthesis with Gaussian Splatting12 Jun 2025
- 2025Complex-Valued Holographic Radiance Fields10 Jun 2025
- 2025HuSc3D: Human Sculpture dataset for 3D object reconstruction9 Jun 2025
- 2025SPC to 3D: Novel View Synthesis from Binary SPC via I2I translation7 Jun 2025
- 2025Multi-StyleGS: Stylizing Gaussian Splatting with Multiple Styles7 Jun 2025
- 2025FreeTimeGS: Free Gaussian Primitives at Anytime and Anywhere for Dynamic Scene Reconstruction5 Jun 2025
- 2025Photoreal Scene Reconstruction from an Egocentric Device4 Jun 2025
- 2025Towards In-the-wild 3D Plane Reconstruction from a Single Image3 Jun 2025
- 2025AnySplat: Feed-forward 3D Gaussian Splatting from Unconstrained Views29 May 2025
- 2025Learning Fine-Grained Geometry for Sparse-View Splatting via Cascade Depth Loss28 May 2025
- 2025Styl3R: Instant 3D Stylized Reconstruction for Arbitrary Scenes and Styles27 May 2025
- 2025Intern-GS: Vision Model Guided Sparse-View 3D Gaussian Splatting27 May 2025
50 newest of 672 All 672 (JSON)
- 2024CAT3D: Create Anything in 3D with Multi-View Diffusion Modelscited by 432
- 2023ReconFusion: 3D Reconstruction with Diffusion Priorscited by 318
- 2025Difix3D+: Improving 3D Reconstructions with Single-Step Diffusion Modelscited by 161
- 2024DimensionX: Create Any 3D and 4D Scenes from a Single Image with Controllable Video Diffusioncited by 140
- 2023DiffusioNeRF: Regularizing Neural Radiance Fields with Denoising Diffusion Modelscited by 127
- 2023Consistent View Synthesis with Pose-Guided Diffusion Modelscited by 117
- 20243DGS-Enhancer: Enhancing Unbounded 3D Gaussian Splatting with View-consistent 2D Diffusion Priorscited by 106
- 2024You See it, You Got it: Learning 3D Creation on Pose-Free Videos at Scalecited by 65
- 2023Watch Your Steps: Local Image and Scene Editing by Text Instructionscited by 50
- 2023Posterior Distillation Samplingcited by 46
- 2023Deceptive-NeRF/3DGS: Diffusion-Generated Pseudo-Observations for High-Quality Sparse-View Reconstructioncited by 39
- 2025Taming Video Diffusion Prior with Scene-Grounding Guidance for 3D Gaussian Splatting from Sparse Inputscited by 29
12 most cited of 34 All 34 (JSON)
- 2026FreeFix: Boosting 3D Gaussian Splatting via Fine-Tuning-Free Diffusion Models28 Jan 2026
- 2025CausNVS: Autoregressive Multi-view Diffusion for Flexible 3D Novel View Synthesis8 Sep 2025
- 2025SSGaussian: Semantic-Aware and Structure-Preserving 3D Style Transfer4 Sep 2025
- 2025Taming Video Diffusion Prior with Scene-Grounding Guidance for 3D Gaussian Splatting from Sparse Inputs7 Mar 2025
- 2025Difix3D+: Improving 3D Reconstructions with Single-Step Diffusion Models3 Mar 2025
- 2024You See it, You Got it: Learning 3D Creation on Pose-Free Videos at Scale9 Dec 2024
- 2024How to Use Diffusion Priors under Sparse Views?3 Dec 2024
- 2024Gaussian Scenes: Pose-Free Sparse-View Scene Reconstruction using Depth-Enhanced Diffusion Priors24 Nov 2024
- 2024NeRF Inpainting with Geometric Diffusion Prior and Balanced Score Distillation23 Nov 2024
- 2024Novel View Extrapolation with Video Diffusion Priors21 Nov 2024
- 2024Towards More Accurate Fake Detection on Images Generated from Advanced Generative and Neural Rendering Models13 Nov 2024
- 2024Novel View Synthesis with Pixel-Space Diffusion Models12 Nov 2024
12 newest of 34 All 34 (JSON)
- 2023Enhancing NeRF akin to Enhancing LLMs: Generalizable NeRF Transformer with Mixture-of-View-Expertscited by 27
- 2023ShiftAddViT: Mixture of Multiplication Primitives Towards Efficient Vision Transformercited by 15
- 2024Boost Your NeRF: A Model-Agnostic Mixture of Experts Framework for High Quality and Efficient Renderingcited by 5
- 2024Boost Your NeRF: A Model-Agnostic Mixture of Experts Framework for High Quality and Efficient Rendering15 Jul 2024
- 2023Enhancing NeRF akin to Enhancing LLMs: Generalizable NeRF Transformer with Mixture-of-View-Experts22 Aug 2023
- 2023ShiftAddViT: Mixture of Multiplication Primitives Towards Efficient Vision Transformer10 Jun 2023
- 2023NeuRAD: Neural Rendering for Autonomous Drivingcited by 150
- 2023NeuRAD: Neural Rendering for Autonomous Driving26 Nov 2023
- 2024Chat-Edit-3D: Interactive 3D Scene Editing via Text Promptscited by 19
- 2023Persistent Nature: A Generative Model of Unbounded 3D Worldscited by 44
- 2023Persistent Nature: A Generative Model of Unbounded 3D Worlds23 Mar 2023
- 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,723
- 2021Mip-NeRF 360: Unbounded Anti-Aliased Neural Radiance Fieldscited by 2,032
- 2021PlenOctrees for Real-time Rendering of Neural Radiance Fieldscited by 905
- 2023ScanNet++: A High-Fidelity Dataset of 3D Indoor Scenescited by 764
- 2023K-Planes: Explicit Radiance Fields in Space, Time, and Appearancecited by 746
- 2021MVSNeRF: Fast Generalizable Radiance Field Reconstruction from Multi-View Stereocited by 740
- 2021KiloNeRF: Speeding up Neural Radiance Fields with Thousands of Tiny MLPscited by 673
- 2021UNISURF: Unifying Neural Implicit Surfaces and Radiance Fields for Multi-View Reconstructioncited by 646
- 2021BARF: Bundle-Adjusting Neural Radiance Fieldscited by 642
- 2021RegNeRF: Regularizing Neural Radiance Fields for View Synthesis from Sparse Inputscited by 615
- 2023Nerfstudio: A Modular Framework for Neural Radiance Field Developmentcited by 600
- 2023HexPlane: A Fast Representation for Dynamic Scenescited by 587
12 most cited of 630 All 630 (JSON)
- 2026Recent Advances and Trends in Learning-based 3D Representations3 Jun 2026
- 2026Boosting Zero-Shot 3D Style Transfer with 2D Pre-trained Priors28 May 2026
- 2026Multimodal-Prior-Guided Importance Sampling for Hierarchical Gaussian Splatting in Sparse-View Novel View Synthesis3 Mar 2026
- 2025Content-Aware Texturing for Gaussian Splatting2 Dec 2025
- 2025Clustered Error Correction with Grouped 4D Gaussian Splatting20 Nov 2025
- 2025Initialize to Generalize: A Stronger Initialization Pipeline for Sparse-View 3DGS20 Oct 2025
- 2025Multi-Agent Pose Uncertainty: A Differentiable Rendering Cram'er-Rao Bound18 Oct 2025
- 2025Opacity-Gradient Driven Density Control for Compact and Efficient Few-Shot 3D Gaussian Splatting11 Oct 2025
- 2025Gesplat: Robust Pose-Free 3D Reconstruction via Geometry-Guided Gaussian Splatting11 Oct 2025
- 2025Geometry-Aware Scene Configurations for Novel View Synthesis10 Oct 2025
- 2025D2GS: Depth-and-Density Guided Gaussian Splatting for Stable and Accurate Sparse-View Reconstruction9 Oct 2025
- 2025Learning Neural Exposure Fields for View Synthesis9 Oct 2025
12 newest of 630 All 630 (JSON)