InfoNeRF: Ray Entropy Minimization for Few-Shot Neural Volume Rendering
Not on the map. Why?
Abstract (arXiv)
We present an information-theoretic regularization technique for few-shot novel view synthesis based on neural implicit representation. The proposed approach minimizes potential reconstruction inconsistency that happens due to insufficient viewpoints by imposing the entropy constraint of the density in each ray. In addition, to alleviate the potential degenerate issue when all training images are acquired from almost redundant viewpoints, we further incorporate the spatially smoothness constraint into the estimated images by restricting information gains from a pair of rays with slightly different viewpoints. The main idea of our algorithm is to make reconstructed scenes compact along individual rays and consistent across rays in the neighborhood. The proposed regularizers can be plugged into most of existing neural volume rendering techniques based on NeRF in a straightforward way. Despite its simplicity, we achieve consistently improved performance compared to existing neural view synthesis methods by large margins on multiple standard benchmarks.
Key facts. Cited by 180 papers in the map (data through 7 Oct 2026). Builds on 23 of its 42 references that are in the map. First posted on arXiv 31 Dec 2021.
Builds on
23 of 42 references.
References · 23
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 2015Rethinking the Inception Architecture for Computer Visioncited by 5,451
- 2021Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fieldscited by 1,957
- 2020pixelNeRF: Neural Radiance Fields from One or Few Imagescited by 1,574
- 2018Demystifying MMD GANscited by 1,268
- 2021PlenOctrees for Real-time Rendering of Neural Radiance Fieldscited by 904
- 2019PIFu: Pixel-Aligned Implicit Function for High-Resolution Clothed Human Digitizationcited by 818
- 2020Neural Scene Flow Fields for Space-Time View Synthesis of Dynamic Scenescited by 750
- 2021Depth-supervised NeRF: Fewer Views and Faster Training for Freecited by 732
- 2020Neural Body: Implicit Neural Representations with Structured Latent Codes for Novel View Synthesis of Dynamic Humanscited by 634
11 more
- 2020NeRV: Neural Reflectance and Visibility Fields for Relighting and View Synthesiscited by 493
- 2021Putting NeRF on a Diet: Semantically Consistent Few-Shot View Synthesiscited by 464
- 2020Single-View View Synthesis with Multiplane Imagescited by 263
- 2019DeepView: View Synthesis with Learned Gradient Descentcited by 253
- 2021NeX: Real-time View Synthesis with Neural Basis Expansioncited by 215
- 2018Stereo Magnification: Learning View Synthesis using Multiplane Imagescited by 206
- 2015DeepStereo: Learning to Predict New Views from the World's Imagerycited by 185
- 2016View Synthesis by Appearance Flowcited by 172
- 2021Neural Human Performer: Learning Generalizable Radiance Fields for Human Performance Renderingcited by 158
- 2021NeRF--: Neural Radiance Fields Without Known Camera Parameterscited by 155
- 2017Learning to Synthesize a 4D RGBD Light Field from a Single Imagecited by 60
Built on by
Citing papers per year: 2022: 12; 2023: 58; 2024: 66; 2025: 34; 2026: 10.
180 papers.
Sort:
By area:
- 2023Magic123: One Image to High-Quality 3D Object Generation Using Both 2D and 3D Diffusion Priorscited by 395
- 2024DNGaussian: Optimizing Sparse-View 3D Gaussian Radiance Fields with Global-Local Depth Normalizationcited by 256
- 2023SparseNeRF: Distilling Depth Ranking for Few-shot Novel View Synthesiscited by 247
- 2022NoPe-NeRF: Optimising Neural Radiance Field with No Pose Priorcited by 235
- 2022SPARF: Neural Radiance Fields from Sparse and Noisy Posescited by 195
- 2023COLMAP-Free 3D Gaussian Splattingcited by 193
- 2023Depth-Regularized Optimization for 3D Gaussian Splatting in Few-Shot Imagescited by 172
- 2022SinNeRF: Training Neural Radiance Fields on Complex Scenes from a Single Imagecited by 165
- 2023PF-LRM: Pose-Free Large Reconstruction Model for Joint Pose and Shape Predictioncited by 165
- 2025The Unreasonable Effectiveness of Entropy Minimization in LLM Reasoningcited by 160
- 2022D2NeRF: Self-Supervised Decoupling of Dynamic and Static Objects from a Monocular Videocited by 136
- 2024CoR-GS: Sparse-View 3D Gaussian Splatting via Co-Regularizationcited by 120
38 more
- 2024GES: Generalized Exponential Splatting for Efficient Radiance Field Renderingcited by 92
- 2024Fully Explicit Dynamic Gaussian Splattingcited by 75
- 2022Removing Objects From Neural Radiance Fieldscited by 66
- 2023Behind the Scenes: Density Fields for Single View Reconstructioncited by 63
- 2024BAD-Gaussians: Bundle Adjusted Deblur Gaussian Splattingcited by 61
- 2024PF3plat: Pose-Free Feed-Forward 3D Gaussian Splattingcited by 60
- 2023Factor Fields: A Unified Framework for Neural Fields and Beyondcited by 58
- 2023GeCoNeRF: Few-shot Neural Radiance Fields via Geometric Consistencycited by 54
- 20243D Convex Splatting: Radiance Field Rendering with 3D Smooth Convexescited by 50
- 20233D generation on ImageNetcited by 47
- 2023LiDAR-NeRF: Novel LiDAR View Synthesis via Neural Radiance Fieldscited by 46
- 2023Control3D: Towards Controllable Text-to-3D Generationcited by 46
- 2024Generic 3D Diffusion Adapter Using Controlled Multi-View Editingcited by 46
- 2023PERF: Panoramic Neural Radiance Field from a Single Panoramacited by 45
- 2023SimpleNeRF: Regularizing Sparse Input Neural Radiance Fields with Simpler Solutionscited by 44
- 2023Robust e-NeRF: NeRF from Sparse & Noisy Events under Non-Uniform Motioncited by 44
- 2024PhyRecon: Physically Plausible Neural Scene Reconstructioncited by 44
- 2023ViP-NeRF: Visibility Prior for Sparse Input Neural Radiance Fieldscited by 43
- 2024Binocular-Guided 3D Gaussian Splatting with View Consistency for Sparse View Synthesiscited by 41
- 2023MixNeRF: Modeling a Ray with Mixture Density for Novel View Synthesis from Sparse Inputscited by 40
- 2023Deceptive-NeRF/3DGS: Diffusion-Generated Pseudo-Observations for High-Quality Sparse-View Reconstructioncited by 39
- 2022Fast Learning Radiance Fields by Shooting Much Fewer Rayscited by 38
- 2023NeuSurf: On-Surface Priors for Neural Surface Reconstruction from Sparse Input Viewscited by 36
- 2024SpaRP: Fast 3D Object Reconstruction and Pose Estimation from Sparse Viewscited by 35
- 2025Decompositional Neural Scene Reconstruction with Generative Diffusion Priorcited by 30
- 2023FlipNeRF: Flipped Reflection Rays for Few-shot Novel View Synthesiscited by 29
- 2024MVPGS: Excavating Multi-view Priors for Gaussian Splatting from Sparse Input Viewscited by 29
- 2025Taming Video Diffusion Prior with Scene-Grounding Guidance for 3D Gaussian Splatting from Sparse Inputscited by 29
- 2022StructNeRF: Neural Radiance Fields for Indoor Scenes with Structural Hintscited by 28
- 2023ScatterNeRF: Seeing Through Fog with Physically-Based Inverse Neural Renderingcited by 28
- 20244D Gaussian Splatting in the Wild with Uncertainty-Aware Regularizationcited by 28
- 2025FlowR: Flowing from Sparse to Dense 3D Reconstructionscited by 28
- 2022ParticleNeRF: A Particle-Based Encoding for Online Neural Radiance Fieldscited by 27
- 2023DaRF: Boosting Radiance Fields from Sparse Inputs with Monocular Depth Adaptationcited by 25
- 2023ZeroRF: Fast Sparse View 360deg Reconstruction with Zero Pretrainingcited by 24
- 2025LongSplat: Robust Unposed 3D Gaussian Splatting for Casual Long Videoscited by 23
- 2023PanoGRF: Generalizable Spherical Radiance Fields for Wide-baseline Panoramascited by 22
- 2024SparseCraft: Few-Shot Neural Reconstruction through Stereopsis Guided Geometric Linearizationcited by 19
50 most cited of 180 All 180 (JSON)
- 2026Is Gaussian Splatting Becoming Neural Again? A Taxonomy and Controlled Study of Learned Parameterization11 Sep 2026
- 2026RouteBridge: Reliability-Routed Bidirectional Distillation Between Neural Radiance Fields and 3D Gaussian Splatting9 Sep 2026
- 2026Latent Riemannian Flow Matching for Geometry-Grounded 3D Foundation Models21 Jul 2026
- 2026VisDom: Sparse Novel View Synthesis with Visible Domain Constraint18 Jun 2026
- 2026Learning Global Motion with Compact Gaussians for Feed-Forward 4D Reconstruction29 May 2026
- 2026SurfelSplat: Learning Efficient and Generalizable Gaussian Surfel Representations for Sparse-View Surface Reconstruction9 Apr 2026
- 2026GP-4DGS: Probabilistic 4D Gaussian Splatting from Monocular Video via Variational Gaussian Processes3 Apr 2026
- 2026GRVS: a Generalizable and Recurrent Approach to Monocular Dynamic View Synthesis31 Mar 2026
- 2026NERFIFY: A Multi-Agent Framework for Turning NeRF Papers into Code28 Feb 2026
- 2026EdgeNeRF: Edge-Guided Regularization for Neural Radiance Fields from Sparse Views4 Jan 2026
- 2025Model Whisper: Steering Vectors Unlock Large Language Models' Potential in Test-time4 Dec 2025
- 2025OUGS: Active View Selection via Object-aware Uncertainty Estimation in 3DGS12 Nov 2025
38 more
- 2025Uncertainty Matters in Dynamic Gaussian Splatting for Monocular 4D Reconstruction14 Oct 2025
- 2025MS-GS: Multi-Appearance Sparse-View 3D Gaussian Splatting in the Wild19 Sep 2025
- 2025RGB-Only Supervised Camera Parameter Optimization in Dynamic Scenes18 Sep 2025
- 2025LongSplat: Robust Unposed 3D Gaussian Splatting for Casual Long Videos19 Aug 2025
- 2025NeRF Is a Valuable Assistant for 3D Gaussian Splatting31 Jul 2025
- 2025UFV-Splatter: Pose-Free Feed-Forward 3D Gaussian Splatting Adapted to Unfavorable Views30 Jul 2025
- 2025Sparse-View 3D Reconstruction: Recent Advances and Open Challenges22 Jul 2025
- 2025TimeNeRF: Building Generalizable Neural Radiance Fields across Time from Few-Shot Input Views18 Jul 2025
- 2025A View-consistent Sampling Method for Regularized Training of Neural Radiance Fields6 Jul 2025
- 2025Aligned Novel View Image and Geometry Synthesis via Cross-modal Attention Instillation13 Jun 2025
- 2025PhysGaia: A Physics-Aware Benchmark with Multi-Body Interactions for Dynamic Novel View Synthesis3 Jun 2025
- 2025M2SVid: End-to-End Inpainting and Refinement for Monocular-to-Stereo Video Conversion22 May 2025
- 2025The Unreasonable Effectiveness of Entropy Minimization in LLM Reasoning21 May 2025
- 2025SpatialCrafter: Unleashing the Imagination of Video Diffusion Models for Scene Reconstruction from Limited Observations17 May 2025
- 2025MutualNeRF: Improve the Performance of NeRF under Limited Samples with Mutual Information Theory16 May 2025
- 2025SparSplat: Fast Multi-View Reconstruction with Generalizable 2D Gaussian Splatting4 May 2025
- 2025LIRM: Large Inverse Rendering Model for Progressive Reconstruction of Shape, Materials and View-dependent Radiance Fields28 Apr 2025
- 2025Rendering Anywhere You See: Renderability Field-guided Gaussian Splatting27 Apr 2025
- 2025FlowR: Flowing from Sparse to Dense 3D Reconstructions2 Apr 2025
- 2025CoMapGS: Covisibility Map-based Gaussian Splatting for Sparse Novel View Synthesis25 Mar 2025
- 2025SparseGS-W: Sparse-View 3D Gaussian Splatting in the Wild with Generative Priors25 Mar 2025
- 2025ClaraVid: A Holistic Scene Reconstruction Benchmark From Aerial Perspective With Delentropy-Based Complexity Profiling22 Mar 2025
- 2025Decompositional Neural Scene Reconstruction with Generative Diffusion Prior19 Mar 2025
- 2025Improving Geometric Consistency for 360-Degree Neural Radiance Fields in Indoor Scenarios17 Mar 2025
- 2025DivCon-NeRF: Diverse and Consistent Ray Augmentation for Few-Shot NeRF17 Mar 2025
- 2025Close-up-GS: Enhancing Close-Up View Synthesis in 3D Gaussian Splatting with Progressive Self-Training12 Mar 2025
- 2025Taming Video Diffusion Prior with Scene-Grounding Guidance for 3D Gaussian Splatting from Sparse Inputs7 Mar 2025
- 2025Empowering Sparse-Input Neural Radiance Fields with Dual-Level Semantic Guidance from Dense Novel Views4 Mar 2025
- 2025FourieRF: Few-Shot NeRFs via Progressive Fourier Frequency Control3 Feb 2025
- 2025Neural Radiance Fields for the Real World: A Survey22 Jan 2025
- 2025DWTNeRF: Boosting Few-shot Neural Radiance Fields via Discrete Wavelet Transform22 Jan 2025
- 2025RDG-GS: Relative Depth Guidance with Gaussian Splatting for Real-time Sparse-View 3D Rendering19 Jan 2025
- 2024Incremental Multi-Scene Modeling via Continual Neural Graphics Primitives29 Nov 2024
- 2024Surf-NeRF: Surface Regularised Neural Radiance Fields27 Nov 2024
- 20243D Convex Splatting: Radiance Field Rendering with 3D Smooth Convexes22 Nov 2024
- 2024SPARS3R: Semantic Prior Alignment and Regularization for Sparse 3D Reconstruction15 Nov 2024
- 20244D Gaussian Splatting in the Wild with Uncertainty-Aware Regularization13 Nov 2024
- 2024Structure Consistent Gaussian Splatting with Matching Prior for Few-shot Novel View Synthesis6 Nov 2024
50 newest of 180 All 180 (JSON)
- 2023Magic123: One Image to High-Quality 3D Object Generation Using Both 2D and 3D Diffusion Priorscited by 395
- 2023Control3D: Towards Controllable Text-to-3D Generationcited by 46
- 2024Generic 3D Diffusion Adapter Using Controlled Multi-View Editingcited by 46
- 2023Deceptive-NeRF/3DGS: Diffusion-Generated Pseudo-Observations for High-Quality Sparse-View Reconstructioncited by 39
- 2024SpaRP: Fast 3D Object Reconstruction and Pose Estimation from Sparse Viewscited by 35
- 2025Decompositional Neural Scene Reconstruction with Generative Diffusion Priorcited by 30
- 2025Taming Video Diffusion Prior with Scene-Grounding Guidance for 3D Gaussian Splatting from Sparse Inputscited by 29
- 20243D-Adapter: Geometry-Consistent Multi-View Diffusion for High-Quality 3D Generationcited by 19
- 2025SpatialCrafter: Unleashing the Imagination of Video Diffusion Models for Scene Reconstruction from Limited Observationscited by 16
- 2023Free-Editor: Zero-shot Text-driven 3D Scene Editingcited by 14
- 2023iFusion: Inverting Diffusion for Pose-Free Reconstruction from Sparse Viewscited by 14
- 2023Editing 3D Scenes via Text Prompts without Retrainingcited by 8
12 most cited of 17 All 17 (JSON)
- 2026Latent Riemannian Flow Matching for Geometry-Grounded 3D Foundation Models21 Jul 2026
- 2025SpatialCrafter: Unleashing the Imagination of Video Diffusion Models for Scene Reconstruction from Limited Observations17 May 2025
- 2025SparseGS-W: Sparse-View 3D Gaussian Splatting in the Wild with Generative Priors25 Mar 2025
- 2025Decompositional Neural Scene Reconstruction with Generative Diffusion Prior19 Mar 2025
- 2025Taming Video Diffusion Prior with Scene-Grounding Guidance for 3D Gaussian Splatting from Sparse Inputs7 Mar 2025
- 20243D-Adapter: Geometry-Consistent Multi-View Diffusion for High-Quality 3D Generation24 Oct 2024
- 2024SpaRP: Fast 3D Object Reconstruction and Pose Estimation from Sparse Views19 Aug 2024
- 2024Geometry-Aware Score Distillation via 3D Consistent Noising and Gradient Consistency Modeling24 Jun 2024
- 2024X-Diffusion: Generating Detailed 3D MRI Volumes From a Single Image Using Cross-Sectional Diffusion Models30 Apr 2024
- 2024Generic 3D Diffusion Adapter Using Controlled Multi-View Editing18 Mar 2024
- 2023iFusion: Inverting Diffusion for Pose-Free Reconstruction from Sparse Views28 Dec 2023
- 2023Free-Editor: Zero-shot Text-driven 3D Scene Editing21 Dec 2023
12 newest of 17 All 17 (JSON)
- 2024DNGaussian: Optimizing Sparse-View 3D Gaussian Radiance Fields with Global-Local Depth Normalizationcited by 256
- 2023SparseNeRF: Distilling Depth Ranking for Few-shot Novel View Synthesiscited by 247
- 2022NoPe-NeRF: Optimising Neural Radiance Field with No Pose Priorcited by 235
- 2022SPARF: Neural Radiance Fields from Sparse and Noisy Posescited by 195
- 2023COLMAP-Free 3D Gaussian Splattingcited by 193
- 2023Depth-Regularized Optimization for 3D Gaussian Splatting in Few-Shot Imagescited by 172
- 2022SinNeRF: Training Neural Radiance Fields on Complex Scenes from a Single Imagecited by 165
- 2023PF-LRM: Pose-Free Large Reconstruction Model for Joint Pose and Shape Predictioncited by 165
- 2022D2NeRF: Self-Supervised Decoupling of Dynamic and Static Objects from a Monocular Videocited by 136
- 2024CoR-GS: Sparse-View 3D Gaussian Splatting via Co-Regularizationcited by 120
- 2024GES: Generalized Exponential Splatting for Efficient Radiance Field Renderingcited by 92
- 2024Fully Explicit Dynamic Gaussian Splattingcited by 75
12 most cited of 160 All 160 (JSON)
- 2026Is Gaussian Splatting Becoming Neural Again? A Taxonomy and Controlled Study of Learned Parameterization11 Sep 2026
- 2026RouteBridge: Reliability-Routed Bidirectional Distillation Between Neural Radiance Fields and 3D Gaussian Splatting9 Sep 2026
- 2026VisDom: Sparse Novel View Synthesis with Visible Domain Constraint18 Jun 2026
- 2026Learning Global Motion with Compact Gaussians for Feed-Forward 4D Reconstruction29 May 2026
- 2026SurfelSplat: Learning Efficient and Generalizable Gaussian Surfel Representations for Sparse-View Surface Reconstruction9 Apr 2026
- 2026GP-4DGS: Probabilistic 4D Gaussian Splatting from Monocular Video via Variational Gaussian Processes3 Apr 2026
- 2026GRVS: a Generalizable and Recurrent Approach to Monocular Dynamic View Synthesis31 Mar 2026
- 2026EdgeNeRF: Edge-Guided Regularization for Neural Radiance Fields from Sparse Views4 Jan 2026
- 2025OUGS: Active View Selection via Object-aware Uncertainty Estimation in 3DGS12 Nov 2025
- 2025Uncertainty Matters in Dynamic Gaussian Splatting for Monocular 4D Reconstruction14 Oct 2025
- 2025MS-GS: Multi-Appearance Sparse-View 3D Gaussian Splatting in the Wild19 Sep 2025
- 2025RGB-Only Supervised Camera Parameter Optimization in Dynamic Scenes18 Sep 2025
12 newest of 160 All 160 (JSON)