# Floaters No More: Radiance Field Gradient Scaling for Improved Near-Camera Training

arXiv: https://arxiv.org/abs/2305.02756 · HTML: https://mlsanity.com/paper/2305.02756/

## Key facts

- Cited by 25 papers in the map (data through 14 Oct 2026).
- Builds on 24 of its 32 references that are in the map.
- First posted on arXiv 4 May 2023.

## Builds on (most cited first, 24 of 24)

- [The Unreasonable Effectiveness of Deep Features as a Perceptual Metric](https://mlsanity.com/paper/1801.03924/) (2018)
- [Instant Neural Graphics Primitives with a Multiresolution Hash Encoding](https://mlsanity.com/paper/2201.05989/) (2022)
- [Mip-NeRF 360: Unbounded Anti-Aliased Neural Radiance Fields](https://mlsanity.com/paper/2111.12077/) (2021)
- [Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fields](https://mlsanity.com/paper/2103.13415/) (2021)
- [Plenoxels: Radiance Fields without Neural Networks](https://mlsanity.com/paper/2112.05131/) (2021)
- [TensoRF: Tensorial Radiance Fields](https://mlsanity.com/paper/2203.09517/) (2022)
- [Direct Voxel Grid Optimization: Super-fast Convergence for Radiance Fields Reconstruction](https://mlsanity.com/paper/2111.11215/) (2021)
- [PlenOctrees for Real-time Rendering of Neural Radiance Fields](https://mlsanity.com/paper/2103.14024/) (2021)
- [NeRF++: Analyzing and Improving Neural Radiance Fields](https://mlsanity.com/paper/2010.07492/) (2020)
- [KiloNeRF: Speeding up Neural Radiance Fields with Thousands of Tiny MLPs](https://mlsanity.com/paper/2103.13744/) (2021)
- [Ref-NeRF: Structured View-Dependent Appearance for Neural Radiance Fields](https://mlsanity.com/paper/2112.03907/) (2021)
- [Baking Neural Radiance Fields for Real-Time View Synthesis](https://mlsanity.com/paper/2103.14645/) (2021)
- [Advances in Neural Rendering](https://mlsanity.com/paper/2111.05849/) (2021)
- [NeRF in the Dark: High Dynamic Range View Synthesis from Noisy Raw Images](https://mlsanity.com/paper/2111.13679/) (2021)
- [Neural Point-Based Graphics](https://mlsanity.com/paper/1906.08240/) (2019)
- [FreeNeRF: Improving Few-shot Neural Rendering with Free Frequency Regularization](https://mlsanity.com/paper/2303.07418/) (2023)
- [Dense Depth Priors for Neural Radiance Fields from Sparse Input Views](https://mlsanity.com/paper/2112.03288/) (2021)
- [Free View Synthesis](https://mlsanity.com/paper/2008.05511/) (2020)
- [Point-Based Neural Rendering with Per-View Optimization](https://mlsanity.com/paper/2109.02369/) (2021)
- [Stable View Synthesis](https://mlsanity.com/paper/2011.07233/) (2020)
- [Neural Point Catacaustics for Novel-View Synthesis of Reflections](https://mlsanity.com/paper/2301.01087/) (2023)
- [Improved Direct Voxel Grid Optimization for Radiance Fields Reconstruction](https://mlsanity.com/paper/2206.05085/) (2022)
- [Free-viewpoint Indoor Neural Relighting from Multi-view Stereo](https://mlsanity.com/paper/2106.13299/) (2021)
- [NPBG++: Accelerating Neural Point-Based Graphics](https://mlsanity.com/paper/2203.13318/) (2022)

## Built on by (most cited first, 25 of 25)

- [Pixel-GS: Density Control with Pixel-aware Gradient for 3D Gaussian Splatting](https://mlsanity.com/paper/2403.15530/) (2024)
- [GenFusion: Closing the Loop between Reconstruction and Generation via Videos](https://mlsanity.com/paper/2503.21219/) (2025)
- [A Diffusion Approach to Radiance Field Relighting using Multi-Illumination Synthesis](https://mlsanity.com/paper/2409.08947/) (2024)
- [VR-Splatting: Foveated Radiance Field Rendering via 3D Gaussian Splatting and Neural Points](https://mlsanity.com/paper/2410.17932/) (2024)
- [Fast View Synthesis of Casual Videos with Soup-of-Planes](https://mlsanity.com/paper/2312.02135/) (2023)
- [Gaussian in the Dark: Real-Time View Synthesis From Inconsistent Dark Images Using Gaussian Splatting](https://mlsanity.com/paper/2408.09130/) (2024)
- [PyNeRF: Pyramidal Neural Radiance Fields](https://mlsanity.com/paper/2312.00252/) (2023)
- [ExtraNeRF: Visibility-Aware View Extrapolation of Neural Radiance Fields with Diffusion Models](https://mlsanity.com/paper/2406.06133/) (2024)
- [TrackNeRF: Bundle Adjusting NeRF from Sparse and Noisy Views via Feature Tracks](https://mlsanity.com/paper/2408.10739/) (2024)
- [AquaNeRF: Neural Radiance Fields in Underwater Media with Distractor Removal](https://mlsanity.com/paper/2502.16351/) (2025)
- [Stochastic Preconditioning for Neural Field Optimization](https://mlsanity.com/paper/2505.20473/) (2025)
- [LAENeRF: Local Appearance Editing for Neural Radiance Fields](https://mlsanity.com/paper/2312.09913/) (2023)
- [G3DR: Generative 3D Reconstruction in ImageNet](https://mlsanity.com/paper/2403.00939/) (2024)
- [Sparse-DeRF: Deblurred Neural Radiance Fields from Sparse View](https://mlsanity.com/paper/2407.06613/) (2024)
- [Surface-SOS: Self-Supervised Object Segmentation via Neural Surface Representation](https://mlsanity.com/paper/2501.09947/) (2025)
- [Fast Sparse View Guided NeRF Update for Object Reconfigurations](https://mlsanity.com/paper/2403.11024/) (2024)
- [UnMix-NeRF: Spectral Unmixing Meets Neural Radiance Fields](https://mlsanity.com/paper/2506.21884/) (2025)
- [Simple-RF: Regularizing Sparse Input Radiance Fields with Simpler Solutions](https://mlsanity.com/paper/2404.19015/) (2024)
- [FourieRF: Few-Shot NeRFs via Progressive Fourier Frequency Control](https://mlsanity.com/paper/2502.01405/) (2025)
- [Physically Inspired Gaussian Splatting for HDR Novel View Synthesis](https://mlsanity.com/paper/2603.28020/) (2026)
- [RANRAC: Robust Neural Scene Representations via Random Ray Consensus](https://mlsanity.com/paper/2312.09780/) (2023)
- [Surface-Based Visibility-Guided Uncertainty for Continuous Active 3D Neural Reconstruction](https://mlsanity.com/paper/2405.02568/) (2024)
- [GAS-NeRF: Geometry-Aware Stylization of Dynamic Radiance Fields](https://mlsanity.com/paper/2503.08483/) (2025)
- [NeuSEditor: From Multi-View Images to Text-Guided Neural Surface Edits](https://mlsanity.com/paper/2505.10827/) (2025)
- [Two-View Accumulation as the Primary Training Lever for Hybrid-Capture Gaussian Splatting: A Variance-Decomposition View of When Gradient Surgery Helps](https://mlsanity.com/paper/2605.00052/) (2026)

## Abstract (arXiv)

NeRF acquisition typically requires careful choice of near planes for the different cameras or suffers from background collapse, creating floating artifacts on the edges of the captured scene. The key insight of this work is that background collapse is caused by a higher density of samples in regions near cameras. As a result of this sampling imbalance, near-camera volumes receive significantly more gradients, leading to incorrect density buildup. We propose a gradient scaling approach to counter-balance this sampling imbalance, removing the need for near planes, while preventing background collapse. Our method can be implemented in a few lines, does not induce any significant overhead, and is compatible with most NeRF implementations.
