mlsanityData to 7 Oct 2026

Improving Sparse-View 3DGS Generalization via Flat Minima Optimization

arXiv 2607.00885 ↗First posted 1 Jul 2026cs.CV cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Recent advances in neural rendering have established 3D Gaussian Splatting (3DGS) as a highly efficient representation for novel view synthesis, enabling fast training and real-time rendering with strong fidelity. However, when supervision is limited to sparse input views, 3DGS tends to overfit to the observed images and generalize poorly to unseen viewpoints. We address this challenge from the perspective of flat minima (FM) optimization, which seeks solutions that remain stable under small parameter perturbations. Viewing Gaussian parameters as trainable weights, we adapt FM principles to the geometric and dynamic nature of 3DGS with a lightweight training framework. Our method regularizes optimization with controlled Gaussian perturbations that account for each Gaussian's anisotropy and the training progress, preserving fine details while improving robustness to sparse-view overfitting. To further stabilize this flat minima optimization process, we introduce periodic reinitialization, which temporarily returns non-positional parameters to their initial states for a short window. Together, these techniques integrate seamlessly into existing 3DGS pipelines without architectural changes. Experiments on LLFF and Mip-NeRF360 datasets demonstrate improved quantitative metrics and perceptual quality under sparse-view supervision, producing reconstructions that are sharper, more stable, and better generalized to novel viewpoints.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 29 of its 37 references that are in the map. First posted on arXiv 1 Jul 2026.

Builds on

29 of 37 references.

References · 29

  1. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  2. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
  3. 2021Mip-NeRF 360: Unbounded Anti-Aliased Neural Radiance Fieldscited by 2,013
  4. 2020Sharpness-Aware Minimization for Efficiently Improving Generalizationcited by 1,404
  5. 2016On Large-Batch Training for Deep Learning: Generalization Gap and Sharp Minimacited by 1,337
  6. 2017Sharp Minima Can Generalize For Deep Netscited by 462
  7. 2023FSGS: Real-Time Few-shot View Synthesis using Gaussian Splattingcited by 278
  8. 2024DNGaussian: Optimizing Sparse-View 3D Gaussian Radiance Fields with Global-Local Depth Normalizationcited by 256
  9. 2025AnySplat: Feed-forward 3D Gaussian Splatting from Unconstrained Viewscited by 234
  10. 20243D Gaussian Splatting as Markov Chain Monte Carlocited by 210
  11. 2023Depth-Regularized Optimization for 3D Gaussian Splatting in Few-Shot Imagescited by 172
  12. 2025Difix3D+: Improving 3D Reconstructions with Single-Step Diffusion Modelscited by 160
17 more
  1. 2023SparseGS: Sparse View Synthesis using 3D Gaussian Splattingcited by 134
  2. 2024CoR-GS: Sparse-View 3D Gaussian Splatting via Co-Regularizationcited by 120
  3. 2025DropGaussian: Structural Regularization for Sparse-view Gaussian Splattingcited by 65
  4. 2022Low-Pass Filtering SGD for Recovering Flat Optima in the Deep Learning Optimization Landscapecited by 39
  5. 2024Effective Rank Analysis and Regularization for Enhanced 3D Gaussian Splattingcited by 29
  6. 2025Taming Video Diffusion Prior with Scene-Grounding Guidance for 3D Gaussian Splatting from Sparse Inputscited by 29
  7. 2025DropoutGS: Dropping Out Gaussians for Better Sparse-view Renderingcited by 29
  8. 2025Sparse2DGS: Geometry-Prioritized Gaussian Splatting for Surface Reconstruction from Sparse Viewscited by 25
  9. 2024MAtCha Gaussians: Atlas of Charts for High-Quality Geometry and Photorealism From Sparse Viewscited by 21
  10. 2024Structure Consistent Gaussian Splatting with Matching Prior for Few-shot Novel View Synthesiscited by 18
  11. 2024Self-Ensembling Gaussian Splatting for Few-Shot Novel View Synthesiscited by 14
  12. 2024Revisiting Random Weight Perturbation for Efficiently Improving Generalizationcited by 13
  13. 2025Quantifying and Alleviating Co-Adaptation in Sparse-View 3D Gaussian Splattingcited by 12
  14. 2025D2GS: Depth-and-Density Guided Gaussian Splatting for Stable and Accurate Sparse-View Reconstructioncited by 10
  15. 2022Efficient Generalization Improvement Guided by Random Weight Perturbationcited by 8
  16. 2025AD-GS: Alternating Densification for Sparse-Input 3D Gaussian Splattingcited by 8
  17. 2025UGOD: Uncertainty-Guided Differentiable Opacity and Soft Dropout for Enhanced Sparse-View 3DGScited by 3

Built on by

Not cited yet.