mlsanityData to 7 Oct 2026

Learn2Splat: Extending the Horizon of Learned 3DGS Optimization

arXiv 2605.15760 ↗First posted 15 May 2026cs.CVcited by 1

Not on the map. Why?

Abstract (arXiv)

3D Gaussian Splatting (3DGS) optimization is most commonly performed using general-purpose first-order optimizers such as Adam or SGD. Although robust across scenes, they update each parameter independently without exploiting the structural and spatial relationships among Gaussians, which slows convergence. Recent works introduced learned optimizers that predict correlated updates informed by inter-parameter and inter-Gaussian dependencies. However, those are trained for a fixed number of optimization iterations and rely on manually scheduled learning rates to avoid degradation. In this paper, we introduce Learn2Splat, a learned optimizer for 3DGS that avoids degradation over extended optimization horizons without auxiliary mechanisms. To enable this, we propose a meta-learning scheme that extends the optimization horizon via a checkpoint buffer and an optimizer rollout strategy, combined with an architecture that encodes gradient scale information in its latent states. Results show higher novel view synthesis quality at equal wall-clock time, while remaining stable over long horizons, with zero-shot generalization to unseen datasets and settings. To support our findings, we build a unified framework to train and evaluate learned and standard optimizers across sparse and dense view settings. Code and models will be released publicly. Our project page is available at https://autonomousvision.github.io/learn2splat .

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 46 of its 63 references that are in the map. First posted on arXiv 15 May 2026.

Builds on

46 of 63 references.

References · 46

  1. 2017Attention Is All You Needcited by 59,932
  2. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  3. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
  4. 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,736
  5. 2021Mip-NeRF 360: Unbounded Anti-Aliased Neural Radiance Fieldscited by 2,013
  6. 2020Point Transformercited by 1,462
  7. 2023Scaffold-GS: Structured 3D Gaussians for View-Adaptive Renderingcited by 684
  8. 2023pixelSplat: 3D Gaussian Splats from Image Pairs for Scalable Generalizable 3D Reconstructioncited by 668
  9. 2025Depth Anything 3: Recovering the Visual Space from Any Viewscited by 626
  10. 2016Learning to learn by gradient descent by gradient descentcited by 616
  11. 2023Point Transformer V3: Simpler, Faster, Strongercited by 579
  12. 2024MVSplat: Efficient 3D Gaussian Splatting from Sparse Multi-View Imagescited by 553
34 more
  1. 2023DL3DV-10K: A Large-Scale Scene Dataset for Deep Learning-based 3D Visioncited by 514
  2. 2022Point Transformer V2: Grouped Vector Attention and Partition-based Poolingcited by 384
  3. 2023Splatter Image: Ultra-Fast Single-View 3D Reconstructioncited by 359
  4. 2024gsplat: An Open-Source Library for Gaussian Splattingcited by 279
  5. 2024DepthSplat: Connecting Gaussian Splatting and Depthcited by 275
  6. 2019DeepView: View Synthesis with Learned Gradient Descentcited by 253
  7. 2025AnySplat: Feed-forward 3D Gaussian Splatting from Unconstrained Viewscited by 234
  8. 2024Mini-Splatting: Representing Scenes with a Constrained Number of Gaussianscited by 208
  9. 2021Learning to Optimize: A Primer and A Benchmarkcited by 206
  10. 2024Taming 3DGS: High-Quality Radiance Fields with Limited Resourcescited by 198
  11. 2024Revising Densification in Gaussian Splattingcited by 127
  12. 2017Learned Optimizers that Scale and Generalizecited by 109
  13. 2024MVSGaussian: Fast Generalizable Gaussian Splatting Reconstruction from Multi-View Stereocited by 86
  14. 2017Neural Optimizer Search with Reinforcement Learningcited by 82
  15. 2025WorldMirror: Universal 3D World Reconstruction with Any-Prior Promptingcited by 60
  16. 2020Tasks, stability, architecture, and compute: Training more effective learned optimizers, and using them to train themselvescited by 57
  17. 2022VeLO: Training Versatile Learned Optimizers by Scaling Upcited by 57
  18. 20243DGS-LM: Faster Gaussian-Splatting Optimization with Levenberg-Marquardtcited by 42
  19. 2025VolSplat: Rethinking Feed-Forward 3D Gaussian Splatting with Voxel-Aligned Predictioncited by 41
  20. 2025FastGS: Training 3D Gaussian Splatting in 100 Secondscited by 39
  21. 2022Learned Vertex Descent: A New Direction for 3D Human Model Fittingcited by 37
  22. 2024G3R: Gradient Guided Generalizable Reconstructioncited by 29
  23. 2025ZPressor: Bottleneck-Aware Compression for Scalable Feed-Forward 3DGScited by 29
  24. 2025EDGS: Eliminating Densification for Efficient Convergence of 3DGScited by 21
  25. 2018Taking a Deeper Look at the Inverse Compositional Algorithmcited by 20
  26. 20253DGS2: Near Second-order Converging 3D Gaussian Splattingcited by 19
  27. 2025ReSplat: Learning Recurrent Gaussian Splattingcited by 12
  28. 2025QuickSplat: Fast 3D Surface Reconstruction via Learned Gaussian Initializationcited by 11
  29. 2025SOGS: Second-Order Anchor for Advanced 3D Gaussian Splattingcited by 10
  30. 2025Off The Grid: Detection of Primitives for Feed-Forward 3D Gaussian Splattingcited by 8
  31. 2025Matrix-free Second-order Optimization of Gaussian Splats with Residual Samplingcited by 5
  32. 2026GIFSplat: Generative Prior-Guided Iterative Feed-Forward 3D Gaussian Splatting from Sparse Viewscited by 4
  33. 2026Beyond Heuristics: Learnable Density Control for 3D Gaussian Splattingcited by 2
  34. 2023RealLiFe: Real-Time Light Field Reconstruction via Hierarchical Sparse Gradient Descentcited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.