mlsanityData to 14 Oct 2026

OMeGa: Joint Optimization of Explicit Meshes and Gaussian Splats for Robust Scene-Level Surface Reconstruction

arXiv 2509.24308 ↗First posted 29 Sep 2025cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Neural rendering with Gaussian splatting has advanced novel view synthesis, and most methods reconstruct surfaces via post-hoc mesh extraction. However, existing methods suffer from two limitations: (i) inaccurate geometry in texture-less indoor regions, and (ii) the decoupling of mesh extraction from optimization, thereby missing the opportunity to leverage mesh geometry to guide splat optimization. In this paper, we present OMeGa, an end-to-end framework that jointly optimizes an explicit triangle mesh and 2D Gaussian splats via a flexible binding strategy, where spatial attributes of Gaussian Splats are expressed in the mesh frame and texture attributes are retained on splats. To further improve reconstruction accuracy, we integrate mesh constraints and monocular normal supervision into the optimization, thereby regularizing geometry learning. In addition, we propose a heuristic, iterative mesh-refinement strategy that splits high-error faces and prunes unreliable ones to further improve the detail and accuracy of the reconstructed mesh. OMeGa achieves state-of-the-art performance on challenging indoor reconstruction benchmarks, reducing Chamfer-L1 by 47.3% over the 2DGS baseline while maintaining competitive novel-view rendering quality. The experimental results demonstrate that OMeGa effectively addresses prior limitations in indoor texture-less reconstruction.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 40 of its 50 references that are in the map. First posted on arXiv 29 Sep 2025.

Builds on

40 of 50 references.

References · 40

  1. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
  2. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
  3. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
  4. 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,723
  5. 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,117
  6. 2021Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fieldscited by 1,964
  7. 2021NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view Reconstructioncited by 1,712
  8. 2021Plenoxels: Radiance Fields without Neural Networkscited by 1,613
  9. 20242D Gaussian Splatting for Geometrically Accurate Radiance Fieldscited by 1,076
  10. 2024Grounding Image Matching in 3D with MASt3Rcited by 983
  11. 2021Direct Voxel Grid Optimization: Super-fast Convergence for Radiance Fields Reconstructioncited by 964
  12. 2021PlenOctrees for Real-time Rendering of Neural Radiance Fieldscited by 905
28 more
  1. 2023ScanNet++: A High-Fidelity Dataset of 3D Indoor Scenescited by 764
  2. 2023Zip-NeRF: Anti-Aliased Grid-Based Neural Radiance Fieldscited by 671
  3. 2023ZoeDepth: Zero-shot Transfer by Combining Relative and Metric Depthcited by 657
  4. 2021UNISURF: Unifying Neural Implicit Surfaces and Radiance Fields for Multi-View Reconstructioncited by 646
  5. 2023SuGaR: Surface-Aligned Gaussian Splatting for Efficient 3D Mesh Reconstruction and High-Quality Mesh Renderingcited by 616
  6. 2021FastNeRF: High-Fidelity Neural Rendering at 200FPScited by 511
  7. 2024Depth Pro: Sharp Monocular Metric Depth in Less Than a Secondcited by 404
  8. 2021Omnidata: A Scalable Pipeline for Making Multi-Task Mid-Level Vision Datasets from 3D Scanscited by 336
  9. 2024PGSR: Planar-based Gaussian Splatting for Efficient and High-Fidelity Surface Reconstructioncited by 285
  10. 2024gsplat: An Open-Source Library for Gaussian Splattingcited by 285
  11. 2024Gaussian Opacity Fields: Efficient Adaptive Surface Reconstruction in Unbounded Scenescited by 232
  12. 2023BakedSDF: Meshing Neural SDFs for Real-Time View Synthesiscited by 221
  13. 2022Geo-Neus: Geometry-Consistent Neural Implicit Surfaces Learning for Multi-view Reconstructioncited by 212
  14. 2024StableNormal: Reducing Diffusion Variance for Stable and Sharp Normalcited by 154
  15. 2024WildGaussians: 3D Gaussian Splatting in the Wildcited by 152
  16. 2024DN-Splatter: Depth and Normal Priors for Gaussian Splatting and Meshingcited by 138
  17. 2022HF-NeuS: Improved Surface Reconstruction Using High-Frequency Detailscited by 121
  18. 2021Estimating and Exploiting the Aleatoric Uncertainty in Surface Normal Estimationcited by 116
  19. 2023Delicate Textured Mesh Recovery from NeRF via Adaptive Surface Refinementcited by 106
  20. 2024GaMeS: Mesh-Based Adapting and Modification of Gaussian Splattingcited by 70
  21. 2023NeRFMeshing: Distilling Neural Radiance Fields into Geometrically-Accurate 3D Meshescited by 53
  22. 2024GaussianRoom: Improving 3D Gaussian Splatting with SDF Guidance and Monocular Cues for Indoor Scene Reconstructioncited by 31
  23. 2024Dynamic Gaussians Mesh: Consistent Mesh Reconstruction from Dynamic Scenescited by 22
  24. 2024MeshGS: Adaptive Mesh-Aligned Gaussian Splatting for High-Quality Renderingcited by 19
  25. 2023MuSHRoom: Multi-Sensor Hybrid Room Dataset for Joint 3D Reconstruction and Novel View Synthesiscited by 12
  26. 2024AGS-Mesh: Adaptive Gaussian Splatting and Meshing with Geometric Priors for Indoor Room Reconstruction Using Smartphonescited by 10
  27. 2024Direct and Adaptable Mesh-Gaussian Scene Reconstruction from Multi-View Imagescited by 9
  28. 20242DGS-Room: Seed-Guided 2D Gaussian Splatting with Geometric Constrains for High-Fidelity Indoor Scene Reconstructioncited by 9

Built on by

Not cited yet.