Mesh2GS: White-Box 3DGS Construction via Plenoptic Sampling
Not on the map. Why?
Abstract (arXiv)
3D Gaussian Splatting (3DGS) has emerged as a promising method for high-quality, real-time 3D reconstruction. To associate 3DGS with mesh representations, existing methods primarily focus on 3DGS-to-mesh reconstruction from multi-view images. In contrast, the problem of converting a mesh into 3DGS has received comparatively less attention. Instead of relying on heuristic strategies that bind 3D Gaussians to the mesh, we propose a novel white-box 3DGS construction framework, termed Mesh2GS, which generates 3DGS directly from mesh geometry based on plenoptic sampling theory, achieving Nyquist-level performance for high-quality global illumination rendering. Firstly, we propose a plenoptic sampling guided 3DGS construction strategy that theoretically derives the minimum sampling rate of the sampled views and the distribution of 3D Gaussians. Second, we propose a novel 3DGS update procedure with albedo--shading decomposition for efficient global-illumination capture. Finally, we introduce a neural illumination enhancement module to handle non-Lambertian effects. Experimental results demonstrate that our method surpasses state-of-the-art baselines and is practically effective for both real-time shared rendering and non-Lambertian effects capturing specular highlights. The project code will be released upon acceptance.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 13 of its 35 references that are in the map. First posted on arXiv 20 Jun 2026.
Builds on
13 of 35 references.
References · 13
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
- 20242D Gaussian Splatting for Geometrically Accurate Radiance Fieldscited by 1,076
- 2023SuGaR: Surface-Aligned Gaussian Splatting for Efficient 3D Mesh Reconstruction and High-Quality Mesh Renderingcited by 616
- 2015DeepStereo: Learning to Predict New Views from the World's Imagerycited by 185
- 2016Learning-Based View Synthesis for Light Field Camerascited by 145
- 20243D Gaussian as a New Era: A Surveycited by 104
- 2021Real-time Neural Radiance Caching for Path Tracingcited by 91
- 2024GaMeS: Mesh-Based Adapting and Modification of Gaussian Splattingcited by 70
- 2017Learning to Synthesize a 4D RGBD Light Field from a Single Imagecited by 60
- 2024Mani-GS: Gaussian Splatting Manipulation with Triangular Meshcited by 22
- 2024MeshGS: Adaptive Mesh-Aligned Gaussian Splatting for High-Quality Renderingcited by 19
1 more
- 2021Dynamic Diffuse Global Illumination Resamplingcited by 1
Built on by
Not cited yet.