Reprojection-Guided 3D Gaussian Splatting Diffusion for Weakly Supervised Single-Image Normal Estimation
Not on the map. Why?
Abstract (arXiv)
We propose CLONE, a Continuous Latent Optimization framework for Normal Estimation via 3D Gaussian splatting. The core idea is to construct an image-geometry-image consistency strategy that unifies explicit geometric representation with differentiable rendering, thereby enabling weakly supervised learning without normal ground truth. Specifically, CLONE comprises four components. First, by introducing a differentiable light interaction model with a learnable modulation kernel, we perform a unified reparameterization of the 3DGS parameter space. Second, the conditional single-step deterministic refinement network integrates denoising architectures with differentiable reprojection constraints to refine the initial normals, thereby adaptively recovering the high-frequency details erased by the inherently smooth Gaussian primitives. Third, the cross-domain gating fusion mechanism adaptively combines the two complementary normal estimates, reconciling the geometrically consistent yet over-smooth 3DGS estimate with the detailed yet potentially geometry-inconsistent refinement. Finally, all components are jointly optimized under a unified photometric reprojection objective with geometric consistency regularizations in a fully differentiable pathway, achieving an end-to-end optimization closed loop without relying on external normal labels.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 22 of its 31 references that are in the map. First posted on arXiv 8 Aug 2025.
Builds on
22 of 31 references.
References · 22
- 2020Denoising Diffusion Implicit Modelscited by 9,655
- 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,006
- 2023Consistency Modelscited by 1,778
- 2022Objaverse: A Universe of Annotated 3D Objectscited by 1,522
- 2023Zero-1-to-3: Zero-shot One Image to 3D Objectcited by 1,483
- 2022Magic3D: High-Resolution Text-to-3D Content Creationcited by 1,285
- 2023Wonder3D: Single Image to 3D using Cross-Domain Diffusioncited by 682
- 2023SuGaR: Surface-Aligned Gaussian Splatting for Efficient 3D Mesh Reconstruction and High-Quality Mesh Renderingcited by 611
- 2022Google Scanned Objects: A High-Quality Dataset of 3D Scanned Household Itemscited by 601
- 2014Predicting Depth, Surface Normals and Semantic Labels with a Common Multi-Scale Convolutional Architecturecited by 483
- 2024Metric3Dv2: A Versatile Monocular Geometric Foundation Model for Zero-shot Metric Depth and Surface Normal Estimationcited by 389
- 2023OmniObject3D: Large-Vocabulary 3D Object Dataset for Realistic Perception, Reconstruction and Generationcited by 324
10 more
- 2023RealFusion: 360deg Reconstruction of Any Object from a Single Imagecited by 305
- 2023One-2-3-45++: Fast Single Image to 3D Objects with Consistent Multi-View Generation and 3D Diffusioncited by 283
- 2019Enforcing geometric constraints of virtual normal for depth predictioncited by 233
- 2024StableNormal: Reducing Diffusion Variance for Stable and Sharp Normalcited by 153
- 2024Rethinking Inductive Biases for Surface Normal Estimationcited by 122
- 2024What Matters When Repurposing Diffusion Models for General Dense Perception Tasks?cited by 74
- 2014Designing Deep Networks for Surface Normal Estimationcited by 59
- 2024GeoSplatting: Towards Geometry Guided Gaussian Splatting for Physically-based Inverse Renderingcited by 22
- 2024Neural LightRig: Unlocking Accurate Object Normal and Material Estimation with Multi-Light Diffusioncited by 19
- 2024Normal-GS: 3D Gaussian Splatting with Normal-Involved Renderingcited by 7
Built on by
Not cited yet.