mlsanityData to 7 Oct 2026

Reprojection-Guided 3D Gaussian Splatting Diffusion for Weakly Supervised Single-Image Normal Estimation

arXiv 2508.05950 ↗First posted 8 Aug 2025cs.CV cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

We propose CLONE, a Continuous Latent Optimization framework for Normal Estimation via 3D Gaussian splatting. The core idea is to construct an image-geometry-image consistency strategy that unifies explicit geometric representation with differentiable rendering, thereby enabling weakly supervised learning without normal ground truth. Specifically, CLONE comprises four components. First, by introducing a differentiable light interaction model with a learnable modulation kernel, we perform a unified reparameterization of the 3DGS parameter space. Second, the conditional single-step deterministic refinement network integrates denoising architectures with differentiable reprojection constraints to refine the initial normals, thereby adaptively recovering the high-frequency details erased by the inherently smooth Gaussian primitives. Third, the cross-domain gating fusion mechanism adaptively combines the two complementary normal estimates, reconciling the geometrically consistent yet over-smooth 3DGS estimate with the detailed yet potentially geometry-inconsistent refinement. Finally, all components are jointly optimized under a unified photometric reprojection objective with geometric consistency regularizations in a fully differentiable pathway, achieving an end-to-end optimization closed loop without relying on external normal labels.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 22 of its 31 references that are in the map. First posted on arXiv 8 Aug 2025.

Builds on

22 of 31 references.

References · 22

  1. 2020Denoising Diffusion Implicit Modelscited by 9,655
  2. 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,006
  3. 2023Consistency Modelscited by 1,778
  4. 2022Objaverse: A Universe of Annotated 3D Objectscited by 1,522
  5. 2023Zero-1-to-3: Zero-shot One Image to 3D Objectcited by 1,483
  6. 2022Magic3D: High-Resolution Text-to-3D Content Creationcited by 1,285
  7. 2023Wonder3D: Single Image to 3D using Cross-Domain Diffusioncited by 682
  8. 2023SuGaR: Surface-Aligned Gaussian Splatting for Efficient 3D Mesh Reconstruction and High-Quality Mesh Renderingcited by 611
  9. 2022Google Scanned Objects: A High-Quality Dataset of 3D Scanned Household Itemscited by 601
  10. 2014Predicting Depth, Surface Normals and Semantic Labels with a Common Multi-Scale Convolutional Architecturecited by 483
  11. 2024Metric3Dv2: A Versatile Monocular Geometric Foundation Model for Zero-shot Metric Depth and Surface Normal Estimationcited by 389
  12. 2023OmniObject3D: Large-Vocabulary 3D Object Dataset for Realistic Perception, Reconstruction and Generationcited by 324
10 more
  1. 2023RealFusion: 360deg Reconstruction of Any Object from a Single Imagecited by 305
  2. 2023One-2-3-45++: Fast Single Image to 3D Objects with Consistent Multi-View Generation and 3D Diffusioncited by 283
  3. 2019Enforcing geometric constraints of virtual normal for depth predictioncited by 233
  4. 2024StableNormal: Reducing Diffusion Variance for Stable and Sharp Normalcited by 153
  5. 2024Rethinking Inductive Biases for Surface Normal Estimationcited by 122
  6. 2024What Matters When Repurposing Diffusion Models for General Dense Perception Tasks?cited by 74
  7. 2014Designing Deep Networks for Surface Normal Estimationcited by 59
  8. 2024GeoSplatting: Towards Geometry Guided Gaussian Splatting for Physically-based Inverse Renderingcited by 22
  9. 2024Neural LightRig: Unlocking Accurate Object Normal and Material Estimation with Multi-Light Diffusioncited by 19
  10. 2024Normal-GS: 3D Gaussian Splatting with Normal-Involved Renderingcited by 7

Built on by

Not cited yet.