mlsanityData to 7 Oct 2026

Pygmalion Effect in Vision: Image-to-Clay Translation for Reflective Geometry Reconstruction

arXiv 2511.21098 ↗First posted 26 Nov 2025cs.CV cs.AI cs.GRcited by 0

Not on the map. Why?

Abstract (arXiv)

Understanding reflection remains a long-standing challenge in 3D reconstruction due to the entanglement of appearance and geometry under view-dependent reflections. In this work, we present the Pygmalion Effect in Vision, a novel framework that metaphorically "sculpts" reflective objects into clay-like forms through image-to-clay translation. Inspired by the myth of Pygmalion, our method learns to suppress specular cues while preserving intrinsic geometric consistency, enabling robust reconstruction from multi-view images containing complex reflections. Specifically, we introduce a dual-branch network in which a BRDF-based reflective branch is complemented by a clay-guided branch that stabilizes geometry and refines surface normals. The two branches are trained jointly using the synthesized clay-like images, which provide a neutral, reflection-free supervision signal that complements the reflective views. Experiments on both synthetic and real datasets demonstrate substantial improvement in normal accuracy and mesh completeness over existing reflection-handling methods. Beyond technical gains, our framework reveals that seeing by unshining, translating radiance into neutrality, can serve as a powerful inductive bias for reflective object geometry learning.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 32 of its 42 references that are in the map. First posted on arXiv 26 Nov 2025.

Builds on

32 of 42 references.

References · 32

  1. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
  2. 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,510
  3. 2024GPT-4o System Cardcited by 4,467
  4. 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,698
  5. 2021Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fieldscited by 1,957
  6. 2021NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view Reconstructioncited by 1,701
  7. 2022Objaverse: A Universe of Annotated 3D Objectscited by 1,522
  8. 20242D Gaussian Splatting for Geometrically Accurate Radiance Fieldscited by 1,061
  9. 2021Volume Rendering of Neural Implicit Surfacescited by 990
  10. 2025Qwen-Image Technical Reportcited by 973
  11. 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Spacecited by 960
  12. 2018Multimodal Unsupervised Image-to-Image Translationcited by 795
20 more
  1. 2023Objaverse-XL: A Universe of 10M+ 3D Objectscited by 767
  2. 2021UNISURF: Unifying Neural Implicit Surfaces and Radiance Fields for Multi-View Reconstructioncited by 643
  3. 2020Contrastive Learning for Unpaired Image-to-Image Translationcited by 637
  4. 2021Ref-NeRF: Structured View-Dependent Appearance for Neural Radiance Fieldscited by 569
  5. 2022MonoSDF: Exploring Monocular Geometric Cues for Neural Implicit Surface Reconstructioncited by 467
  6. 2023Neuralangelo: High-Fidelity Neural Surface Reconstructioncited by 464
  7. 2024OminiControl: Minimal and Universal Control for Diffusion Transformercited by 334
  8. 2021Neural RGB-D Surface Reconstructioncited by 312
  9. 2022NeuS2: Fast Learning of Neural Implicit Surfaces for Multi-view Reconstructioncited by 311
  10. 2023GaussianShader: 3D Gaussian Splatting with Shading Functions for Reflective Surfacescited by 249
  11. 2023GS-IR: 3D Gaussian Splatting for Inverse Renderingcited by 220
  12. 2023NeRO: Neural Geometry and BRDF Reconstruction of Reflective Objects from Multiview Imagescited by 163
  13. 2023Relightable 3D Gaussians: Realistic Point Cloud Relighting with BRDF Decomposition and Ray Tracingcited by 138
  14. 20243D Gaussian Ray Tracing: Fast Tracing of Particle Scenescited by 138
  15. 2018NSML: Meet the MLaaS platform with a real-world case studycited by 70
  16. 2024Reflective Gaussian Splattingcited by 39
  17. 2024NeRF-Casting: Improved View-Dependent Appearance with Consistent Reflectionscited by 32
  18. 2024Ref-GS: Directional Factorization for 2D Gaussian Splattingcited by 27
  19. 2024TensoSDF: Roughness-aware Tensorial Representation for Robust Geometry and Material Reconstructioncited by 26
  20. 2025GS-2DGS: Geometrically Supervised 2DGS for Reflective Object Reconstructioncited by 11

Built on by

Not cited yet.