Pygmalion Effect in Vision: Image-to-Clay Translation for Reflective Geometry Reconstruction
Not on the map. Why?
Abstract (arXiv)
Understanding reflection remains a long-standing challenge in 3D reconstruction due to the entanglement of appearance and geometry under view-dependent reflections. In this work, we present the Pygmalion Effect in Vision, a novel framework that metaphorically "sculpts" reflective objects into clay-like forms through image-to-clay translation. Inspired by the myth of Pygmalion, our method learns to suppress specular cues while preserving intrinsic geometric consistency, enabling robust reconstruction from multi-view images containing complex reflections. Specifically, we introduce a dual-branch network in which a BRDF-based reflective branch is complemented by a clay-guided branch that stabilizes geometry and refines surface normals. The two branches are trained jointly using the synthesized clay-like images, which provide a neutral, reflection-free supervision signal that complements the reflective views. Experiments on both synthetic and real datasets demonstrate substantial improvement in normal accuracy and mesh completeness over existing reflection-handling methods. Beyond technical gains, our framework reveals that seeing by unshining, translating radiance into neutrality, can serve as a powerful inductive bias for reflective object geometry learning.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 32 of its 42 references that are in the map. First posted on arXiv 26 Nov 2025.
Builds on
32 of 42 references.
References · 32
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
- 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,510
- 2024GPT-4o System Cardcited by 4,467
- 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,698
- 2021Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fieldscited by 1,957
- 2021NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view Reconstructioncited by 1,701
- 2022Objaverse: A Universe of Annotated 3D Objectscited by 1,522
- 20242D Gaussian Splatting for Geometrically Accurate Radiance Fieldscited by 1,061
- 2021Volume Rendering of Neural Implicit Surfacescited by 990
- 2025Qwen-Image Technical Reportcited by 973
- 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Spacecited by 960
- 2018Multimodal Unsupervised Image-to-Image Translationcited by 795
20 more
- 2023Objaverse-XL: A Universe of 10M+ 3D Objectscited by 767
- 2021UNISURF: Unifying Neural Implicit Surfaces and Radiance Fields for Multi-View Reconstructioncited by 643
- 2020Contrastive Learning for Unpaired Image-to-Image Translationcited by 637
- 2021Ref-NeRF: Structured View-Dependent Appearance for Neural Radiance Fieldscited by 569
- 2022MonoSDF: Exploring Monocular Geometric Cues for Neural Implicit Surface Reconstructioncited by 467
- 2023Neuralangelo: High-Fidelity Neural Surface Reconstructioncited by 464
- 2024OminiControl: Minimal and Universal Control for Diffusion Transformercited by 334
- 2021Neural RGB-D Surface Reconstructioncited by 312
- 2022NeuS2: Fast Learning of Neural Implicit Surfaces for Multi-view Reconstructioncited by 311
- 2023GaussianShader: 3D Gaussian Splatting with Shading Functions for Reflective Surfacescited by 249
- 2023GS-IR: 3D Gaussian Splatting for Inverse Renderingcited by 220
- 2023NeRO: Neural Geometry and BRDF Reconstruction of Reflective Objects from Multiview Imagescited by 163
- 2023Relightable 3D Gaussians: Realistic Point Cloud Relighting with BRDF Decomposition and Ray Tracingcited by 138
- 20243D Gaussian Ray Tracing: Fast Tracing of Particle Scenescited by 138
- 2018NSML: Meet the MLaaS platform with a real-world case studycited by 70
- 2024Reflective Gaussian Splattingcited by 39
- 2024NeRF-Casting: Improved View-Dependent Appearance with Consistent Reflectionscited by 32
- 2024Ref-GS: Directional Factorization for 2D Gaussian Splattingcited by 27
- 2024TensoSDF: Roughness-aware Tensorial Representation for Robust Geometry and Material Reconstructioncited by 26
- 2025GS-2DGS: Geometrically Supervised 2DGS for Reflective Object Reconstructioncited by 11
Built on by
Not cited yet.