TransNormal: Dense Visual Semantics for Diffusion-based Transparent Object Normal Estimation
Not on the map. Why?
Abstract (arXiv)
Monocular normal estimation for transparent objects is critical for laboratory automation, yet it remains challenging due to complex light refraction and reflection. These optical properties often lead to catastrophic failures in conventional depth and normal sensors, hindering the deployment of embodied AI in scientific environments. We propose TransNormal, a novel framework that adapts pre-trained diffusion priors for single-step normal regression. To handle the lack of texture in transparent surfaces, TransNormal integrates dense visual semantics from DINOv3 via a cross-attention mechanism, providing strong geometric cues. Furthermore, we employ a multi-task learning objective and wavelet-based regularization to ensure the preservation of fine-grained structural details. To support this task, we introduce TransNormal-Synthetic, a physics-based dataset with high-fidelity normal maps for transparent labware. Extensive experiments demonstrate that TransNormal significantly outperforms state-of-the-art methods: on the ClearGrasp benchmark, it reduces mean error by 24.4% and improves 11.25deg accuracy by 22.8%; on ClearPose, it achieves a 15.2% reduction in mean error. The code and dataset will be made publicly available at https://longxiang-ai.github.io/TransNormal.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 47 of its 62 references that are in the map. First posted on arXiv 31 Jan 2026.
Builds on
47 of 62 references.
References · 47
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2024SAM 2: Segment Anything in Images and Videoscited by 2,784
- 2019Towards Robust Monocular Depth Estimation: Mixing Datasets for Zero-shot Cross-dataset Transfercited by 1,484
- 2017Domain Randomization for Transferring Deep Neural Networks from Simulation to the Real Worldcited by 1,401
- 2024Depth Anything V2cited by 1,385
- 2024Depth Anything: Unleashing the Power of Large-Scale Unlabeled Datacited by 1,346
- 2014Depth Map Prediction from a Single Image using a Multi-Scale Deep Networkcited by 1,264
- 2025SigLIP 2: Multilingual Vision-Language Encoders with Improved Semantic Understanding, Localization, and Dense Featurescited by 1,127
- 2020Hypersim: A Photorealistic Synthetic Dataset for Holistic Indoor Scene Understandingcited by 593
- 2021Omnidata: A Scalable Pipeline for Making Multi-Task Mid-Level Vision Datasets from 3D Scanscited by 336
35 more
- 2023Repurposing Diffusion-Based Image Generators for Monocular Depth Estimationcited by 323
- 2024MoGe: Unlocking Accurate Monocular Geometry Estimation for Open-Domain Images with Optimal Training Supervisioncited by 290
- 2024GeoWizard: Unleashing the Diffusion Priors for 3D Geometry Estimation from a Single Imagecited by 283
- 2025MoGe-2: Accurate Monocular Geometry with Metric Scale and Sharp Detailscited by 250
- 2022AnyGrasp: Robust and Efficient Grasp Perception in Spatial and Temporal Domainscited by 205
- 2024DepthCrafter: Generating Consistent Long Depth Sequences for Open-world Videoscited by 202
- 2018Sim-to-Real via Sim-to-Sim: Data-efficient Robotic Grasping via Randomized-to-Canonical Adaptation Networkscited by 171
- 2024Lotus: Diffusion-based Visual Foundation Model for High-quality Dense Predictioncited by 163
- 2024StableNormal: Reducing Diffusion Variance for Stable and Sharp Normalcited by 153
- 2019ClearGrasp: 3D Shape Estimation of Transparent Objects for Manipulationcited by 124
- 2024Rethinking Inductive Biases for Surface Normal Estimationcited by 122
- 20223D Common Corruptions and Data Augmentationcited by 120
- 2021Dex-NeRF: Using a Neural Radiance Field to Grasp Transparent Objectscited by 119
- 2023Investigating the Catastrophic Forgetting in Multimodal Large Language Modelscited by 119
- 2024Transparent Image Layer Diffusion using Latent Transparencycited by 111
- 2020Segmenting Transparent Objects in the Wildcited by 98
- 2024Fine-Tuning Image-Conditional Diffusion Models is Easier than You Thinkcited by 82
- 2024What Matters When Repurposing Diffusion Models for General Dense Perception Tasks?cited by 74
- 2021RGB-D Local Implicit Function for Depth Completion of Transparent Objectscited by 64
- 2022TransCG: A Large-Scale Real-World Dataset for Transparent Object Depth Completion and a Grasping Baselinecited by 55
- 2022Domain Randomization-Enhanced Depth Simulation and Restoration for Perceiving and Grasping Specular and Transparent Objectscited by 49
- 2022ClearPose: Large-scale Transparent Object Dataset and Benchmarkcited by 46
- 2024VidMan: Exploiting Implicit Dynamics from Video Diffusion Model for Effective Robot Manipulationcited by 45
- 2021Seeing Glass: Joint Point Cloud and Depth Completion for Transparent Objectscited by 39
- 2025DICEPTION: A Generalist Diffusion Model for Visual Perceptual Taskscited by 37
- 2022Transparent Shape from a Single View Polarization Imagecited by 16
- 2023TRansPose: Large-Scale Multispectral Dataset for Transparent Objectcited by 15
- 2025TSGS: Improving Gaussian Splatting for Transparent Surface Reconstruction via Normal and De-lighting Priorscited by 14
- 2022TransNet: Category-Level Transparent Object Pose Estimationcited by 13
- 2023NeTO:Neural Reconstruction of Transparent Objects with Self-Occlusion Aware Refraction-Tracingcited by 9
- 2025Diffusion Knows Transparency: Repurposing Video Diffusion for Transparent Object Depth and Normal Estimationcited by 9
- 2023RFTrans: Leveraging Refractive Flow of Transparent Objects for Surface Normal Estimation and Manipulationcited by 6
- 2025RetrDex: Efficient Object Retrieval in Cluttered Scenes with a Dexterous Handcited by 4
- 2023Towards Monocular Shape from Refractioncited by 3
- 2024Making the Flow Glow -- Robot Perception under Severe Lighting Conditions using Normalizing Flow Gradientscited by 1
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2024Neural LightRig: Unlocking Accurate Object Normal and Material Estimation with Multi-Light Diffusion
- 2026SILICA: Repurposing Diffusion Priors for Joint Glass Segmentation and Depth Estimation
- 2026SeeClear: Reliable Transparent Object Depth Estimation via Generative Opacification
- 2025TransDiff: Diffusion-Based Method for Manipulating Transparent Objects Using a Single RGB-D Image
- 2023RichDreamer: A Generalizable Normal-Depth Diffusion Model for Detail Richness in Text-to-3D
- 2026DIAMOND-SSS: Diffusion-Augmented Multi-View Optimization for Data-efficient SubSurface Scattering
- 2025TranSplat: Surface Embedding-guided 3D Gaussian Splatting for Transparent Object Manipulation
- 2023Make-It-3D: High-Fidelity 3D Creation from A Single Image with Diffusion Prior