mlsanityData to 14 Oct 2026

TransNormal-2: Geometry-Grounded Rectified Flow with Edge-Aware Decoding for Precise Normal Estimation

arXiv 2609.06665 ↗First posted 6 Sep 2026cs.CVcited by 0

On the map: Diffusion models → 3D, point cloud and scene generation

Abstract (arXiv)

Diffusion-based models enable monocular geometry estimation, yet their pixel-space precision is limited by a shared, under-studied error source: VAE reconstruction degradation. The 8x spatial compression in the VAE encoder-decoder degrades surface normals at object boundaries; even encoding and decoding ground-truth normals introduces 1.3--8.5deg of mean angular error (MAE), with edge MAE reaching 2.8x the global MAE. We present TransNormal-2, a FLUX.2-based rectified-flow framework with single-step deterministic inference that addresses this degradation on both sides of the VAE decoder: in how latent predictions are supervised during training, and in how decoded normals are corrected at inference. First, geometry-aware pixel-space losses, including inverse rendering self-consistency, von~Mises-Fisher angular loss, and wavelet edge-aware regularization, complement latent MSE by enforcing spherical normal geometry and diffuse image-formation cues after VAE decoding. Second, a lightweight Geometric Refinement Module (GRM) applies an RGB-guided residual correction to reduce boundary-localized decoding errors without freely rewriting the coarse prediction. On general-scene benchmarks, TransNormal-2 matches or exceeds MoGe-2 on all eight reported metrics while using only 1.4% as many task-specific normal annotations. The gains are clearest for transparent objects, reducing MAE by 4.2deg on ClearGrasp and 3.1deg on ClearPose over the strongest prior baselines. Code will be released at https://longxiang-ai.github.io/TransNormal-2.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in 3D, point cloud and scene generation, one of 14 directions in Diffusion models. Builds on 70 of its 91 references that are in the map. First posted on arXiv 6 Sep 2026.

Builds on

70 of 91 references.

Closest ancestors · 14

Same direction, newest first

  1. 2026Video Generative Models as Geometry Learner28 Aug
  2. 2025Diffusion Knows Transparency: Repurposing Video Diffusion for Transparent Object Depth and Normal Estimation29 Dec
  3. 2025Lotus-2: Advancing Geometric Dense Prediction with Powerful Image Generative Model30 Nov
  4. 2025Pixel-Perfect Depth with Semantics-Prompted Diffusion Transformers8 Oct
  5. 2025From Editor to Dense Geometry Estimator4 Sep
  6. 2025JointDiT: Enhancing RGB-Depth Joint Modeling with Diffusion Transformers1 May
  7. 2025NormalCrafter: Learning Temporally Consistent Normals from Video Diffusion Priors15 Apr
  8. 2025Orchid: Image Latent Diffusion for Joint Appearance and Geometry Generation22 Jan
  9. 2025DepthMaster: Taming Diffusion Models for Monocular Depth Estimation5 Jan
  10. 2024SharpDepth: Sharpening Metric Depth Predictions Using Diffusion Distillation27 Nov
  11. 2024Fine-Tuning Image-Conditional Diffusion Models is Easier than You Think17 Sep
  12. 2024StableNormal: Reducing Diffusion Variance for Stable and Sharp Normal24 Jun
2 more
  1. 2024GeoWizard: Unleashing the Diffusion Priors for 3D Geometry Estimation from a Single Image18 Mar
  2. 2023Repurposing Diffusion-Based Image Generators for Monocular Depth Estimation4 Dec

Other references · 56

  1. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  2. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  3. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
  4. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  5. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  6. 2022Scalable Diffusion Models with Transformerscited by 6,054
  7. 2022Flow Matching for Generative Modelingcited by 5,702
  8. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
  9. 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,700
  10. 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,117
  11. 2021Vision Transformers for Dense Predictioncited by 1,803
  12. 2019Towards Robust Monocular Depth Estimation: Mixing Datasets for Zero-shot Cross-dataset Transfercited by 1,495
38 more
  1. 2024Depth Anything V2cited by 1,422
  2. 2014Depth Map Prediction from a Single Image using a Multi-Scale Deep Networkcited by 1,274
  3. 2020Hypersim: A Photorealistic Synthetic Dataset for Holistic Indoor Scene Understandingcited by 604
  4. 2024Metric3Dv2: A Versatile Monocular Geometric Foundation Model for Zero-shot Metric Depth and Surface Normal Estimationcited by 395
  5. 2025Reconstruction vs. Generation: Taming Optimization Dilemma in Latent Diffusion Modelscited by 393
  6. 2020Virtual KITTI 2cited by 353
  7. 2021Omnidata: A Scalable Pipeline for Making Multi-Task Mid-Level Vision Datasets from 3D Scanscited by 336
  8. 2024MoGe: Unlocking Accurate Monocular Geometry Estimation for Open-Domain Images with Optimal Training Supervisioncited by 299
  9. 2025MoGe-2: Accurate Monocular Geometry with Metric Scale and Sharp Detailscited by 261
  10. 2024Deep Compression Autoencoder for Efficient High-Resolution Diffusion Modelscited by 217
  11. 2024Lotus: Diffusion-based Visual Foundation Model for High-quality Dense Predictioncited by 166
  12. 2018Evaluation of CNN-based Single-Image Depth Estimation Methodscited by 138
  13. 2019ClearGrasp: 3D Shape Estimation of Transparent Objects for Manipulationcited by 124
  14. 2024Rethinking Inductive Biases for Surface Normal Estimationcited by 124
  15. 2021Dex-NeRF: Using a Neural Radiance Field to Grasp Transparent Objectscited by 119
  16. 20223D Common Corruptions and Data Augmentationcited by 119
  17. 2024Transparent Image Layer Diffusion using Latent Transparencycited by 114
  18. 2020Segmenting Transparent Objects in the Wildcited by 98
  19. 2024What Matters When Repurposing Diffusion Models for General Dense Perception Tasks?cited by 74
  20. 2021RGB-D Local Implicit Function for Depth Completion of Transparent Objectscited by 64
  21. 2022TransCG: A Large-Scale Real-World Dataset for Transparent Object Depth Completion and a Grasping Baselinecited by 55
  22. 2022Domain Randomization-Enhanced Depth Simulation and Restoration for Perceiving and Grasping Specular and Transparent Objectscited by 50
  23. 2022ClearPose: Large-scale Transparent Object Dataset and Benchmarkcited by 46
  24. 2025Dens3R: A Foundation Model for 3D Geometry Predictioncited by 46
  25. 2021Seeing Glass: Joint Point Cloud and Depth Completion for Transparent Objectscited by 39
  26. 2025DICEPTION: A Generalist Diffusion Model for Visual Perceptual Taskscited by 39
  27. 2023Exploiting Diffusion Prior for Generalizable Dense Predictioncited by 38
  28. 2020GeoNet++: Iterative Geometric Neural Network with Edge-Aware Refinement for Joint Depth and Surface Normal Estimationcited by 36
  29. 2023Learning Depth Estimation for Transparent and Mirror Surfacescited by 34
  30. 2022IronDepth: Iterative Refinement of Single-View Depth using Surface Normal and its Uncertaintycited by 30
  31. 2019FrameNet: Learning Local Canonical Frames of 3D Surfaces from a Single RGB Imagecited by 26
  32. 2022Transparent Shape from a Single View Polarization Imagecited by 16
  33. 2023TRansPose: Large-Scale Multispectral Dataset for Transparent Objectcited by 15
  34. 2025TSGS: Improving Gaussian Splatting for Transparent Surface Reconstruction via Normal and De-lighting Priorscited by 14
  35. 2022TransNet: Category-Level Transparent Object Pose Estimationcited by 13
  36. 2023NeTO:Neural Reconstruction of Transparent Objects with Self-Occlusion Aware Refraction-Tracingcited by 9
  37. 2024ClearDepth: Enhanced Stereo Perception of Transparent Objects for Robotic Manipulationcited by 9
  38. 2025Monocular Depth Estimation and Segmentation for Transparent Object with Iterative Semantic and Geometric Fusioncited by 8

50 most cited of 56 All 56 (JSON)

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Beyond Gaussian Bottlenecks: Topologically Aligned Encoding of Vision-Transformer Feature Spaces
  2. 2026Surflo: Consistent 3D Surface Flow Model with Global State
  3. 2026VGGT-Diff: Visual Geometry Meets Diffusion for Sparse-View Novel View Synthesis
  4. 2026EagleDepth: Efficient Fine-Grained Depth Estimation via Pixel Diffusion Decoder
  5. 2026GeoStereo: A Unified Stereo Geometry Estimation Framework for Disparity and Surface Normal
  6. 2026FLAT: Feedforward Latent Triangle Splatting for Geometrically Accurate Scene Generation
  7. 2025UniGeo: Taming Video Diffusion for Unified Consistent Geometry Estimation
  8. 2026Iris: Bringing Real-World Priors into Diffusion Model for Monocular Depth Estimation