Geometry Reinforced Efficient Attention Tuning Equipped with Normals for Robust Stereo Matching
Not on the map. Why?
Abstract (arXiv)
Despite remarkable advances in image-driven stereo matching over the past decade, Synthetic-to-Realistic ZeroShot (Syn-to-Real) generalization remains an open challenge. This suboptimal generalization performance mainly stems from cross-domain shifts and ill-posed ambiguities inherent in image textures, particularly in occluded, textureless, repetitive, and non-Lambertian (specular/transparent) regions. To improve Synto-Real generalization, we propose GREATEN, a framework that incorporates surface normals as domain-invariant, object-intrinsic, and discriminative geometric cues to compensate for the limitations of image textures. The proposed framework consists of three key components. First, a Gated Contextual-Geometric Fusion (GCGF) module adaptively suppresses unreliable contextual cues in image features and fuses the filtered image features with normal-driven geometric features to construct domain-invariant and discriminative contextual-geometric representations. Second, a Specular-Transparent Augmentation (STA) strategy improves the robustness of GCGF against misleading visual cues in non-Lambertian regions. Third, sparse attention designs preserve the fine-grained global feature extraction capability of GREATStereo for handling occlusion and texture-related ambiguities while substantially reducing computational overhead, including Sparse Spatial (SSA), Sparse Dual-Matching (SDMA), and Simple Volume (SVA) attentions. Trained exclusively on synthetic data such as SceneFlow, GREATEN-IGEV achieves outstanding Syn-to-Real performance. Specifically, it reduces errors by 30% on ETH3D, 8.5% on the non-Lambertian Booster, and 14.1% on KITTI-2015, compared to FoundationStereo, Monster-Stereo, and DEFOM-Stereo, respectively. In addition, GREATEN-IGEV runs 19.2% faster than GREAT-IGEV and supports high-resolution (3K) inference on Middlebury with disparity ranges up to 768.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 54 of its 83 references that are in the map. First posted on arXiv 10 Apr 2026.
Builds on
54 of 83 references.
References · 54
- 2017Attention Is All You Needcited by 59,932
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
- 2022Generative Adversarial Networkscited by 5,603
- 2018MobileNetV2: Inverted Residuals and Linear Bottleneckscited by 4,773
- 2020Deformable DETR: Deformable Transformers for End-to-End Object Detectioncited by 3,410
- 2020RAFT: Recurrent All-Pairs Field Transforms for Optical Flowcited by 2,385
- 2024Depth Anything V2cited by 1,385
- 2015A Large Dataset to Train Convolutional Networks for Disparity, Optical Flow, and Scene Flow Estimationcited by 878
- 2020Hypersim: A Photorealistic Synthetic Dataset for Holistic Indoor Scene Understandingcited by 593
- 2020TartanAir: A Dataset to Push the Limits of Visual SLAMcited by 494
38 more
- 2018Pyramid Stereo Matching Networkcited by 486
- 2019Cascade Cost Volume for High-Resolution Multi-View Stereo and Stereo Matchingcited by 414
- 2017End-to-End Learning of Geometry and Context for Deep Stereo Regressioncited by 359
- 2021RAFT-Stereo: Multilevel Recurrent Field Transforms for Stereo Matchingcited by 348
- 2020Virtual KITTI 2cited by 345
- 2022Vision Transformer with Deformable Attentioncited by 293
- 2019GA-Net: Guided Aggregation Net for End-to-end Stereo Matchingcited by 242
- 2019Group-wise Correlation Stereo Networkcited by 235
- 2021Learning to Estimate Hidden Motions with Global Motion Aggregationcited by 223
- 2020AANet: Adaptive Aggregation Network for Efficient Stereo Matchingcited by 202
- 2022Practical Stereo Matching via Cascaded Recurrent Network with Adaptive Correlationcited by 197
- 2023Iterative Geometry Encoding Volume for Stereo Matchingcited by 188
- 2025FoundationStereo: Zero-Shot Stereo Matchingcited by 168
- 2024GaussianFormer: Scene as Gaussians for Vision-Based 3D Semantic Occupancy Predictioncited by 155
- 2021CFNet: Cascade and Fused Cost Volume for Robust Stereo Matchingcited by 153
- 2022Attention Concatenation Volume for Accurate and Efficient Stereo Matchingcited by 130
- 2019Hierarchical Deep Stereo Matching on High-resolution Imagescited by 126
- 2019Domain-invariant Stereo Matching Networkscited by 108
- 2024Selective-Stereo: Adaptive Frequency Information Selection for Stereo Matchingcited by 98
- 2018Falling Things: A Synthetic Dataset for 3D Object Detection and Pose Estimationcited by 92
- 2024GaussianFormer-2: Probabilistic Gaussian Superposition for Efficient 3D Occupancy Predictioncited by 83
- 2018Occlusions, Motion and Depth Boundaries with a Generic Network for Disparity, Optical Flow or Scene Flow Estimationcited by 69
- 2020PCW-Net: Pyramid Combination and Warping Cost Volume for Stereo Matchingcited by 62
- 2022Accurate and Efficient Stereo Matching via Attention Concatenation Volumecited by 59
- 2024IGEV++: Iterative Multi-range Geometry Encoding Volumes for Stereo Matchingcited by 55
- 2025DEFOM-Stereo: Depth Foundation Model Based Stereo Matchingcited by 51
- 2022Open Challenges in Deep Stereo: the Booster Datasetcited by 48
- 2024Stereo Anywhere: Robust Zero-Shot Deep Stereo Matching Even Where Either Stereo or Mono Failcited by 45
- 2022GraftNet: Towards Domain Generalized Stereo Matching with a Broad-Spectrum and Task-Oriented Featurecited by 43
- 2023Uncertainty Guided Adaptive Warping for Robust and Efficient Stereo Matchingcited by 36
- 2018ActiveStereoNet: End-to-End Self-Supervised Learning for Active Stereo Systemscited by 35
- 2017Self-Supervised Learning for Stereo Matching with Self-Improving Abilitycited by 32
- 2021PVStereo: Pyramid Voting Module for End-to-End Self-Supervised Stereo Matchingcited by 28
- 2021Rethinking Skip Connection with Layer Normalization in Transformers and ResNetscited by 22
- 2023Global Occlusion-Aware Transformer for Robust Stereo Matchingcited by 19
- 2025MonSter++: Unified Stereo Matching, Multi-view Stereo, and Real-time Stereo with Monodepth Priorscited by 19
- 2025BridgeDepth: Bridging Monocular and Stereo Reasoning with Latent Alignmentcited by 15
- 2025Learning Robust Stereo Matching in the Wild with Selective Mixture-of-Expertscited by 13
50 most cited of 54 All 54 (JSON)
Built on by
Not cited yet.