Bidirectional Cross-Modal Prompting for Event-Frame Asymmetric Stereo
Not on the map. Why?
Abstract (arXiv)
Conventional frame-based cameras capture rich contextual information but suffer from limited temporal resolution and motion blur in dynamic scenes. Event cameras offer an alternative visual representation with higher dynamic range free from such limitations. The complementary characteristics of the two modalities make event-frame asymmetric stereo promising for reliable 3D perception under fast motion and challenging illumination. However, the modality gap often leads to marginalization of domain-specific cues essential for cross-modal stereo matching. In this paper, we introduce Bi-CMPStereo, a novel bidirectional cross-modal prompting framework that fully exploits semantic and structural features from both domains for robust matching. Our approach learns finely aligned stereo representations within a target canonical space and integrates complementary representations by projecting each modality into both event and frame domains. Extensive experiments demonstrate that our approach significantly outperforms state-of-the-art methods in accuracy and generalization.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 54 of its 90 references that are in the map. First posted on arXiv 16 Apr 2026.
Builds on
54 of 90 references.
References · 54
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2020RAFT: Recurrent All-Pairs Field Transforms for Optical Flowcited by 2,385
- 2024Depth Anything V2cited by 1,385
- 2019Event-based Vision: A Surveycited by 1,010
- 2015A Large Dataset to Train Convolutional Networks for Disparity, Optical Flow, and Scene Flow Estimationcited by 878
- 2016Unsupervised Monocular Depth Estimation with Left-Right Consistencycited by 819
- 2018Pyramid Stereo Matching Networkcited by 486
- 2017End-to-End Learning of Geometry and Context for Deep Stereo Regressioncited by 359
- 2021RAFT-Stereo: Multilevel Recurrent Field Transforms for Stereo Matchingcited by 348
- 2018Unsupervised Event-based Learning of Optical Flow, Depth, and Egomotioncited by 304
38 more
- 2021DSEC: A Stereo Event Camera Dataset for Driving Scenarioscited by 297
- 2022Unifying Flow, Stereo and Depth Estimationcited by 270
- 2018The Multi Vehicle Stereo Event Camera Dataset: An Event Camera Dataset for 3D Perceptioncited by 251
- 2019GA-Net: Guided Aggregation Net for End-to-end Stereo Matchingcited by 242
- 2019Group-wise Correlation Stereo Networkcited by 235
- 2020AANet: Adaptive Aggregation Network for Efficient Stereo Matchingcited by 202
- 2022Practical Stereo Matching via Cascaded Recurrent Network with Adaptive Correlationcited by 197
- 2020Revisiting Stereo Depth Estimation From a Sequence-to-Sequence Perspective with Transformerscited by 190
- 2023Iterative Geometry Encoding Volume for Stereo Matchingcited by 188
- 2025FoundationStereo: Zero-Shot Stereo Matchingcited by 168
- 2021CFNet: Cascade and Fused Cost Volume for Robust Stereo Matchingcited by 153
- 2022Attention Concatenation Volume for Accurate and Efficient Stereo Matchingcited by 130
- 2019Domain-invariant Stereo Matching Networkscited by 108
- 2024Selective-Stereo: Adaptive Frequency Information Selection for Stereo Matchingcited by 98
- 2018Hierarchical Discrete Distribution Decomposition for Match Density Estimationcited by 93
- 2020A Survey on Deep Learning Techniques for Stereo-based Depth Estimationcited by 90
- 2014Computing the Stereo Matching Cost with a Convolutional Neural Networkcited by 74
- 2024IGEV++: Iterative Multi-range Geometry Encoding Volumes for Stereo Matchingcited by 55
- 2025DEFOM-Stereo: Depth Foundation Model Based Stereo Matchingcited by 51
- 2024MoCha-Stereo: Motif Channel Attention Network for Stereo Matchingcited by 48
- 2022Revisiting Domain Generalized Stereo Matching Networks from a Feature Consistency Perspectivecited by 46
- 2023NeRF-Supervised Deep Stereocited by 46
- 2024Stereo Anywhere: Robust Zero-Shot Deep Stereo Matching Even Where Either Stereo or Mono Failcited by 45
- 2022GraftNet: Towards Domain Generalized Stereo Matching with a Broad-Spectrum and Task-Oriented Featurecited by 43
- 2022ITSA: An Information-Theoretic Approach to Automatic Shortcut Avoidance and Domain Generalization in Stereo Matching Networkscited by 39
- 2022Context-Enhanced Stereo Transformercited by 37
- 2021Bridging the Gap between Events and Frames through Unsupervised Domain Adaptationcited by 36
- 2020Continual Adaptation for Deep Stereocited by 23
- 2024A Survey on Deep Stereo Matching in the Twentiescited by 23
- 2021Neural Disparity Refinement for Arbitrary Resolution Stereocited by 20
- 2024Event-based Stereo Depth Estimation: A Surveycited by 19
- 2021Stereo Hybrid Event-Frame (SHEF) Cameras for 3D Perceptioncited by 16
- 2025BridgeDepth: Bridging Monocular and Stereo Reasoning with Latent Alignmentcited by 15
- 2025Depth AnyEvent: A Cross-Modal Distillation Paradigm for Event-Based Monocular Depth Estimationcited by 13
- 2024Federated Online Adaptation for Deep Stereocited by 12
- 2024Temporal Event Stereo via Joint Learning with Stereoscopic Flowcited by 12
- 2023Video Frame Interpolation with Stereo Event and Intensity Cameracited by 10
- 2025Diving into the Fusion of Monocular Priors for Generalized Stereo Matchingcited by 10
50 most cited of 54 All 54 (JSON)
Built on by
Not cited yet.