mlsanityData to 7 Oct 2026

Bidirectional Cross-Modal Prompting for Event-Frame Asymmetric Stereo

arXiv 2604.15312 ↗First posted 16 Apr 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Conventional frame-based cameras capture rich contextual information but suffer from limited temporal resolution and motion blur in dynamic scenes. Event cameras offer an alternative visual representation with higher dynamic range free from such limitations. The complementary characteristics of the two modalities make event-frame asymmetric stereo promising for reliable 3D perception under fast motion and challenging illumination. However, the modality gap often leads to marginalization of domain-specific cues essential for cross-modal stereo matching. In this paper, we introduce Bi-CMPStereo, a novel bidirectional cross-modal prompting framework that fully exploits semantic and structural features from both domains for robust matching. Our approach learns finely aligned stereo representations within a target canonical space and integrates complementary representations by projecting each modality into both event and frame domains. Extensive experiments demonstrate that our approach significantly outperforms state-of-the-art methods in accuracy and generalization.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 54 of its 90 references that are in the map. First posted on arXiv 16 Apr 2026.

Builds on

54 of 90 references.

References · 54

  1. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  2. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
  3. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  4. 2020RAFT: Recurrent All-Pairs Field Transforms for Optical Flowcited by 2,385
  5. 2024Depth Anything V2cited by 1,385
  6. 2019Event-based Vision: A Surveycited by 1,010
  7. 2015A Large Dataset to Train Convolutional Networks for Disparity, Optical Flow, and Scene Flow Estimationcited by 878
  8. 2016Unsupervised Monocular Depth Estimation with Left-Right Consistencycited by 819
  9. 2018Pyramid Stereo Matching Networkcited by 486
  10. 2017End-to-End Learning of Geometry and Context for Deep Stereo Regressioncited by 359
  11. 2021RAFT-Stereo: Multilevel Recurrent Field Transforms for Stereo Matchingcited by 348
  12. 2018Unsupervised Event-based Learning of Optical Flow, Depth, and Egomotioncited by 304
38 more
  1. 2021DSEC: A Stereo Event Camera Dataset for Driving Scenarioscited by 297
  2. 2022Unifying Flow, Stereo and Depth Estimationcited by 270
  3. 2018The Multi Vehicle Stereo Event Camera Dataset: An Event Camera Dataset for 3D Perceptioncited by 251
  4. 2019GA-Net: Guided Aggregation Net for End-to-end Stereo Matchingcited by 242
  5. 2019Group-wise Correlation Stereo Networkcited by 235
  6. 2020AANet: Adaptive Aggregation Network for Efficient Stereo Matchingcited by 202
  7. 2022Practical Stereo Matching via Cascaded Recurrent Network with Adaptive Correlationcited by 197
  8. 2020Revisiting Stereo Depth Estimation From a Sequence-to-Sequence Perspective with Transformerscited by 190
  9. 2023Iterative Geometry Encoding Volume for Stereo Matchingcited by 188
  10. 2025FoundationStereo: Zero-Shot Stereo Matchingcited by 168
  11. 2021CFNet: Cascade and Fused Cost Volume for Robust Stereo Matchingcited by 153
  12. 2022Attention Concatenation Volume for Accurate and Efficient Stereo Matchingcited by 130
  13. 2019Domain-invariant Stereo Matching Networkscited by 108
  14. 2024Selective-Stereo: Adaptive Frequency Information Selection for Stereo Matchingcited by 98
  15. 2018Hierarchical Discrete Distribution Decomposition for Match Density Estimationcited by 93
  16. 2020A Survey on Deep Learning Techniques for Stereo-based Depth Estimationcited by 90
  17. 2014Computing the Stereo Matching Cost with a Convolutional Neural Networkcited by 74
  18. 2024IGEV++: Iterative Multi-range Geometry Encoding Volumes for Stereo Matchingcited by 55
  19. 2025DEFOM-Stereo: Depth Foundation Model Based Stereo Matchingcited by 51
  20. 2024MoCha-Stereo: Motif Channel Attention Network for Stereo Matchingcited by 48
  21. 2022Revisiting Domain Generalized Stereo Matching Networks from a Feature Consistency Perspectivecited by 46
  22. 2023NeRF-Supervised Deep Stereocited by 46
  23. 2024Stereo Anywhere: Robust Zero-Shot Deep Stereo Matching Even Where Either Stereo or Mono Failcited by 45
  24. 2022GraftNet: Towards Domain Generalized Stereo Matching with a Broad-Spectrum and Task-Oriented Featurecited by 43
  25. 2022ITSA: An Information-Theoretic Approach to Automatic Shortcut Avoidance and Domain Generalization in Stereo Matching Networkscited by 39
  26. 2022Context-Enhanced Stereo Transformercited by 37
  27. 2021Bridging the Gap between Events and Frames through Unsupervised Domain Adaptationcited by 36
  28. 2020Continual Adaptation for Deep Stereocited by 23
  29. 2024A Survey on Deep Stereo Matching in the Twentiescited by 23
  30. 2021Neural Disparity Refinement for Arbitrary Resolution Stereocited by 20
  31. 2024Event-based Stereo Depth Estimation: A Surveycited by 19
  32. 2021Stereo Hybrid Event-Frame (SHEF) Cameras for 3D Perceptioncited by 16
  33. 2025BridgeDepth: Bridging Monocular and Stereo Reasoning with Latent Alignmentcited by 15
  34. 2025Depth AnyEvent: A Cross-Modal Distillation Paradigm for Event-Based Monocular Depth Estimationcited by 13
  35. 2024Federated Online Adaptation for Deep Stereocited by 12
  36. 2024Temporal Event Stereo via Joint Learning with Stereoscopic Flowcited by 12
  37. 2023Video Frame Interpolation with Stereo Event and Intensity Cameracited by 10
  38. 2025Diving into the Fusion of Monocular Priors for Generalized Stereo Matchingcited by 10

50 most cited of 54 All 54 (JSON)

Built on by

Not cited yet.