mlsanityData to 7 Oct 2026

LiDAR-Event Stereo Fusion with Hallucinations

arXiv 2408.04633 ↗First posted 8 Aug 2024cs.CVcited by 6

Not on the map. Why?

Abstract (arXiv)

Event stereo matching is an emerging technique to estimate depth from neuromorphic cameras; however, events are unlikely to trigger in the absence of motion or the presence of large, untextured regions, making the correspondence problem extremely challenging. Purposely, we propose integrating a stereo event camera with a fixed-frequency active sensor -- e.g., a LiDAR -- collecting sparse depth measurements, overcoming the aforementioned limitations. Such depth hints are used by hallucinating -- i.e., inserting fictitious events -- the stacks or raw input streams, compensating for the lack of information in the absence of brightness changes. Our techniques are general, can be adapted to any structured representation to stack events and outperform state-of-the-art fusion methods applied to event-based stereo.

Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Builds on 51 of its 91 references that are in the map. First posted on arXiv 8 Aug 2024.

Builds on

51 of 91 references.

References · 51

  1. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  2. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  3. 2019Event-based Vision: A Surveycited by 1,010
  4. 2015A Large Dataset to Train Convolutional Networks for Disparity, Optical Flow, and Scene Flow Estimationcited by 878
  5. 2018Pyramid Stereo Matching Networkcited by 486
  6. 2017End-to-End Learning of Geometry and Context for Deep Stereo Regressioncited by 359
  7. 2021RAFT-Stereo: Multilevel Recurrent Field Transforms for Stereo Matchingcited by 348
  8. 2018Unsupervised Event-based Learning of Optical Flow, Depth, and Egomotioncited by 304
  9. 2021DSEC: A Stereo Event Camera Dataset for Driving Scenarioscited by 297
  10. 2019GA-Net: Guided Aggregation Net for End-to-end Stereo Matchingcited by 242
  11. 2019Group-wise Correlation Stereo Networkcited by 235
  12. 2020AANet: Adaptive Aggregation Network for Efficient Stereo Matchingcited by 202
38 more
  1. 2018Event-based Vision meets Deep Learning on Steering Prediction for Self-driving Carscited by 197
  2. 2022Practical Stereo Matching via Cascaded Recurrent Network with Adaptive Correlationcited by 197
  3. 2020Revisiting Stereo Depth Estimation From a Sequence-to-Sequence Perspective with Transformerscited by 190
  4. 2023Iterative Geometry Encoding Volume for Stereo Matchingcited by 188
  5. 2020Hierarchical Neural Architecture Search for Deep Stereo Matchingcited by 166
  6. 2021CFNet: Cascade and Fused Cost Volume for Robust Stereo Matchingcited by 153
  7. 2015Stereo Matching by Training a Convolutional Neural Network to Compare Image Patchescited by 151
  8. 2018Learning Depth with Convolutional Spatial Propagation Networkcited by 135
  9. 2019Hierarchical Deep Stereo Matching on High-resolution Imagescited by 126
  10. 2020HITNet: Hierarchical Iterative Tile Refinement Network for Real-time Stereo Matchingcited by 120
  11. 2019DeepPruner: Learning Efficient Stereo Matching via Differentiable PatchMatchcited by 114
  12. 2018Hierarchical Discrete Distribution Decomposition for Match Density Estimationcited by 93
  13. 2018StereoNet: Guided Hierarchical Refinement for Real-Time Edge-Aware Depth Predictioncited by 88
  14. 2018SegStereo: Exploiting Semantic Information for Disparity Estimationcited by 88
  15. 2018Real-time self-adaptive deep stereocited by 80
  16. 2021Time-Ordered Recent Event (TORE) Volumes for Event Camerascited by 73
  17. 2018Semi-Dense 3D Reconstruction with a Stereo Event Cameracited by 67
  18. 2017Cascade Residual Learning: A Two-stage Convolutional Neural Network for Stereo Matchingcited by 63
  19. 2018Anytime Stereo Image Depth Estimation on Mobile Devicescited by 54
  20. 2023From Chaos Comes Order: Ordering Event Representations for Object Recognition and Detectioncited by 52
  21. 2023NeRF-Supervised Deep Stereocited by 46
  22. 2022VECtor: A Versatile Event-Centric Benchmark for Multi-Sensor SLAMcited by 45
  23. 2022Context-Enhanced Stereo Transformercited by 37
  24. 2018EdgeStereo: A Context Integrated Residual Pyramid Network for Stereo Matchingcited by 32
  25. 2019Noise-Aware Unsupervised Deep Lidar-Stereo Fusioncited by 31
  26. 2019AutoDispNet: Improving Disparity Estimation With AutoMLcited by 29
  27. 2019Guided Stereo Matchingcited by 24
  28. 2021EventPoint: Self-Supervised Interest Point Detection and Description for Event-based Cameracited by 24
  29. 20193D LiDAR and Stereo Fusion using Stereo Matching Network with Conditional Cost Volume Normalizationcited by 17
  30. 2022L2E: Lasers to Events for 6-DoF Extrinsic Calibration of Lidars and Event Camerascited by 15
  31. 2019LiStereo: Generate Dense Depth Maps from LIDAR and Stereo Imagerycited by 13
  32. 2024Federated Online Adaptation for Deep Stereocited by 12
  33. 2021S3: Learnable Sparse Signal Superdensity for Guided Depth Estimationcited by 10
  34. 2018Analysis of Robust Functions for Registration Algorithmscited by 9
  35. 2023Active Stereo Without Pattern Projectorcited by 8
  36. 2021High-Resolution Depth Maps Based on TOF-Stereo Fusioncited by 5
  37. 2022LiDAR-guided Stereo Matching with a Spatial Consistency Constraintcited by 5
  38. 2023Learning to Estimate Two Dense Depths from LiDAR and Event Datacited by 5

50 most cited of 51 All 51 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 1; 2025: 3; 2026: 2.

6 papers.

  1. 2024Event-based Stereo Depth Estimation: A Surveycited by 19
  2. 2025Depth AnyEvent: A Cross-Modal Distillation Paradigm for Event-Based Monocular Depth Estimationcited by 13
  3. 2025URNet: Uncertainty-aware Refinement Network for Event-based Stereo Depth Estimationcited by 4
  4. 2025Unleashing the Temporal Potential of Stereo Event Cameras for Continuous-Time 3D Object Detectioncited by 3
  5. 2026EventHub: Data Factory for Generalizable Event-Based Stereo Networks without Active Sensorscited by 0
  6. 2026Bidirectional Cross-Modal Prompting for Event-Frame Asymmetric Stereocited by 0