mlsanityData to 14 Oct 2026

Event Camera Meets Mobile Embodied Perception: Abstraction, Algorithm, Acceleration, Application

arXiv 2503.22943 ↗First posted 29 Mar 2025cs.RO cs.CVcited by 6

Not on the map. Why?

Abstract (arXiv)

With the increasing complexity of mobile device applications, these devices are evolving toward high agility. This shift imposes new demands on mobile sensing, particularly in achieving high-accuracy and low-latency. Event-based vision has emerged as a disruptive paradigm, offering high temporal resolution and low latency, making it well-suited for high-accuracy and low-latency sensing tasks on high-agility platforms. However, the presence of substantial noisy events, lack of stable, persistent semantic information, and large data volume pose challenges for event-based data processing on resource-constrained mobile devices. This paper surveys the literature from 2014 to 2025 and presents a comprehensive overview of event-based mobile sensing, encompassing its fundamental principles, event textitabstraction methods, textitalgorithm advancements, and both hardware and software textitacceleration strategies. We discuss key textitapplications of event cameras in mobile sensing, including visual odometry, object tracking, optical flow, and 3D reconstruction, while highlighting challenges associated with event data processing, sensor fusion, and real-time deployment. Furthermore, we outline future research directions, such as improving the event camera with advanced optics, leveraging neuromorphic computing for efficient processing, and integrating bio-inspired algorithms. To support ongoing research, we provide an open-source textitOnline Sheet with recent developments. We hope this survey serves as a reference, facilitating the adoption of event-based vision across diverse applications.

Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Builds on 115 of its 274 references that are in the map. First posted on arXiv 29 Mar 2025.

Builds on

115 of 274 references.

References · 115

  1. 2019Event-based Vision: A Surveycited by 1,016
  2. 2019Surrogate Gradient Learning in Spiking Neural Networkscited by 626
  3. 2019High Speed and High Dynamic Range Video with an Event Cameracited by 345
  4. 2021DSEC: A Stereo Event Camera Dataset for Driving Scenarioscited by 303
  5. 2018The Multi Vehicle Stereo Event Camera Dataset: An Event Camera Dataset for 3D Perceptioncited by 254
  6. 2016The Event-Camera Dataset and Simulator: Event-based Data for Pose Estimation, Visual Odometry, and SLAMcited by 203
  7. 2019Events-to-Video: Bringing Modern Computer Vision to Event Camerascited by 193
  8. 2020Learning to Detect Objects with a 1 Megapixel Event Cameracited by 186
  9. 2018A Unifying Contrast Maximization Framework for Event Cameras, with Applications to Motion, Depth, and Optical Flow Estimationcited by 178
  10. 2022Recurrent Vision Transformers for Object Detection with Event Camerascited by 159
  11. 2017Ultimate SLAM? Combining Events, Images, and IMU for Robust Visual SLAM in HDR and High Speed Scenarioscited by 150
  12. 2018Asynchronous, Photometric Feature Tracking using Events and Framescited by 118
38 more
  1. 2022AEGNN: Asynchronous Event-based Graph Neural Networkscited by 118
  2. 2022Attention Spiking Neural Networkscited by 107
  3. 2020Event-based Stereo Visual Odometrycited by 105
  4. 2020Event-based Asynchronous Sparse Convolutional Networkscited by 104
  5. 2018Event-based High Dynamic Range Image and Very High Frame Rate Video Generation using Conditional Generative Adversarial Networkscited by 97
  6. 2023Deep Learning for Event-based Vision: A Comprehensive Survey and Benchmarkscited by 90
  7. 2018InteriorNet: Mega-scale Multi-sensor Photo-realistic Indoor Scenes Datasetcited by 87
  8. 2019Graph-Based Object Classification for Neuromorphic Vision Sensingcited by 85
  9. 2021Object Tracking by Jointly Exploiting Frame and Event Domaincited by 84
  10. 2019Event-Based Motion Segmentation by Motion Compensationcited by 78
  11. 2024Recent Event Camera Innovations: A Surveycited by 68
  12. 2018Semi-Dense 3D Reconstruction with a Stereo Event Cameracited by 67
  13. 2020DDD20 End-to-End Event Camera Driving Dataset: Fusing Frames and Events with Deep Learning for Improved Steering Predictioncited by 56
  14. 2016ESE: Efficient Speech Recognition Engine with Sparse LSTM on FPGAcited by 52
  15. 2023Speck: A Smart event-based Vision Sensor with a low latency 327K Neuron Convolutional Neuronal Network Processing Pipelinecited by 52
  16. 2023Graph-based Asynchronous Event Processing for Rapid Object Recognitioncited by 51
  17. 2018Unsupervised Learning of a Hierarchical Spiking Neural Network for Optical Flow Estimation: From Events to Global Motion Perceptioncited by 48
  18. 2020EventHands: Real-Time Neural 3D Hand Pose Estimation from an Event Streamcited by 48
  19. 2024Towards Robust Event-guided Low-Light Image Enhancement: A Large-Scale Real-World Event-Image Dataset and Novel Approachcited by 48
  20. 2019EVDodgeNet: Deep Dynamic Obstacle Dodging with Event Camerascited by 46
  21. 2022Dense Continuous-Time Optical Flow from Events and Framescited by 46
  22. 2019A General Optimization-based Framework for Local Odometry Estimation with Multiple Sensorscited by 45
  23. 2022VECtor: A Versatile Event-Centric Benchmark for Multi-Sensor SLAMcited by 45
  24. 2023Cross-modal Orthogonal High-rank Augmentation for RGB-Event Transformer-trackerscited by 43
  25. 2021EventHPE: Event-based 3D Human Pose and Shape Estimationcited by 42
  26. 2021TUM-VIE: The TUM Stereo Visual-Inertial Event Datasetcited by 41
  27. 2017NullHop: A Flexible Convolutional Neural Network Accelerator Based on Sparse Representations of Feature Mapscited by 39
  28. 2024Scene Adaptive Sparse Transformer for Event-based Object Detectioncited by 39
  29. 2020Event Probability Mask (EPM) and Event Denoising Convolutional Neural Network (EDnCNN) for Neuromorphic Camerascited by 38
  30. 2021A Voxel Graph CNN for Object Classification with Event Camerascited by 38
  31. 2024OpenESS: Event-based Semantic Scene Understanding with Open Vocabulariescited by 38
  32. 2025UrbanVideo-Bench: Benchmarking Vision-Language Models on Embodied Intelligence with Video Data in Urban Spacescited by 36
  33. 2021Event-driven Vision and Control for UAVs on a Neuromorphic Chipcited by 34
  34. 2020Globally Optimal Contrast Maximisation for Event-based Motion Estimationcited by 33
  35. 2022ESVIO: Event-based Stereo Visual Inertial Odometrycited by 33
  36. 2022Lightweight Event-based Optical Flow Estimation via Iterative Deblurringcited by 31
  37. 2024CMax-SLAM: Event-based Rotational-Motion Bundle Adjustment and SLAM System using Contrast Maximizationcited by 31
  38. 2023CMDA: Cross-Modality Domain Adaptation for Nighttime Semantic Segmentationcited by 30

50 most cited of 115 All 115 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 2; 2026: 4.

6 papers.