Event Camera Meets Mobile Embodied Perception: Abstraction, Algorithm, Acceleration, Application
Not on the map. Why?
Abstract (arXiv)
With the increasing complexity of mobile device applications, these devices are evolving toward high agility. This shift imposes new demands on mobile sensing, particularly in achieving high-accuracy and low-latency. Event-based vision has emerged as a disruptive paradigm, offering high temporal resolution and low latency, making it well-suited for high-accuracy and low-latency sensing tasks on high-agility platforms. However, the presence of substantial noisy events, lack of stable, persistent semantic information, and large data volume pose challenges for event-based data processing on resource-constrained mobile devices. This paper surveys the literature from 2014 to 2025 and presents a comprehensive overview of event-based mobile sensing, encompassing its fundamental principles, event textitabstraction methods, textitalgorithm advancements, and both hardware and software textitacceleration strategies. We discuss key textitapplications of event cameras in mobile sensing, including visual odometry, object tracking, optical flow, and 3D reconstruction, while highlighting challenges associated with event data processing, sensor fusion, and real-time deployment. Furthermore, we outline future research directions, such as improving the event camera with advanced optics, leveraging neuromorphic computing for efficient processing, and integrating bio-inspired algorithms. To support ongoing research, we provide an open-source textitOnline Sheet with recent developments. We hope this survey serves as a reference, facilitating the adoption of event-based vision across diverse applications.
Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Builds on 115 of its 274 references that are in the map. First posted on arXiv 29 Mar 2025.
Builds on
115 of 274 references.
References · 115
- 2019Event-based Vision: A Surveycited by 1,016
- 2019Surrogate Gradient Learning in Spiking Neural Networkscited by 626
- 2019High Speed and High Dynamic Range Video with an Event Cameracited by 345
- 2021DSEC: A Stereo Event Camera Dataset for Driving Scenarioscited by 303
- 2018The Multi Vehicle Stereo Event Camera Dataset: An Event Camera Dataset for 3D Perceptioncited by 254
- 2016The Event-Camera Dataset and Simulator: Event-based Data for Pose Estimation, Visual Odometry, and SLAMcited by 203
- 2019Events-to-Video: Bringing Modern Computer Vision to Event Camerascited by 193
- 2020Learning to Detect Objects with a 1 Megapixel Event Cameracited by 186
- 2018A Unifying Contrast Maximization Framework for Event Cameras, with Applications to Motion, Depth, and Optical Flow Estimationcited by 178
- 2022Recurrent Vision Transformers for Object Detection with Event Camerascited by 159
- 2017Ultimate SLAM? Combining Events, Images, and IMU for Robust Visual SLAM in HDR and High Speed Scenarioscited by 150
- 2018Asynchronous, Photometric Feature Tracking using Events and Framescited by 118
38 more
- 2022AEGNN: Asynchronous Event-based Graph Neural Networkscited by 118
- 2022Attention Spiking Neural Networkscited by 107
- 2020Event-based Stereo Visual Odometrycited by 105
- 2020Event-based Asynchronous Sparse Convolutional Networkscited by 104
- 2018Event-based High Dynamic Range Image and Very High Frame Rate Video Generation using Conditional Generative Adversarial Networkscited by 97
- 2023Deep Learning for Event-based Vision: A Comprehensive Survey and Benchmarkscited by 90
- 2018InteriorNet: Mega-scale Multi-sensor Photo-realistic Indoor Scenes Datasetcited by 87
- 2019Graph-Based Object Classification for Neuromorphic Vision Sensingcited by 85
- 2021Object Tracking by Jointly Exploiting Frame and Event Domaincited by 84
- 2019Event-Based Motion Segmentation by Motion Compensationcited by 78
- 2024Recent Event Camera Innovations: A Surveycited by 68
- 2018Semi-Dense 3D Reconstruction with a Stereo Event Cameracited by 67
- 2020DDD20 End-to-End Event Camera Driving Dataset: Fusing Frames and Events with Deep Learning for Improved Steering Predictioncited by 56
- 2016ESE: Efficient Speech Recognition Engine with Sparse LSTM on FPGAcited by 52
- 2023Speck: A Smart event-based Vision Sensor with a low latency 327K Neuron Convolutional Neuronal Network Processing Pipelinecited by 52
- 2023Graph-based Asynchronous Event Processing for Rapid Object Recognitioncited by 51
- 2018Unsupervised Learning of a Hierarchical Spiking Neural Network for Optical Flow Estimation: From Events to Global Motion Perceptioncited by 48
- 2020EventHands: Real-Time Neural 3D Hand Pose Estimation from an Event Streamcited by 48
- 2024Towards Robust Event-guided Low-Light Image Enhancement: A Large-Scale Real-World Event-Image Dataset and Novel Approachcited by 48
- 2019EVDodgeNet: Deep Dynamic Obstacle Dodging with Event Camerascited by 46
- 2022Dense Continuous-Time Optical Flow from Events and Framescited by 46
- 2019A General Optimization-based Framework for Local Odometry Estimation with Multiple Sensorscited by 45
- 2022VECtor: A Versatile Event-Centric Benchmark for Multi-Sensor SLAMcited by 45
- 2023Cross-modal Orthogonal High-rank Augmentation for RGB-Event Transformer-trackerscited by 43
- 2021EventHPE: Event-based 3D Human Pose and Shape Estimationcited by 42
- 2021TUM-VIE: The TUM Stereo Visual-Inertial Event Datasetcited by 41
- 2017NullHop: A Flexible Convolutional Neural Network Accelerator Based on Sparse Representations of Feature Mapscited by 39
- 2024Scene Adaptive Sparse Transformer for Event-based Object Detectioncited by 39
- 2020Event Probability Mask (EPM) and Event Denoising Convolutional Neural Network (EDnCNN) for Neuromorphic Camerascited by 38
- 2021A Voxel Graph CNN for Object Classification with Event Camerascited by 38
- 2024OpenESS: Event-based Semantic Scene Understanding with Open Vocabulariescited by 38
- 2025UrbanVideo-Bench: Benchmarking Vision-Language Models on Embodied Intelligence with Video Data in Urban Spacescited by 36
- 2021Event-driven Vision and Control for UAVs on a Neuromorphic Chipcited by 34
- 2020Globally Optimal Contrast Maximisation for Event-based Motion Estimationcited by 33
- 2022ESVIO: Event-based Stereo Visual Inertial Odometrycited by 33
- 2022Lightweight Event-based Optical Flow Estimation via Iterative Deblurringcited by 31
- 2024CMax-SLAM: Event-based Rotational-Motion Bundle Adjustment and SLAM System using Contrast Maximizationcited by 31
- 2023CMDA: Cross-Modality Domain Adaptation for Nighttime Semantic Segmentationcited by 30
50 most cited of 115 All 115 (JSON)
Built on by
Citing papers per year: 2025: 2; 2026: 4.
6 papers.
- 2025Event-based Optical Marker Systems: A surveycited by 1
- 2026x2-Fusion: Cross-Modality and Cross-Dimension Flow Estimation in Event Edge Spacecited by 1
- 2025HOMI: Ultra-Fast EdgeAI platform for Event Camerascited by 0
- 2026See Silhouettes in Motion with Neuromorphic Visioncited by 0
- 2026Minimal Solvers for Full-DoF Motion Estimation from Asynchronous Differential SfMcited by 0
- 2026Unified Complex-valued Neural Network: A Magnitude-Phase Computational Model for Event-Driven Neuromorphic Learningcited by 0
- 2026Unified Complex-valued Neural Network: A Magnitude-Phase Computational Model for Event-Driven Neuromorphic Learning27 Jun 2026
- 2026Minimal Solvers for Full-DoF Motion Estimation from Asynchronous Differential SfM8 Jun 2026
- 2026See Silhouettes in Motion with Neuromorphic Vision18 May 2026
- 2026x2-Fusion: Cross-Modality and Cross-Dimension Flow Estimation in Event Edge Space17 Mar 2026
- 2025HOMI: Ultra-Fast EdgeAI platform for Event Cameras18 Aug 2025
- 2025Event-based Optical Marker Systems: A survey29 Apr 2025