Quantitative evaluation of brain-inspired vision sensors in high-speed robotic perception
Not on the map. Why?
Abstract (arXiv)
Perception systems in robotics encounter significant challenges in high-speed and dynamic conditions when relying on traditional cameras, where motion blur can compromise spatial feature integrity and task performance. Brain-inspired vision sensors (BVS) have recently gained attention as an alternative, offering high temporal resolution with reduced bandwidth and power requirements. Here, we present the first quantitative evaluation framework for two representative classes of BVSs in variable-speed robotic sensing, including event-based vision sensors (EVS) that detect asynchronous temporal contrasts, and the primitive-based sensor Tianmouc that employs a complementary mechanism to encode both spatiotemporal changes and intensity. A unified testing protocol is established, including crosssensor calibrations, standardized testing platforms, and quality metrics to address differences in data modality. From an imaging standpoint, we evaluate the effects of sensor non-idealities, such as motion-induced distortion, on the capture of structural information. For functional benchmarking, we examine task performance in corner detection and motion estimation under different rotational speeds. Results indicate that EVS performs well in highspeed, sparse scenarios and in modestly fast, complex scenes, but exhibits performance limitations in high-speed, cluttered settings due to pixel-level bandwidth variations and event rate saturation. In comparison, Tianmouc demonstrates consistent performance across sparse and complex scenarios at various speeds, supported by its global, precise, high-speed spatiotemporal gradient samplings. These findings offer valuable insights into the applicationdependent suitability of BVS technologies and support further advancement in this area.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 13 of its 33 references that are in the map. First posted on arXiv 27 Apr 2025.
Builds on
13 of 33 references.
References · 13
- 2019Event-based Vision: A Surveycited by 1,016
- 2019High Speed and High Dynamic Range Video with an Event Cameracited by 345
- 2018EV-FlowNet: Self-Supervised Optical Flow Estimation for Event-based Camerascited by 224
- 2018A Unifying Contrast Maximization Framework for Event Cameras, with Applications to Motion, Depth, and Optical Flow Estimationcited by 178
- 2021TimeLens: Event-based Video Frame Interpolationcited by 151
- 2018Asynchronous, Photometric Feature Tracking using Events and Framescited by 118
- 2023Event Stream-based Visual Object Tracking: A High-Resolution Benchmark Dataset and A Novel Baselinecited by 73
- 2023E-MLB: Multilevel Benchmark for Event-Based Camera Denoisingcited by 27
- 2023EVREAL: Towards a Comprehensive Benchmark and Analysis Suite for Event-based Video Reconstructioncited by 24
- 2023EventAid: Benchmarking Event-aided Image/Video Enhancement Algorithms with Real-captured Hybrid Datasetcited by 19
- 2022Are High-Resolution Event Cameras Really Needed?cited by 18
- 2024Microsaccade-inspired Event Camera for Roboticscited by 17
Built on by
Not cited yet.