Retina-Inspired Object Motion Segmentation for Event-Cameras
Not on the map. Why?
Abstract (arXiv)
Event-cameras have emerged as a revolutionary technology with a high temporal resolution that far surpasses standard active pixel cameras. This technology draws biological inspiration from photoreceptors and the initial retinal synapse. This research showcases the potential of additional retinal functionalities to extract visual features. We provide a domain-agnostic and efficient algorithm for ego-motion compensation based on Object Motion Sensitivity (OMS), one of the multiple features computed within the mammalian retina. We develop a method based on experimental neuroscience that translates OMS' biological circuitry to a low-overhead algorithm to suppress camera motion bypassing the need for deep networks and learning. Our system processes event data from dynamic scenes to perform pixel-wise object motion segmentation using a real and synthetic dataset. This paper introduces a bio-inspired computer vision method that dramatically reduces the number of parameters by 103 to 106 orders of magnitude compared to previous approaches. Our work paves the way for robust, high-speed, and low-bandwidth decision-making for in-sensor computations.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 16 of its 36 references that are in the map. First posted on arXiv 18 Aug 2024.
Builds on
16 of 36 references.
References · 16
- 2017PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Spacecited by 4,384
- 2019Event-based Vision: A Surveycited by 1,010
- 2017Unsupervised Learning of Depth and Ego-Motion from Videocited by 778
- 2018Unsupervised Event-based Learning of Optical Flow, Depth, and Egomotioncited by 304
- 2018A Unifying Contrast Maximization Framework for Event Cameras, with Applications to Motion, Depth, and Optical Flow Estimationcited by 178
- 2018Event-based Moving Object Detection and Trackingcited by 126
- 2019Event-Based Motion Segmentation by Motion Compensationcited by 78
- 20223D Object Detection from Images for Autonomous Driving: A Surveycited by 66
- 2019EV-IMO: Motion Segmentation Dataset and Learning Pipeline for Event Camerascited by 46
- 2019EVDodgeNet: Deep Dynamic Obstacle Dodging with Event Camerascited by 46
- 2021SpikeMS: Deep Spiking Neural Network for Motion Segmentationcited by 29
- 2018Simultaneous Optical Flow and Segmentation (SOFAS) using Dynamic Vision Sensorcited by 21
4 more
- 2017Independent Motion Detection with Event-driven Camerascited by 8
- 20200-MMS: Zero-Shot Multi-Motion Segmentation With A Monocular Event Cameracited by 4
- 2022IRIS: Integrated Retinal Functionality in Image Sensorscited by 4
- 2024Hardware-Algorithm Re-engineering of Retinal Circuit for Intelligent Object Motion Segmentationcited by 2
Built on by
Citing papers per year: 2025: 2.
2 papers.