# Flow-Based Visual Stream Compression for Event Cameras

arXiv: https://arxiv.org/abs/2403.08086 · HTML: https://mlsanity.com/paper/2403.08086/

## Key facts

- Cited by 2 papers in the map (data through 14 Oct 2026).
- Builds on 10 of its 35 references that are in the map.
- First posted on arXiv 12 Mar 2024.

## Builds on (most cited first, 10 of 10)

- [RAFT: Recurrent All-Pairs Field Transforms for Optical Flow](https://mlsanity.com/paper/2003.12039/) (2020)
- [Event-based Vision: A Survey](https://mlsanity.com/paper/1904.08405/) (2019)
- [The Multi Vehicle Stereo Event Camera Dataset: An Event Camera Dataset for 3D Perception](https://mlsanity.com/paper/1801.10202/) (2018)
- [EV-FlowNet: Self-Supervised Optical Flow Estimation for Event-based Cameras](https://mlsanity.com/paper/1802.06898/) (2018)
- [The Event-Camera Dataset and Simulator: Event-based Data for Pose Estimation, Visual Odometry, and SLAM](https://mlsanity.com/paper/1610.08336/) (2016)
- [E-RAFT: Dense Optical Flow from Event Cameras](https://mlsanity.com/paper/2108.10552/) (2021)
- [Real-time high speed motion prediction using fast aperture-robust event-driven visual flow](https://mlsanity.com/paper/1811.11135/) (2018)
- [Block-Matching Optical Flow for Dynamic Vision Sensor- Algorithm and FPGA Implementation](https://mlsanity.com/paper/1706.05415/) (2017)
- [A Novel Approach for Neuromorphic Vision Data Compression based on Deep Belief Network](https://mlsanity.com/paper/2210.15362/) (2022)
- [hARMS: A Hardware Acceleration Architecture for Real-Time Event-Based Optical Flow](https://mlsanity.com/paper/2112.06772/) (2021)

## Built on by (most cited first, 2 of 2)

- [Deep Learning-based Event Data Coding: A Joint Spatiotemporal and Polarity Solution](https://mlsanity.com/paper/2502.03285/) (2025)
- [Lossy Event Compression: From Event Stream Distortion to Task Performance](https://mlsanity.com/paper/2608.28429/) (2026)

## Abstract (arXiv)

As the use of neuromorphic, event-based vision sensors expands, the need for compression of their output streams has increased. While their operational principle ensures event streams are spatially sparse, the high temporal resolution of the sensors can result in high data rates from the sensor depending on scene dynamics. For systems operating in communication-bandwidth-constrained and power-constrained environments, it is essential to compress these streams before transmitting them to a remote receiver. Therefore, we introduce a flow-based method for the real-time asynchronous compression of event streams as they are generated. This method leverages real-time optical flow estimates to predict future events without needing to transmit them, therefore, drastically reducing the amount of data transmitted. The flow-based compression introduced is evaluated using a variety of methods including spatiotemporal distance between event streams. The introduced method itself is shown to achieve an average compression ratio of 2.81 on a variety of event-camera datasets with the evaluation configuration used. That compression is achieved with a median temporal error of 0.48 ms and an average spatiotemporal event-stream distance of 3.07. When combined with LZMA compression for non-real-time applications, our method can achieve state-of-the-art average compression ratios ranging from 10.45 to 17.24. Additionally, we demonstrate that the proposed prediction algorithm is capable of performing real-time, low-latency event prediction.
