Bend the Clock: Predicting Ahead to Beat Latency in Event-Based Object Detection
Not on the map. Why?
Abstract (arXiv)
Event cameras promise low-latency perception for high-speed robotic systems, where even short delays can render detections stale by the time they inform downstream robotic decisions. Yet modern event detectors still require tens of milliseconds of computation before their predictions become available. Conventional evaluation ignores this delay by comparing predictions with annotations at the observation timestamp, even though the scene may have changed by the time those predictions are produced. We study this observation-availability mismatch in event-based multi-object detection and show that state-of-the-art event detectors degrade substantially when evaluated at prediction availability rather than observation time. To address this, we introduce ChronoFuse, a causal availability-time detector that predicts object states for when its output becomes available rather than for when its input was observed. ChronoFuse performs causal cross-time fusion over a multi-scale feature hierarchy, combining current representations with cached temporal features to expose short-term temporal cues without using future observations. The fusion pathway is lightweight, adding only 0.17 million parameters and 0.84 ms of mean end-to-end latency overhead. ChronoFuse recovers 71% of the accuracy lost to latency on 1Mpx driving data and 90.8% under rapid drone motion on FRED, nearly restoring zero-delay performance. Under the extreme motion of EV-Flying, ChronoFuse reaches 20.95 sAP, compared with 2.25 for the strongest standard event detector (9.3x gain). These results show that predicting ahead can be critical for robots operating in fast-changing scenes, including autonomous driving, agile flight, and robotic interception.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 17 of its 21 references that are in the map. First posted on arXiv 22 Sep 2026.
Builds on
17 of 21 references.
References · 17
- 2021YOLOX: Exceeding YOLO Series in 2021cited by 1,071
- 2019Event-based Vision: A Surveycited by 1,016
- 2020Learning to Detect Objects with a 1 Megapixel Event Cameracited by 186
- 2022Recurrent Vision Transformers for Object Detection with Event Camerascited by 159
- 2024State Space Models for Event Camerascited by 75
- 2023SODFormer: Streaming Object Detection with Transformer Using Events and Framescited by 39
- 2024Scene Adaptive Sparse Transformer for Event-based Object Detectioncited by 39
- 2022Real-time Object Detection for Streaming Perceptioncited by 30
- 2025SMamba: Sparse Mamba for Event-based Object Detectioncited by 19
- 2025FRED: The Florence RGB-Event Drone Datasetcited by 16
- 2023DAMO-StreamNet: Optimizing Streaming Perception in Autonomous Drivingcited by 13
- 2022LongShortNet: Exploring Temporal and Semantic Features Fusion in Streaming Perceptioncited by 12
5 more
- 2024E-Motion: Future Motion Simulation via Event Sequence Diffusioncited by 12
- 2025EV-Flying: an Event-based Dataset for In-The-Wild Recognition of Flying Objectscited by 9
- 2024Transtreaming: Adaptive Delay-aware Transformer for Real-time Streaming Perceptioncited by 3
- 2026Low-Latency Event-Based Object Detection with Spatially-Sparse Linear Attentioncited by 3
- 2026E-TIDE: Fast, Structure-Preserving Motion Forecasting from Event Sequencescited by 1
Built on by
Not cited yet.