REACT: A Fully Spiking State-Space Model for Real-Time Event-Driven Temporal Perception
Not on the map. Why?
Abstract (arXiv)
Robotic systems operating in dynamic environments require visual perception that evolves continuously with the incoming sensory stream. Event cameras provide microsecond temporal resolution and asynchronous sensing, but most learning-based methods accumulate events into frames or temporal bins, introducing an integration delay that can limit fast reaction. Here we propose REACT, a fully spiking state-space model for event-driven temporal perception that processes raw events one by one, without temporal accumulation. REACT uses a complex-valued spiking neuron, C-SiLIF, whose continuous-time dynamics are driven by the physical inter-event interval, allowing its internal state to evolve at the temporal resolution of individual events. We evaluate REACT on gesture recognition and time-to-collision (TTC) estimation from full-field event streams, without a target bounding box or localization input. On EvTTC, REACT achieves a 9.59% relative TTC error with 4.6 ms end-to-end inference latency, within 0.15 percentage points of the best learned method while requiring no target prior. At the dataset's mean approach speed, this latency corresponds to only 4 cm of vehicle motion, compared with 1 m for the fastest competing learned method. REACT further supports anytime TTC prediction, zero-shot transfer to a different driving sequence, and INT8 quantization, reducing the estimated energy consumption from 18.5 to 2.8 mJ per 32,768 events. These results show that event-driven spiking state-space dynamics can provide low-latency, continuously updated temporal perception for reactive robotic systems.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 23 of its 34 references that are in the map. First posted on arXiv 16 Sep 2026.
Builds on
23 of 34 references.
References · 23
- 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,718
- 2019CutMix: Regularization Strategy to Train Strong Classifiers with Localizable Featurescited by 2,884
- 2021Efficiently Modeling Long Sequences with Structured State Spacescited by 2,465
- 2019Event-based Vision: A Surveycited by 1,016
- 2022Simplified State Space Layers for Sequence Modelingcited by 788
- 2022On the Parameterization and Initialization of Diagonal State Space Modelscited by 424
- 2019End-to-End Learning of Representations for Asynchronous Event-Based Datacited by 217
- 2018A Unifying Contrast Maximization Framework for Event Cameras, with Applications to Motion, Depth, and Optical Flow Estimationcited by 178
- 2023SpikingJelly: An open-source machine learning infrastructure platform for spike-based intelligencecited by 169
- 2024State Space Models for Event Camerascited by 75
- 2022Neuromorphic Data Augmentation for Training Spiking Neural Networkscited by 52
- 2022An Analytical Estimation of Spiking Neural Networks Energy Efficiencycited by 38
11 more
- 2024Scalable Event-by-event Processing of Neuromorphic Sensory Signals With Deep State-Space Modelscited by 31
- 2023Learning Long Sequences in Spiking Neural Networkscited by 19
- 2023Asynchronous Blob Tracker for Event Camerascited by 16
- 2024Balanced Resonate-and-Fire Neuronscited by 12
- 2022Globally Optimal Event-Based Divergence Estimation for Ventral Landingcited by 9
- 2024Event-Aided Time-to-Collision Estimation for Autonomous Drivingcited by 8
- 2025Compute-in-Memory Implementation of State Space Models for Event Sequence Processingcited by 6
- 2021FAITH: Fast iterative half-plane focus of expansion estimation using event-based optic flowcited by 5
- 2024EvTTC: An Event Camera Dataset for Time-to-Collision Estimationcited by 3
- 2025SiLIF: Structured State Space Model Dynamics and Parametrization for Spiking Neural Networkscited by 3
- 2026Toward Deep Representation Learning for Event-Enhanced Visual Autonomous Perception: the eAP Datasetcited by 2
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026TEMPO: Learning Temporal Context for Dynamic Robot Manipulation
- 2026Spike-driven Vision-Language-Action Model
- 2026Temporal Policy: History-Initialized Action Generation for Robotic Learning from Demonstration
- 2026Chameleon: Control-Indexed Prospective Memory for Visuomotor Manipulation
- 2026Chronos Policy: Learning Robot Policies on Physical Time
- 2026Reflex: Enabling Fast and Predictive Vision-Language-Action Models for Reaction-Critical Manipulation
- 2026ActiveArena: Benchmarking and Understanding Active Perception in Robotic Manipulation
- 2025VLASH: Real-Time VLAs via Future-State-Aware Asynchronous Inference