mlsanityData to 14 Oct 2026

Can Spiking Neural Networks play pinball? A neuromorphic motion detector for target tracking

arXiv 2609.24403 ↗First posted 21 Sep 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Biological visual systems achieve continuous, low-latency motion perception by processing sparse, asynchronous spiking signals, enabling real-time tracking under strict energy constraints. Event-based cameras, inspired by the mammalian retina, replicate this efficiency by capturing only local brightness changes as asynchronous events, offering a natural substrate for spiking neural networks (SNNs) to parallelise computation and adapt to fast-changing scenes. Pinball provides a controlled yet dynamic testbed, requiring precise motion estimation and fast reaction to a small, rapidly moving target. This work presents a fully spiking, real-time perception-to-action pipeline for closed-loop pinball gameplay. A dynamic vision sensor observes a small, fast-moving ball, and a network of spiking Time-Difference Encoders on the SpiNNaker neuromorphic platform jointly estimates its position, speed, and direction. The system is characterised across receptive field size, accumulation window, and angular tuning width for real-time operation, and benchmarked in closed loop against human players across two flipper regimes of increasing physical realism. It achieves a hit rate of 56.1%, nearly double the human average, reacting within 21.7 ms (5 ms network latency) and consuming an estimated 148 μW using fewer than 25k neurons, among the fastest and most energy-efficient event-based closed-loop demonstrators benchmarked. Under more realistic flipper dynamics, tuning a single interpretable policy parameter reproduces the full spectrum of human play styles, from cautious to aggressive, with no change to the perception pipeline. A physical demonstrator, tracking a real ball and actuating real flippers in closed loop, confirms the principle operates beyond simulation. Its fully spiking, learning-free design offers a compact, energy-efficient example of real-time neuromorphic perception-to-action.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 20 of its 80 references that are in the map. First posted on arXiv 21 Sep 2026.

Builds on

20 of 80 references.

References · 20

  1. 2019Event-based Vision: A Surveycited by 1,016
  2. 2018Real-world Anomaly Detection in Surveillance Videoscited by 577
  3. 2021DSEC: A Stereo Event Camera Dataset for Driving Scenarioscited by 303
  4. 2018The Multi Vehicle Stereo Event Camera Dataset: An Event Camera Dataset for 3D Perceptioncited by 254
  5. 2018EV-FlowNet: Self-Supervised Optical Flow Estimation for Event-based Camerascited by 224
  6. 2018Event-based Vision meets Deep Learning on Steering Prediction for Self-driving Carscited by 200
  7. 2017A scalable multi-core architecture with heterogeneous memory structures for Dynamic Neuromorphic Asynchronous Processors (DYNAPs)cited by 52
  8. 2022The BrainScaleS-2 accelerated neuromorphic system with hybrid plasticitycited by 42
  9. 2020Event-Based Angular Velocity Regression with Spiking Networkscited by 41
  10. 2021SpikeMS: Deep Spiking Neural Network for Motion Segmentationcited by 29
  11. 2023EV-Catcher: High-Speed Object Catching Using Low-latency Event-based Neural Networkscited by 16
  12. 2022Tracking Small and Fast Moving Objects: A Benchmarkcited by 11
8 more
  1. 2025From Tiny Machine Learning to Tiny Deep Learning: A Surveycited by 5
  2. 2022PUCK: Parallel Surface and Convolution-kernel Tracking for Event-Based Camerascited by 4
  3. 2024Detection of Fast-Moving Objects with Neuromorphic Hardwarecited by 4
  4. 2024Deep Event-based Object Detection in Autonomous Driving: A Surveycited by 4
  5. 2019ATIS + SpiNNaker: a Fully Event-based Visual Tracking Demonstrationcited by 1
  6. 2024TDE-3: An improved prior for optical flow computation in spiking neural networkscited by 1
  7. 2024Neuromorphic dreaming: A pathway to efficient learning in artificial agentscited by 1
  8. 2026Training slow silicon neurons to control extremely fast robots with spiking reinforcement learningcited by 1

Built on by

Not cited yet.