# Attention Mechanisms for Object Recognition with Event-Based Cameras

arXiv: https://arxiv.org/abs/1807.09480 · HTML: https://mlsanity.com/paper/1807.09480/

## Key facts

- Cited by 13 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 25 Jul 2018.

## Built on by (most cited first, 13 of 13)

- [Temporal-wise Attention Spiking Neural Networks for Event Streams Classification](https://mlsanity.com/paper/2107.11711/) (2021)
- [Recent Event Camera Innovations: A Survey](https://mlsanity.com/paper/2408.13627/) (2024)
- [Spikeformer: A Novel Architecture for Training High-Performance Low-Latency Spiking Neural Network](https://mlsanity.com/paper/2211.10686/) (2022)
- [How Many Events do You Need? Event-based Visual Place Recognition Using Sparse But Varying Pixels](https://mlsanity.com/paper/2206.13673/) (2022)
- [Neuromorphic Drone Detection: an Event-RGB Multimodal Approach](https://mlsanity.com/paper/2409.16099/) (2024)
- [Event-LSTM: An Unsupervised and Asynchronous Learning-based Representation for Event-based Data](https://mlsanity.com/paper/2105.04216/) (2021)
- [A Spatial-channel-temporal-fused Attention for Spiking Neural Networks](https://mlsanity.com/paper/2209.10837/) (2022)
- [Unleashing the Power of CNN and Transformer for Balanced RGB-Event Video Recognition](https://mlsanity.com/paper/2312.11128/) (2023)
- [Razor SNN: Efficient Spiking Neural Network with Temporal Embeddings](https://mlsanity.com/paper/2306.17597/) (2023)
- [Bio-inspired visual attention for silicon retinas based on spiking neural networks applied to pattern classification](https://mlsanity.com/paper/2105.14753/) (2021)
- [Predictive Temporal Attention on Event-based Video Stream for Energy-efficient Situation Awareness](https://mlsanity.com/paper/2402.08936/) (2024)
- [TRIP: Trainable Region-of-Interest Prediction for Hardware-Efficient Neuromorphic Processing on Event-based Vision](https://mlsanity.com/paper/2406.17483/) (2024)
- [A dynamic vision sensor object recognition model based on trainable event-driven convolution and spiking attention mechanism](https://mlsanity.com/paper/2409.12691/) (2024)

## Abstract (arXiv)

Event-based cameras are neuromorphic sensors capable of efficiently encoding visual information in the form of sparse sequences of events. Being biologically inspired, they are commonly used to exploit some of the computational and power consumption benefits of biological vision. In this paper we focus on a specific feature of vision: visual attention. We propose two attentive models for event based vision: an algorithm that tracks events activity within the field of view to locate regions of interest and a fully-differentiable attention procedure based on DRAW neural model. We highlight the strengths and weaknesses of the proposed methods on four datasets, the Shifted N-MNIST, Shifted MNIST-DVS, CIFAR10-DVS and N-Caltech101 collections, using the Phased LSTM recognition network as a baseline reference model obtaining improvements in terms of both translation and scale invariance.
