Applications of Spiking Neural Networks in Visual Place Recognition
Not on the map. Why?
Abstract (arXiv)
In robotics, Spiking Neural Networks (SNNs) are increasingly recognized for their largely-unrealized potential energy efficiency and low latency particularly when implemented on neuromorphic hardware. Our paper highlights three advancements for SNNs in Visual Place Recognition (VPR). Firstly, we propose Modular SNNs, where each SNN represents a set of non-overlapping geographically distinct places, enabling scalable networks for large environments. Secondly, we present Ensembles of Modular SNNs, where multiple networks represent the same place, significantly enhancing accuracy compared to single-network models. Each of our Modular SNN modules is compact, comprising only 1500 neurons and 474k synapses, making them ideally suited for ensembling due to their small size. Lastly, we investigate the role of sequence matching in SNN-based VPR, a technique where consecutive images are used to refine place recognition. We demonstrate competitive performance of our method on a range of datasets, including higher responsiveness to ensembling compared to conventional VPR techniques and higher R@1 improvements with sequence matching than VPR techniques with comparable baseline performance. Our contributions highlight the viability of SNNs for VPR, offering scalable and robust solutions, and paving the way for their application in various energy-sensitive robotic tasks.
Key facts. Cited by 9 papers in the map (data through 14 Oct 2026). Builds on 73 of its 163 references that are in the map. First posted on arXiv 22 Nov 2023.
Builds on
73 of 163 references.
References · 73
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,364
- 2014ImageNet Large Scale Visual Recognition Challengecited by 8,498
- 2016Simple and Scalable Predictive Uncertainty Estimation using Deep Ensemblescited by 3,926
- 2019Event-based Vision: A Surveycited by 1,016
- 2018CosFace: Large Margin Cosine Loss for Deep Face Recognitioncited by 971
- 2015NetVLAD: CNN architecture for weakly supervised place recognitioncited by 941
- 2018From Coarse to Fine: Robust Hierarchical Localization at Large Scalecited by 559
- 2017Fine-tuning CNN Image Retrieval with No Human Annotationcited by 499
- 2016Past, Present, and Future of Simultaneous Localization And Mapping: Towards the Robust-Perception Agecited by 411
- 2021Ensemble deep learning: A reviewcited by 284
- 2021Training Spiking Neural Networks Using Lessons From Deep Learningcited by 259
38 more
- 2016Large-Scale Image Retrieval with Attentive Deep Local Featurescited by 238
- 2021Patch-NetVLAD: Multi-Scale Fusion of Locally-Global Descriptors for Place Recognitioncited by 238
- 2019Learning with Average Precision: Training Image Retrieval with a Listwise Losscited by 185
- 2022Rethinking Visual Geo-localization for Large-Scale Applicationscited by 163
- 2023AnyLoc: Towards Universal Visual Place Recognitioncited by 163
- 2023MixVPR: Feature Mixing for Visual Place Recognitioncited by 161
- 2017Ultimate SLAM? Combining Events, Images, and IMU for Robust Visual SLAM in HDR and High Speed Scenarioscited by 150
- 2016Deep Image Retrieval: Learning global representations for image searchcited by 147
- 2022Toward Transparent AI: A Survey on Interpreting the Inner Structures of Deep Neural Networkscited by 129
- 2019Enabling Spike-based Backpropagation for Training Deep Neural Network Architecturescited by 123
- 2023Optimal ANN-SNN Conversion for High-accuracy and Ultra-low-latency Spiking Neural Networkscited by 122
- 2022TransVPR: Transformer-based place recognition with multi-level attention aggregationcited by 102
- 2020VPR-Bench: An Open-Source Visual Place Recognition Evaluation Framework with Quantifiable Viewpoint and Appearance Changecited by 101
- 2023Deep Model Fusion: A Surveycited by 91
- 2017A Survey of Neuromorphic Computing and Neural Networks in Hardwarecited by 85
- 2021Where is your place, Visual Place Recognition?cited by 82
- 2021Optimal ANN-SNN Conversion for Fast and Accurate Inference in Deep Spiking Neural Networkscited by 78
- 2021SeqNet: Learning Descriptors for Sequence-based Hierarchical Place Recognitioncited by 57
- 2020Deep Reinforcement Learning with Population-Coded Spiking Neural Network for Continuous Controlcited by 49
- 2016SegMatch: Segment based loop-closure for 3D point cloudscited by 48
- 2021A Survey on Ensemble Learning under the Era of Deep Learningcited by 47
- 2023Data-efficient Large Scale Place Recognition with Graded Similarity Supervisioncited by 43
- 2019Scalable Place Recognition Under Appearance Change for Autonomous Drivingcited by 42
- 2019Multi-Process Fusion: Visual Place Recognition Using Multiple Image Processing Methodscited by 38
- 2020Event-based visual place recognition with ensembles of temporal windowscited by 36
- 2021Event-driven Vision and Control for UAVs on a Neuromorphic Chipcited by 34
- 2021Hyperdimensional computing as a framework for systematic aggregation of image descriptorscited by 32
- 2022The Revisiting Problem in Simultaneous Localization and Mapping: A Survey on Visual Loop Closure Detectioncited by 29
- 2021CarSNN: An Efficient Spiking Neural Network for Event-Based Autonomous Cars on the Loihi Neuromorphic Research Processorcited by 27
- 2022Learning Sequential Descriptors for Sequence-based Visual Place Recognitioncited by 25
- 2020Hierarchical Multi-Process Fusion for Visual Place Recognitioncited by 24
- 2020EAO-SLAM: Monocular Semi-Dense Object SLAM Based on Ensemble Data Associationcited by 24
- 2021Backpropagation with Biologically Plausible Spatio-Temporal Adjustment For Training Deep Spiking Neural Networkscited by 23
- 2020Delta Descriptors: Change-Based Place Representation for Robust Visual Localizationcited by 21
- 2021Bottom-up and top-down approaches for the design of neuromorphic processing systems: Tradeoffs and synergies between natural and artificial intelligencecited by 21
- 2021Probabilistic Visual Place Recognition for Hierarchical Localizationcited by 20
- 2019Spiking Neural Network on Neuromorphic Hardware for Energy-Efficient Unidimensional SLAMcited by 19
- 2019A Review of Modularization Techniques in Artificial Neural Networkscited by 19
50 most cited of 73 All 73 (JSON)
Built on by
Citing papers per year: 2024: 3; 2025: 2; 2026: 4.
9 papers.
- 2024General Place Recognition Survey: Towards Real-World Autonomycited by 23
- 2024On Motion Blur and Deblurring in Visual Place Recognitioncited by 3
- 2026Event-Driven Neuromorphic Vision Enables Energy-Efficient Visual Place Recognitioncited by 3
- 2026Quantile Transfer for Reliable Operating Point Selection in Visual Place Recognitioncited by 2
- 2024A Hyperdimensional One Place Signature to Represent Them All: Stackable Descriptors For Visual Place Recognitioncited by 1
- 2025On the Privacy Risks of Spiking Neural Networks: A Membership Inference Analysiscited by 1
- 2025Event-driven Robust Fitting on Neuromorphic Hardwarecited by 0
- 2026LEAR: Learning Edge-Aware Representations for Event-to-LiDAR Localizationcited by 0
- 2026Visual Place Recognition Using Rate-Encoded Spiking Neural Networks with Discrete STDP Learningcited by 0
- 2026Visual Place Recognition Using Rate-Encoded Spiking Neural Networks with Discrete STDP Learning15 Jul 2026
- 2026Event-Driven Neuromorphic Vision Enables Energy-Efficient Visual Place Recognition24 Mar 2026
- 2026LEAR: Learning Edge-Aware Representations for Event-to-LiDAR Localization2 Mar 2026
- 2026Quantile Transfer for Reliable Operating Point Selection in Visual Place Recognition4 Feb 2026
- 2025Event-driven Robust Fitting on Neuromorphic Hardware13 Aug 2025
- 2025On the Privacy Risks of Spiking Neural Networks: A Membership Inference Analysis18 Feb 2025
- 2024On Motion Blur and Deblurring in Visual Place Recognition10 Dec 2024
- 2024A Hyperdimensional One Place Signature to Represent Them All: Stackable Descriptors For Visual Place Recognition9 Dec 2024
- 2024General Place Recognition Survey: Towards Real-World Autonomy8 May 2024