Are All Tokens Necessary for Visual Place Recognition? An Empirical Study of Token Reduction for Efficient Inference
On the map: Efficient LLM inference and serving → Visual token pruning in multimodal models
Abstract (arXiv)
Recent visual place recognition (VPR) methods based on vision transformers, particularly foundation models, have achieved remarkable recognition performance. However, these models process all visual tokens throughout the entire network, resulting in substantial computational overhead, which hinders their deployment in real-time and resource-constrained scenarios. A natural question thus arises: are all visual tokens necessary for VPR? To answer this question, we present the first systematic benchmark of token reduction for efficient visual place recognition. Our benchmark comprehensively evaluates representative token pruning, token merging, and hybrid pruning-merging methods across multiple state-of-the-art VPR models and diverse benchmark datasets covering urban, suburban, and natural environments. We further investigate token reduction from multiple perspectives, including recognition performance under different reduction configurations, computational complexity, inference speed, qualitative visualization, and deployment efficiency on edge devices. Through extensive experiments and in-depth analysis, our benchmark reveals multiple important characteristics of token reduction in VPR and provides several practical insights into the trade-offs between accuracy and inference efficiency. For example, token reduction can reduce computational cost by up to 29% and improve throughput by up to 44%, while incurring less than 1% degradation in recognition accuracy. Overall, this work establishes a comprehensive foundation for future research on token-efficient VPR and efficient visual retrieval systems. Our codes and models will be available at https://github.com/Tong-Jin01/TokenReduction4VPR
Key facts. No citing papers in the map yet (data through 13 Oct 2026). Placed in Visual token pruning in multimodal models, one of 12 directions in Efficient LLM inference and serving. Builds on 50 of its 67 references that are in the map. First posted on arXiv 17 Jul 2026.
Builds on
50 of 67 references.
Closest ancestors · 7
Same direction, newest first
- 2026AgilePruner: An Empirical Study of Attention and Diversity for Adaptive Visual Token Pruning in Large Vision-Language Models1 Mar
- 2025DivPrune: Diversity-based Visual Token Pruning for Large Multimodal Models4 Mar
- 2025What Kind of Visual Tokens Do We Need? Training-free Visual Token Pruning for Multi-modal Large Language Models from the Perspective of Graph4 Jan
- 2024Fit and Prune: Fast and Training-free Visual Token Pruning for Multi-modal Large Language Models16 Sep
- 2024LLaVA-PruMerge: Adaptive Token Reduction for Efficient Large Multimodal Models22 Mar
- 2024An Image is Worth 1/2 Tokens After Layer 2: Plug-and-Play Inference Acceleration for Large Vision-Language Models11 Mar
- 2023Token Merging for Fast Stable Diffusion30 Mar
Other references · 43
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,043
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,857
- 2022Token Merging: Your ViT But Fastercited by 1,000
- 2015NetVLAD: CNN architecture for weakly supervised place recognitioncited by 935
- 2021DynamicViT: Efficient Vision Transformers with Dynamic Token Sparsificationcited by 852
- 2022GroupViT: Semantic Segmentation Emerges from Text Supervisioncited by 531
- 2017Fine-tuning CNN Image Retrieval with No Human Annotationcited by 498
- 2016Past, Present, and Future of Simultaneous Localization And Mapping: Towards the Robust-Perception Agecited by 405
- 2019Multi-Similarity Loss with General Pair Weighting for Deep Metric Learningcited by 368
- 2021AdaViT: Adaptive Tokens for Efficient Vision Transformercited by 359
- 2021Patch-NetVLAD: Multi-Scale Fusion of Locally-Global Descriptors for Place Recognitioncited by 236
- 2021Adaptive Token Sampling For Efficient Vision Transformerscited by 180
31 more
- 2021Evo-ViT: Slow-Fast Token Evolution for Dynamic Vision Transformercited by 175
- 2022Rethinking Visual Geo-localization for Large-Scale Applicationscited by 160
- 2023MixVPR: Feature Mixing for Visual Place Recognitioncited by 160
- 2023Optimal Transport Aggregation for Visual Place Recognitioncited by 151
- 2021IA-RED2: Interpretability-Aware Redundancy Reduction for Vision Transformerscited by 127
- 2023Token Fusion: Bridging the Gap between Token Pruning and Token Mergingcited by 124
- 2023EigenPlaces: Training Viewpoint Robust Models for Visual Place Recognitioncited by 109
- 2020VPR-Bench: An Open-Source Visual Place Recognition Evaluation Framework with Quantifiable Viewpoint and Appearance Changecited by 101
- 2022Not All Tokens Are Equal: Human-centric Visual Analysis via Token Clustering Transformercited by 100
- 2022Deep Visual Geo-localization Benchmarkcited by 83
- 2023Joint Token Pruning and Squeezing Towards More Aggressive Compression of Vision Transformerscited by 79
- 2024BoQ: A Place is Worth a Bag of Learnable Queriescited by 63
- 2023Zero-TPrune: Zero-Shot Token Pruning through Leveraging of the Attention Graph in Pre-Trained Transformerscited by 62
- 2023Which Tokens to Use? Investigating Token Reduction in Vision Transformerscited by 59
- 2024Towards Seamless Adaptation of Pre-trained Models for Visual Place Recognitioncited by 49
- 2023Data-efficient Large Scale Place Recognition with Graded Similarity Supervisioncited by 43
- 2018Single-View Place Recognition under Seasonal Changescited by 35
- 2021Probabilistic Visual Place Recognition for Hierarchical Localizationcited by 20
- 2025Focus on Local: Finding Reliable Discriminative Regions for Visual Place Recognitioncited by 16
- 2020Binary Neural Networks for Memory-Efficient and Effective Visual Place Recognition in Changing Environmentscited by 15
- 2024EffoVPR: Effective Foundation Model Utilization for Visual Place Recognitioncited by 15
- 2025SelaVPR++: Towards Seamless Adaptation of Foundation Models for Efficient Place Recognitioncited by 14
- 2020Fast, Compact and Highly Scalable Visual Place Recognition through Sequence-based Matching of Overloaded Representationscited by 10
- 2023Design Space Exploration of Low-Bit Quantized Neural Networks for Visual Place Recognitioncited by 10
- 2024EDTformer: An Efficient Decoder Transformer for Visual Place Recognitioncited by 10
- 2022Highly-Efficient Binary Neural Networks for Visual Place Recognitioncited by 7
- 2025Towards Implicit Aggregation: Robust Image Representation for Place Recognition in the Transformer Eracited by 6
- 2024Structured Pruning for Efficient Visual Place Recognitioncited by 3
- 2026Faster or Stronger: Towards Flexible Visual Place Recognition via Weighted Aggregation and Token Pruningcited by 3
- 2025Towards Test-time Efficient Visual Place Recognition via Asymmetric Query Processingcited by 2
- 2025TeTRA-VPR: A Ternary Transformer Approach for Compact Visual Place Recognitioncited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Scale, Don't Fine-tune: Guiding Multimodal LLMs for Efficient Visual Place Recognition at Test-Time
- 2026LaVPR: Benchmarking Language and Vision for Place Recognition
- 2023Distillation Improves Visual Place Recognition for Low Quality Images
- 2025VScan: Rethinking Visual Token Reduction for Efficient Large Vision-Language Models
- 2025VLM-Pruner: Buffering for Spatial Sparsity in an Efficient VLM Centrifugal Token Pruning Paradigm
- 2026Unified Spatio-Temporal Token Scoring for Efficient Video VLMs
- 2026Breaking D'ej`a Vu: Independent Auditing of Visual Place Recognition through Vision-Language Reasoning
- 2026Attention-Free and Lightweight Token Reduction for Efficient Vision-Language Models