mlsanityData to 7 Oct 2026

Other Tokens Matter: Exploring Global and Local Features of Vision Transformers for Object Re-Identification

arXiv 2404.14985 ↗First posted 23 Apr 2024cs.CV cs.MMcited by 9

Not on the map. Why?

Abstract (arXiv)

Object Re-Identification (Re-ID) aims to identify and retrieve specific objects from images captured at different places and times. Recently, object Re-ID has achieved great success with the advances of Vision Transformers (ViT). However, the effects of the global-local relation have not been fully explored in Transformers for object Re-ID. In this work, we first explore the influence of global and local features of ViT and then further propose a novel Global-Local Transformer (GLTrans) for high-performance object Re-ID. We find that the features from last few layers of ViT already have a strong representational ability, and the global and local information can mutually enhance each other. Based on this fact, we propose a Global Aggregation Encoder (GAE) to utilize the class tokens of the last few Transformer layers and learn comprehensive global features effectively. Meanwhile, we propose the Local Multi-layer Fusion (LMF) which leverages both the global cues from GAE and multi-layer patch tokens to explore the discriminative local representations. Extensive experiments demonstrate that our proposed method achieves superior performance on four object Re-ID benchmarks.

Key facts. Cited by 9 papers in the map (data through 7 Oct 2026). Builds on 55 of its 81 references that are in the map. First posted on arXiv 23 Apr 2024.

Builds on

55 of 81 references.

References · 55

  1. 2017Attention Is All You Needcited by 59,932
  2. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  3. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  4. 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,690
  5. 2016Layer Normalizationcited by 5,579
  6. 2017Non-local Neural Networkscited by 2,290
  7. 2013Sinkhorn Distances: Lightspeed Computation of Optimal Transportation Distancescited by 2,277
  8. 2019Deep High-Resolution Representation Learning for Human Pose Estimationcited by 1,339
  9. 2017Random Erasing Data Augmentationcited by 1,235
  10. 2017In Defense of the Triplet Loss for Person Re-Identificationcited by 784
  11. 2021PVT v2: Improved Baselines with Pyramid Vision Transformercited by 749
  12. 2016Performance Measures and a Data Set for Multi-Target, Multi-Camera Trackingcited by 685
38 more
  1. 2020Deep Learning for Person Re-identification: A Survey and Outlookcited by 547
  2. 2017Person Transfer GAN to Bridge Domain Gap for Person Re-Identificationcited by 479
  3. 2017Beyond Part Models: Person Retrieval with Refined Part Pooling (and a Strong Convolutional Baseline)cited by 472
  4. 2021TransReID: Transformer-based Object Re-Identificationcited by 432
  5. 2019Omni-Scale Feature Learning for Person Re-Identificationcited by 292
  6. 2018Learning Discriminative Features with Multiple Granularities for Person Re-Identificationcited by 290
  7. 2018Harmonious Attention Network for Person Re-Identificationcited by 211
  8. 2016Person Re-identification: Past, Present and Futurecited by 180
  9. 2021Conformer: Local Features Coupling Global Representations for Visual Recognitioncited by 164
  10. 2020Style Normalization and Restitution for Generalizable Person Re-identificationcited by 136
  11. 2019ABD-Net: Attentive but Diverse Person Re-Identificationcited by 126
  12. 2019Relation-Aware Global Attention for Person Re-identificationcited by 124
  13. 2021Diverse Part Discovery: Occluded Person Re-identification with Part-Aware Transformercited by 119
  14. 2020Identity-Guided Human Semantic Parsing for Person Re-Identificationcited by 118
  15. 2018Human Semantic Parsing for Person Re-identificationcited by 100
  16. 2018Part-Aligned Bilinear Representations for Person Re-identificationcited by 90
  17. 2022Dual Cross-Attention Learning for Fine-Grained Visual Categorization and Object Re-Identificationcited by 78
  18. 2021Pose-guided Feature Disentangling for Occluded Person Re-identification Based on Transformercited by 68
  19. 2017AlignedReID: Surpassing Human-Level Performance in Person Re-Identificationcited by 61
  20. 2022NFormer: Robust Person Re-identification with Neighbor Transformercited by 57
  21. 2019Perceive Where to Focus: Learning Visibility-aware Part-level Features for Partial Person Re-identificationcited by 55
  22. 2020Parsing-based View-aware Embedding Network for Vehicle Re-Identificationcited by 53
  23. 2018Dual Attention Matching Network for Context-Aware Feature Sequence based Person Re-Identificationcited by 50
  24. 2018Attention-Aware Compositional Network for Person Re-identificationcited by 50
  25. 2021AAformer: Auto-Aligned Transformer for Person Re-Identificationcited by 48
  26. 2019Vehicle Re-identification with Viewpoint-aware Metric Learningcited by 45
  27. 2021Combined Depth Space based Architecture Search For Person Re-identificationcited by 44
  28. 2018Re-Identification with Consistent Attentive Siamese Networkscited by 40
  29. 2022Learning Progressive Modality-shared Transformers for Effective Visible-Infrared Person Re-identificationcited by 40
  30. 2023TF-CLIP: Learning Text-free CLIP for Video-based Person Re-Identificationcited by 40
  31. 2020The Devil is in the Details: Self-Supervised Attention for Vehicle Re-Identificationcited by 39
  32. 2021HAT: Hierarchical Aggregation Transformers for Person Re-identificationcited by 39
  33. 2024Magic Tokens: Select Diverse Tokens for Multi-modal Object Re-Identificationcited by 34
  34. 2020Uncertainty-Aware Multi-Shot Knowledge Distillation for Image-Based Object Re-Identificationcited by 31
  35. 2023TOP-ReID: Multi-spectral Object Re-Identification with Token Permutationcited by 31
  36. 2021A Video Is Worth Three Views: Trigeminal Transformers for Video-based Person Re-identificationcited by 28
  37. 2020Orientation-aware Vehicle Re-identification with Semantics-guided Part Attention Networkcited by 26
  38. 2019Stripe-based and Attribute-aware Network: A Two-Branch Deep Model for Vehicle Re-identificationcited by 22

50 most cited of 55 All 55 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 3; 2025: 2; 2026: 4.

9 papers.