mlsanityData to 7 Oct 2026

Recent Advances of Local Mechanisms in Computer Vision: A Survey and Outlook of Recent Work

arXiv 2306.01929 ↗First posted 2 Jun 2023cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Inspired by the fact that human brains can emphasize discriminative parts of the input and suppress irrelevant ones, substantial local mechanisms have been designed to boost the development of computer vision. They can not only focus on target parts to learn discriminative local representations, but also process information selectively to improve the efficiency. In terms of application scenarios and paradigms, local mechanisms have different characteristics. In this survey, we provide a systematic review of local mechanisms for various computer vision tasks and approaches, including fine-grained visual recognition, person re-identification, few-/zero-shot learning, multi-modal learning, self-supervised learning, Vision Transformers, and so on. Categorization of local mechanisms in each field is summarized. Then, advantages and disadvantages for every category are analyzed deeply, leaving room for exploration. Finally, future research directions about local mechanisms have also been discussed that may benefit future works. To the best our knowledge, this is the first survey about local mechanisms on computer vision. We hope that this survey can shed light on future research in the computer vision field.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 234 of its 314 references that are in the map. First posted on arXiv 2 Jun 2023.

Builds on

234 of 314 references.

References · 234

  1. 2017Attention Is All You Needcited by 59,932
  2. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  3. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  4. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  5. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  6. 2014Microsoft COCO: Common Objects in Contextcited by 17,498
  7. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
  8. 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
  9. 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,617
  10. 2014ImageNet Large Scale Visual Recognition Challengecited by 8,441
  11. 2016Communication-Efficient Learning of Deep Networks from Decentralized Datacited by 7,592
  12. 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
38 more
  1. 2017Mask R-CNNcited by 7,259
  2. 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,893
  3. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
  4. 2016Layer Normalizationcited by 5,579
  5. 2017mixup: Beyond Empirical Risk Minimizationcited by 5,155
  6. 2016Feature Pyramid Networks for Object Detectioncited by 5,021
  7. 2014Fully Convolutional Networks for Semantic Segmentationcited by 4,845
  8. 2017Squeeze-and-Excitation Networkscited by 4,763
  9. 2013Auto-Encoding Variational Bayescited by 3,980
  10. 2017Prototypical Networks for Few-shot Learningcited by 3,001
  11. 2020Unsupervised Learning of Visual Features by Contrasting Cluster Assignmentscited by 2,845
  12. 2015FaceNet: A Unified Embedding for Face Recognition and Clusteringcited by 2,833
  13. 2015VQA: Visual Question Answeringcited by 2,489
  14. 2021BEiT: BERT Pre-Training of Image Transformerscited by 2,360
  15. 2013Deep Inside Convolutional Networks: Visualising Image Classification Models and Saliency Mapscited by 2,348
  16. 2020Improved Baselines with Momentum Contrastive Learningcited by 2,282
  17. 2013Visualizing and Understanding Convolutional Networkscited by 2,278
  18. 2021Pyramid Vision Transformer: A Versatile Backbone for Dense Prediction without Convolutionscited by 1,960
  19. 2013Fine-Grained Visual Classification of Aircraftcited by 1,701
  20. 2021Align before Fuse: Vision and Language Representation Learning with Momentum Distillationcited by 1,612
  21. 2016Context Encoders: Feature Learning by Inpaintingcited by 1,424
  22. 2015Spatial Transformer Networkscited by 1,423
  23. 2015Show, Attend and Tell: Neural Image Caption Generation with Visual Attentioncited by 1,421
  24. 2017Bottom-Up and Top-Down Attention for Image Captioning and Visual Question Answeringcited by 1,310
  25. 2022VideoMAE: Masked Autoencoders are Data-Efficient Learners for Self-Supervised Video Pre-Trainingcited by 1,305
  26. 2021ViLT: Vision-and-Language Transformer Without Convolution or Region Supervisioncited by 1,224
  27. 2021SimMIM: A Simple Framework for Masked Image Modelingcited by 1,147
  28. 2021Grounded Language-Image Pre-trainingcited by 1,147
  29. 2017Learning to Compare: Relation Network for Few-Shot Learningcited by 1,139
  30. 2021Tokens-to-Token ViT: Training Vision Transformers from Scratch on ImageNetcited by 1,096
  31. 2021Transformers in Vision: A Surveycited by 1,009
  32. 2017Multimodal Machine Learning: A Survey and Taxonomycited by 1,004
  33. 2019VL-BERT: Pre-training of Generic Visual-Linguistic Representationscited by 954
  34. 2021CvT: Introducing Convolutions to Vision Transformerscited by 946
  35. 2021DynamicViT: Efficient Vision Transformers with Dynamic Token Sparsificationcited by 849
  36. 2020Self-supervised Learning: Generative or Contrastivecited by 693
  37. 2020A Survey on Visual Transformercited by 653
  38. 2021FLAVA: A Foundational Language And Vision Alignment Modelcited by 646

50 most cited of 234 All 234 (JSON)

Built on by

Not cited yet.