mlsanityData to 14 Oct 2026

Human-inspired Global-to-Parallel Multi-scale Encoding for Lightweight Vision Models

arXiv 2601.08190 ↗First posted 13 Jan 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Lightweight vision networks have witnessed remarkable progress in recent years, yet achieving a satisfactory balance among parameter scale, computational overhead, and task performance remains difficult. Although many existing lightweight models manage to reduce computation considerably, they often do so at the expense of a substantial increase in parameter count (e.g., LSNet, MobileMamba), which still poses obstacles for deployment on resource-limited devices. In parallel, some studies attempt to draw inspiration from human visual perception, but their modeling tends to oversimplify the visual process, making it hard to reflect how perception truly operates. Revisiting the cooperative mechanism of the human visual system, we propose GPM (Global-to-Parallel Multi-scale Encoding). GPM first employs a Global Insight Generator (GIG) to extract holistic cues, and subsequently processes features of different scales through parallel branches: LSAE emphasizes mid-/large-scale semantic relations, while IRB (Inverted Residual Block) preserves fine-grained texture information, jointly enabling coherent representation of global and local features. As such, GPM conforms to two characteristic behaviors of human vision perceiving the whole before focusing on details, and maintaining broad contextual awareness even during local attention. Built upon GPM, we further develop the lightweight H-GPE network. Experiments on image classification, object detection, and semantic segmentation show that H-GPE achieves strong performance while maintaining a balanced footprint in both FLOPs and parameters, delivering a more favorable accuracy-efficiency trade-off compared with recent state-of-the-art lightweight models.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 54 of its 74 references that are in the map. First posted on arXiv 13 Jan 2026.

Builds on

54 of 74 references.

References · 54

  1. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  3. 2014Microsoft COCO: Common Objects in Contextcited by 17,608
  4. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
  5. 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,442
  6. 2016Layer Normalizationcited by 5,669
  7. 2017mixup: Beyond Empirical Risk Minimizationcited by 5,183
  8. 2018MobileNetV2: Inverted Residuals and Linear Bottleneckscited by 4,795
  9. 2017Squeeze-and-Excitation Networkscited by 4,789
  10. 2020Training data-efficient image transformers & distillation through attentioncited by 4,586
  11. 2017MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applicationscited by 3,845
  12. 2022A ConvNet for the 2020scited by 3,579
38 more
  1. 2018CBAM: Convolutional Block Attention Modulecited by 2,477
  2. 2017Rethinking Atrous Convolution for Semantic Image Segmentationcited by 2,161
  3. 2021Pyramid Vision Transformer: A Versatile Backbone for Dense Prediction without Convolutionscited by 1,962
  4. 2018Group Normalizationcited by 1,524
  5. 2017Random Erasing Data Augmentationcited by 1,239
  6. 2018ShuffleNet V2: Practical Guidelines for Efficient CNN Architecture Designcited by 1,136
  7. 2024Vision Mamba: Efficient Visual Representation Learning with Bidirectional State Space Modelcited by 1,056
  8. 2021MobileViT: Light-weight, General-purpose, and Mobile-friendly Vision Transformercited by 642
  9. 2021Transformer in Transformercited by 633
  10. 2019ECA-Net: Efficient Channel Attention for Deep Convolutional Neural Networkscited by 575
  11. 2021MetaFormer Is Actually What You Need for Visioncited by 524
  12. 2021ResMLP: Feedforward networks for image classification with data-efficient trainingcited by 339
  13. 2021CMT: Convolutional Neural Networks Meet Vision Transformerscited by 310
  14. 2021Coordinate Attention for Efficient Mobile Network Designcited by 241
  15. 2024LocalMamba: Visual State Space Model with Windowed Selective Scancited by 236
  16. 2021Mobile-Former: Bridging MobileNet and Transformercited by 235
  17. 2020FcaNet: Frequency Channel Attention Networkscited by 179
  18. 2023FLatten Transformer: Vision Transformer using Focused Linear Attentioncited by 171
  19. 2022Separable Self-attention for Mobile Vision Transformerscited by 163
  20. 2023FastViT: A Fast Hybrid Vision Transformer using Structural Reparameterizationcited by 162
  21. 2024MambaOut: Do We Really Need Mamba for Vision?cited by 143
  22. 2020Lite Transformer with Long-Short Range Attentioncited by 127
  23. 2023RepViT: Revisiting Mobile CNN From ViT Perspectivecited by 123
  24. 2022EdgeNeXt: Efficiently Amalgamated CNN-Transformer Architecture for Mobile Vision Applicationscited by 121
  25. 2022Rethinking Vision Transformers for MobileNet Size and Speedcited by 121
  26. 2020Strip Pooling: Rethinking Spatial Pooling for Scene Parsingcited by 114
  27. 2024MobileNetV4 -- Universal Models for the Mobile Ecosystemcited by 99
  28. 2023SwiftFormer: Efficient Additive Attention for Transformer-based Real-time Mobile Vision Applicationscited by 66
  29. 2024Rewrite the Starscited by 55
  30. 2021SA-Net: Shuffle Attention for Deep Convolutional Neural Networkscited by 54
  31. 2023SpectFormer: Frequency and Attention is what you need in a Vision Transformercited by 48
  32. 2022MOAT: Alternating Mobile Convolution and Attention Brings Strong Vision Modelscited by 47
  33. 2022MobileViTv3: Mobile-Friendly Vision Transformer with Simple and Effective Fusion of Local, Global and Input Featurescited by 44
  34. 2021ConvMLP: Hierarchical Convolutional MLPs for Visioncited by 37
  35. 2023Rethinking Mobile Block for Efficient Attention-based Modelscited by 36
  36. 2023MobileViG: Graph-Based Sparse Attention for Mobile Vision Applicationscited by 35
  37. 2024SegMAN: Omni-scale Context Modeling with State Space Models and Local Attention for Semantic Segmentationcited by 31
  38. 2024QuadMamba: Learning Quadtree-based Selective Scan for Visual State Space Modelcited by 18

50 most cited of 54 All 54 (JSON)

Built on by

Not cited yet.