Human-inspired Global-to-Parallel Multi-scale Encoding for Lightweight Vision Models
Not on the map. Why?
Abstract (arXiv)
Lightweight vision networks have witnessed remarkable progress in recent years, yet achieving a satisfactory balance among parameter scale, computational overhead, and task performance remains difficult. Although many existing lightweight models manage to reduce computation considerably, they often do so at the expense of a substantial increase in parameter count (e.g., LSNet, MobileMamba), which still poses obstacles for deployment on resource-limited devices. In parallel, some studies attempt to draw inspiration from human visual perception, but their modeling tends to oversimplify the visual process, making it hard to reflect how perception truly operates. Revisiting the cooperative mechanism of the human visual system, we propose GPM (Global-to-Parallel Multi-scale Encoding). GPM first employs a Global Insight Generator (GIG) to extract holistic cues, and subsequently processes features of different scales through parallel branches: LSAE emphasizes mid-/large-scale semantic relations, while IRB (Inverted Residual Block) preserves fine-grained texture information, jointly enabling coherent representation of global and local features. As such, GPM conforms to two characteristic behaviors of human vision perceiving the whole before focusing on details, and maintaining broad contextual awareness even during local attention. Built upon GPM, we further develop the lightweight H-GPE network. Experiments on image classification, object detection, and semantic segmentation show that H-GPE achieves strong performance while maintaining a balanced footprint in both FLOPs and parameters, delivering a more favorable accuracy-efficiency trade-off compared with recent state-of-the-art lightweight models.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 54 of its 74 references that are in the map. First posted on arXiv 13 Jan 2026.
Builds on
54 of 74 references.
References · 54
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2014Microsoft COCO: Common Objects in Contextcited by 17,608
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
- 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,442
- 2016Layer Normalizationcited by 5,669
- 2017mixup: Beyond Empirical Risk Minimizationcited by 5,183
- 2018MobileNetV2: Inverted Residuals and Linear Bottleneckscited by 4,795
- 2017Squeeze-and-Excitation Networkscited by 4,789
- 2020Training data-efficient image transformers & distillation through attentioncited by 4,586
- 2017MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applicationscited by 3,845
- 2022A ConvNet for the 2020scited by 3,579
38 more
- 2018CBAM: Convolutional Block Attention Modulecited by 2,477
- 2017Rethinking Atrous Convolution for Semantic Image Segmentationcited by 2,161
- 2021Pyramid Vision Transformer: A Versatile Backbone for Dense Prediction without Convolutionscited by 1,962
- 2018Group Normalizationcited by 1,524
- 2017Random Erasing Data Augmentationcited by 1,239
- 2018ShuffleNet V2: Practical Guidelines for Efficient CNN Architecture Designcited by 1,136
- 2024Vision Mamba: Efficient Visual Representation Learning with Bidirectional State Space Modelcited by 1,056
- 2021MobileViT: Light-weight, General-purpose, and Mobile-friendly Vision Transformercited by 642
- 2021Transformer in Transformercited by 633
- 2019ECA-Net: Efficient Channel Attention for Deep Convolutional Neural Networkscited by 575
- 2021MetaFormer Is Actually What You Need for Visioncited by 524
- 2021ResMLP: Feedforward networks for image classification with data-efficient trainingcited by 339
- 2021CMT: Convolutional Neural Networks Meet Vision Transformerscited by 310
- 2021Coordinate Attention for Efficient Mobile Network Designcited by 241
- 2024LocalMamba: Visual State Space Model with Windowed Selective Scancited by 236
- 2021Mobile-Former: Bridging MobileNet and Transformercited by 235
- 2020FcaNet: Frequency Channel Attention Networkscited by 179
- 2023FLatten Transformer: Vision Transformer using Focused Linear Attentioncited by 171
- 2022Separable Self-attention for Mobile Vision Transformerscited by 163
- 2023FastViT: A Fast Hybrid Vision Transformer using Structural Reparameterizationcited by 162
- 2024MambaOut: Do We Really Need Mamba for Vision?cited by 143
- 2020Lite Transformer with Long-Short Range Attentioncited by 127
- 2023RepViT: Revisiting Mobile CNN From ViT Perspectivecited by 123
- 2022EdgeNeXt: Efficiently Amalgamated CNN-Transformer Architecture for Mobile Vision Applicationscited by 121
- 2022Rethinking Vision Transformers for MobileNet Size and Speedcited by 121
- 2020Strip Pooling: Rethinking Spatial Pooling for Scene Parsingcited by 114
- 2024MobileNetV4 -- Universal Models for the Mobile Ecosystemcited by 99
- 2023SwiftFormer: Efficient Additive Attention for Transformer-based Real-time Mobile Vision Applicationscited by 66
- 2024Rewrite the Starscited by 55
- 2021SA-Net: Shuffle Attention for Deep Convolutional Neural Networkscited by 54
- 2023SpectFormer: Frequency and Attention is what you need in a Vision Transformercited by 48
- 2022MOAT: Alternating Mobile Convolution and Attention Brings Strong Vision Modelscited by 47
- 2022MobileViTv3: Mobile-Friendly Vision Transformer with Simple and Effective Fusion of Local, Global and Input Featurescited by 44
- 2021ConvMLP: Hierarchical Convolutional MLPs for Visioncited by 37
- 2023Rethinking Mobile Block for Efficient Attention-based Modelscited by 36
- 2023MobileViG: Graph-Based Sparse Attention for Mobile Vision Applicationscited by 35
- 2024SegMAN: Omni-scale Context Modeling with State Space Models and Local Attention for Semantic Segmentationcited by 31
- 2024QuadMamba: Learning Quadtree-based Selective Scan for Visual State Space Modelcited by 18
50 most cited of 54 All 54 (JSON)
Built on by
Not cited yet.