mlsanityData to 14 Oct 2026

Lightweight Vision Transformer with Window and Spatial Attention for Food Image Classification

arXiv 2509.18692 ↗First posted 23 Sep 2025cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

With the rapid development of society and continuous advances in science and technology, the food industry increasingly demands higher production quality and efficiency. Food image classification plays a vital role in enabling automated quality control on production lines, supporting food safety supervision, and promoting intelligent agricultural production. However, this task faces challenges due to the large number of parameters and high computational complexity of Vision Transformer models. To address these issues, we propose a lightweight food image classification algorithm that integrates a Window Multi-Head Attention Mechanism (WMHAM) and a Spatial Attention Mechanism (SAM). The WMHAM reduces computational cost by capturing local and global contextual features through efficient window partitioning, while the SAM adaptively emphasizes key spatial regions to improve discriminative feature representation. Experiments conducted on the Food-101 and Vireo Food-172 datasets demonstrate that our model achieves accuracies of 95.24% and 94.33%, respectively, while significantly reducing parameters and FLOPs compared with baseline methods. These results confirm that the proposed approach achieves an effective balance between computational efficiency and classification performance, making it well-suited for deployment in resource-constrained environments.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 8 of its 35 references that are in the map. First posted on arXiv 23 Sep 2025.

Builds on

8 of 35 references.

References · 8

  1. 2017Attention Is All You Needcited by 60,361
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  3. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
  4. 2018CBAM: Convolutional Block Attention Modulecited by 2,477
  5. 2018Self-Attention with Relative Position Representationscited by 1,120
  6. 2020Efficient Transformers: A Surveycited by 790
  7. 2020A Survey on Visual Transformercited by 654
  8. 2017Residual Attention Network for Image Classificationcited by 386

Built on by

Not cited yet.