mlsanityData to 14 Oct 2026

Vision Transformers in Precision Agriculture: A Comprehensive Survey

arXiv 2504.21706 ↗First posted 30 Apr 2025cs.CV cs.AIcited by 6

Not on the map. Why?

Abstract (arXiv)

Detecting plant diseases is a crucial aspect of modern agriculture, as it plays a key role in maintaining crop health and increasing overall yield. Traditional approaches, though still valuable, often rely on manual inspection or conventional machine learning techniques, both of which face limitations in scalability and accuracy. Recently, Vision Transformers (ViTs) have emerged as a promising alternative, offering advantages such as improved handling of long-range dependencies and better scalability for visual tasks. This review explores the application of ViTs in precision agriculture, covering a range of tasks. We begin by introducing the foundational architecture of ViTs and discussing their transition from Natural Language Processing (NLP) to Computer Vision. The discussion includes the concept of inductive bias in traditional models like Convolutional Neural Networks (CNNs), and how ViTs mitigate these biases. We provide a comprehensive review of recent literature, focusing on key methodologies, datasets, and performance metrics. This study also includes a comparative analysis of CNNs and ViTs, along with a review of hybrid models and performance enhancements. Technical challenges such as data requirements, computational demands, and model interpretability are addressed, along with potential solutions. Finally, we outline future research directions and technological advancements that could further support the integration of ViTs in real-world agricultural settings. Our goal with this study is to offer practitioners and researchers a deeper understanding of how ViTs are poised to transform smart and precision agriculture.

Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Builds on 46 of its 126 references that are in the map. First posted on arXiv 30 Apr 2025.

Builds on

46 of 126 references.

References · 46

  1. 2017Attention Is All You Needcited by 60,361
  2. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  3. 2020Language Models are Few-Shot Learnerscited by 32,419
  4. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  5. 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,364
  6. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
  7. 2015Distilling the Knowledge in a Neural Networkcited by 10,324
  8. 2017Mask R-CNNcited by 7,277
  9. 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,733
  10. 2016Densely Connected Convolutional Networkscited by 6,720
  11. 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,442
  12. 2015You Only Look Once: Unified, Real-Time Object Detectioncited by 4,852
34 more
  1. 2018MobileNetV2: Inverted Residuals and Linear Bottleneckscited by 4,795
  2. 2017Squeeze-and-Excitation Networkscited by 4,789
  3. 2020Training data-efficient image transformers & distillation through attentioncited by 4,586
  4. 2014Going Deeper with Convolutionscited by 4,241
  5. 2017MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applicationscited by 3,845
  6. 2016Aggregated Residual Transformations for Deep Neural Networkscited by 2,546
  7. 2016Pyramid Scene Parsing Networkcited by 2,479
  8. 2021BEiT: BERT Pre-Training of Image Transformerscited by 2,375
  9. 2016Convolutional Neural Networks on Graphs with Fast Localized Spectral Filteringcited by 2,089
  10. 2019Searching for MobileNetV3cited by 1,994
  11. 2016Identity Mappings in Deep Residual Networkscited by 1,965
  12. 2021Pyramid Vision Transformer: A Versatile Backbone for Dense Prediction without Convolutionscited by 1,962
  13. 2021Swin-Unet: Unet-like Pure Transformer for Medical Image Segmentationcited by 1,222
  14. 2016Group Equivariant Convolutional Networkscited by 1,165
  15. 2021EfficientNetV2: Smaller Models and Faster Trainingcited by 1,135
  16. 2021Tokens-to-Token ViT: Training Vision Transformers from Scratch on ImageNetcited by 1,101
  17. 2014Spatial Pyramid Pooling in Deep Convolutional Networks for Visual Recognitioncited by 720
  18. 2021Do Vision Transformers See Like Convolutional Neural Networks?cited by 675
  19. 2021MobileViT: Light-weight, General-purpose, and Mobile-friendly Vision Transformercited by 642
  20. 2021ConViT: Improving Vision Transformers with Soft Convolutional Inductive Biasescited by 484
  21. 2022MaxViT: Multi-Axis Vision Transformercited by 476
  22. 2021Early Convolutions Help Transformers See Bettercited by 396
  23. 2021ResMLP: Feedforward networks for image classification with data-efficient trainingcited by 339
  24. 2020Inductive Biases for Deep Learning of Higher-Level Cognitioncited by 275
  25. 2020Generalizing Convolutional Neural Networks for Equivariance to Lie Groups on Arbitrary Continuous Datacited by 248
  26. 2016Using Deep Learning for Image-Based Plant Disease Detectioncited by 219
  27. 2017Equivariance Through Parameter-Sharingcited by 141
  28. 2019PlantDoc: A Dataset for Visual Plant Disease Detectioncited by 68
  29. 2021Co-advise: Cross Inductive Bias Distillationcited by 40
  30. 2017A Public Image Database for Benchmark of Plant Seedling Classification Algorithmscited by 20
  31. 2021A Random CNN Sees Objects: One Inductive Bias of CNN and Its Applicationscited by 15
  32. 2023DeNoising-MOT: Towards Multiple Object Tracking with Severe Occlusionscited by 12
  33. 2022Paddy Doctor: A Visual Image Dataset for Automated Paddy Disease Classification and Benchmarkingcited by 4
  34. 2021CD&S Dataset: Handheld Imagery Dataset Acquired Under Field Conditions for Corn Disease Identification and Severity Estimationcited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 5; 2026: 1.

6 papers.