PlantExpertVQA: A Visual Question Answering Dataset for Benchmarking Vision-Language Models in Plant Science
On the map: LLM reasoning → Clinical and biomedical applications
Abstract (arXiv)
Existing plant-disease datasets target classification and detection, leaving vision-language models unable to support interactive, reasoning-based diagnosis. To address this, we present PlantExpertVQA, a large-scale visual question answering (VQA) dataset designed to advance vision-language models for agricultural decision-making. It is compiled from 45 open-source datasets, including the widely used PlantVillage corpus, and comprises 765,186 high-quality question-answer (QA) pairs grounded over 150,841 images spanning 38 crop species and 89 disease conditions. Questions are organized into 3 levels of cognitive complexity and 9 distinct categories. Each was phrased following expert guidance and generated via an automated two-stage pipeline: template-based QA synthesis from image metadata, followed by multi-stage linguistic re-engineering. The dataset was iteratively reviewed by domain experts for scientific accuracy and relevance. We find that current frontier vision-language models, including recent open-source instruction-tuned multimodal LLMs, perform poorly on PlantExpertVQA. However, parameter-efficient fine-tuning of a compact 2B-parameter model on a small fraction of the dataset yields substantial improvements across all question categories, demonstrating its effectiveness for domain adaptation.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Placed in Clinical and biomedical applications, one of 17 directions in LLM reasoning. Builds on 25 of its 76 references that are in the map. First posted on arXiv 23 Aug 2025.
Builds on
25 of 76 references.
References · 25
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2023Visual Instruction Tuningcited by 7,792
- 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,069
- 2019BERTScore: Evaluating Text Generation with BERTcited by 5,462
- 2023Improved Baselines with Visual Instruction Tuningcited by 4,362
- 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generationcited by 4,310
- 2016SQuAD: 100,000+ Questions for Machine Comprehension of Textcited by 4,115
- 2023InstructBLIP: Towards General-purpose Vision-Language Models with Instruction Tuningcited by 2,855
- 2015VQA: Visual Question Answeringcited by 2,489
- 2023Qwen-VL: A Versatile Vision-Language Model for Understanding, Localization, Text Reading, and Beyondcited by 2,179
- 2025Gemma 3 Technical Reportcited by 1,686
- 2021Conceptual 12M: Pushing Web-Scale Image-Text Pre-Training To Recognize Long-Tail Visual Conceptscited by 1,209
13 more
- 2020PathVQA: 30000+ Questions for Medical Visual Question Answeringcited by 467
- 2021SLAKE: A Semantically-Labeled Knowledge-Enhanced Dataset for Medical Visual Question Answeringcited by 444
- 2023PMC-VQA: Visual Instruction Tuning for Medical Visual Question Answeringcited by 333
- 2015Stacked Attention Networks for Image Question Answeringcited by 273
- 2016Using Deep Learning for Image-Based Plant Disease Detectioncited by 216
- 2023LingoQA: Visual Question Answering for Autonomous Drivingcited by 144
- 2015An open access repository of images on plant health to enable the development of mobile disease diagnosticscited by 132
- 2019PlantDoc: A Dataset for Visual Plant Disease Detectioncited by 65
- 2024AgroGPT: Efficient Agricultural Vision-Language Model with Expert Tuningcited by 23
- 2025AgroBench: Vision-Language Model Benchmark in Agriculturecited by 19
- 2025AgMMU: A Comprehensive Agricultural Multimodal Understanding Benchmarkcited by 15
- 2025A Multimodal Benchmark Dataset and Model for Crop Disease Diagnosiscited by 14
- 2023BloomVQA: Assessing Hierarchical Multi-modal Comprehensioncited by 3
Built on by
Citing papers per year: 2026: 3.
3 papers.
- 2026AgriChat: A Multimodal Large Language Model for Agriculture Image Understandingcited by 2
- 2026A Two-Stage Multitask Vision-Language Framework for Explainable Crop Disease Visual Question Answeringcited by 0
- 2026Beyond Routing Saturation: A Long-Horizon Class-Incremental Perspective on Expert Routing in Multimodal Continual Instruction Tuningcited by 0
- 2026Beyond Routing Saturation: A Long-Horizon Class-Incremental Perspective on Expert Routing in Multimodal Continual Instruction Tuning2 Aug 2026
- 2026AgriChat: A Multimodal Large Language Model for Agriculture Image Understanding14 Mar 2026
- 2026A Two-Stage Multitask Vision-Language Framework for Explainable Crop Disease Visual Question Answering8 Jan 2026
Similar, not cited
Close in wording, no citation either way
- 2026LeafNet: A Large-Scale Dataset and Comprehensive Benchmark for Foundational Vision-Language Understanding of Plant Diseases
- 2026Thinking Like a Botanist: Challenging Multimodal Language Models with Intent-Driven Chain-of-Inquiry
- 2025AgroCoT: A Chain-of-Thought Benchmark for Evaluating Reasoning in Vision-Language Models for Agriculture
- 2026AgroGround: Multi-Granularity Grounded Recognition in Agriculture
- 2026A Multi-Modal Generative Model for Tomato Disease Leaves Understanding
- 2026AgriChain Visually Grounded Expert Verified Reasoning for Interpretable Agricultural Vision Language Models
- 2026Vision-language models know more about agriculture than they show and rubric-grounded verifications close the gap
- 2026TomaMMU: A Comprehensive Multimodal Understanding Benchmark for Tomato Leaf Diseases