AgriGPT-VL: Agricultural Vision-Language Understanding Suite
On the map: LLM reasoning → Clinical and biomedical applications
Abstract (arXiv)
Despite rapid advances in multimodal large language models, agricultural applications remain constrained by the scarcity of domain-tailored models, curated vision-language corpora, and rigorous evaluation. To address these challenges, we present the AgriGPT-VL Suite, a unified multimodal framework for agriculture. Our contributions are threefold. First, we introduce Agri-3M-VL, the largest vision-language corpus for agriculture to our knowledge, curated by a scalable multi-agent data generator; it comprises 1M image-caption pairs, 2M image-grounded VQA pairs, 50K expert-level VQA instances, and 15K GRPO reinforcement learning samples. Second, we develop AgriGPT-VL, an agriculture-specialized vision-language model trained via a progressive curriculum of textual grounding, multimodal shallow/deep alignment, and GRPO refinement. This method achieves strong multimodal reasoning while preserving text-only capability. Third, we establish AgriBench-VL-4K, a compact yet challenging evaluation suite with open-ended and image-grounded questions, paired with multi-metric evaluation and an LLM-as-a-judge framework. Experiments show that AgriGPT-VL outperforms leading general-purpose VLMs on AgriBench-VL-4K, achieving higher pairwise win rates in the LLM-as-a-judge evaluation. Meanwhile, it remains competitive on the text-only AgriBench-13K with no noticeable degradation of language ability. Ablation studies further confirm consistent gains from our alignment and GRPO refinement stages. We will open source all of the resources to support reproducible research and deployment in low-resource agricultural settings.
Key facts. Cited by 11 papers in the map (data through 7 Oct 2026). Placed in Clinical and biomedical applications, one of 17 directions in LLM reasoning. Builds on 28 of its 59 references that are in the map. First posted on arXiv 5 Oct 2025.
Builds on
28 of 59 references.
References · 28
- 2023GPT-4 Technical Reportcited by 18,132
- 2023Visual Instruction Tuningcited by 7,792
- 2020Measuring Massive Multitask Language Understandingcited by 7,768
- 2025Qwen2.5-VL Technical Reportcited by 5,418
- 2018Think you have Solved Question Answering? Try ARC, the AI2 Reasoning Challengecited by 4,710
- 2023Improved Baselines with Visual Instruction Tuningcited by 4,362
- 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,131
- 2023Qwen-VL: A Versatile Vision-Language Model for Understanding, Localization, Text Reading, and Beyondcited by 2,179
- 2018Can a Suit of Armor Conduct Electricity? A New Dataset for Open Book Question Answeringcited by 2,114
- 2023MMBench: Is Your Multi-modal Model an All-around Player?cited by 2,105
- 2023MMMU: A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for Expert AGIcited by 2,044
- 2025InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Modelscited by 1,769
16 more
- 2024MiniCPM-V: A GPT-4V Level MLLM on Your Phonecited by 1,061
- 2023A Survey on Multimodal Large Language Modelscited by 898
- 2024Are We on the Right Way for Evaluating Large Vision-Language Models?cited by 893
- 2024DeepSeek-VL: Towards Real-World Vision-Language Understandingcited by 718
- 2022A Survey of Vision-Language Pre-Trained Modelscited by 177
- 2018Deep learning in agriculture: A surveycited by 160
- 2015An open access repository of images on plant health to enable the development of mobile disease diagnosticscited by 132
- 2024Leveraging Vision Language Models for Specialized Agricultural Taskscited by 24
- 2025AgroBench: Vision-Language Model Benchmark in Agriculturecited by 19
- 2024Agri-LLaVA: Knowledge-Infused Large Multimodal Assistant on Agricultural Pests and Diseasescited by 14
- 2024AgriCLIP: Adapting CLIP for Agriculture and Livestock via Domain-Specialized Cross-Model Alignmentcited by 13
- 2024The New Agronomists: Language Models are Experts in Crop Managementcited by 12
- 2023Species196: A One-Million Semi-supervised Dataset for Fine-grained Species Recognitioncited by 11
- 2025AgriGPT: a Large Language Model Ecosystem for Agriculturecited by 11
- 2024AgriBench: A Hierarchical Agriculture Benchmark for Multimodal Large Language Modelscited by 7
- 2025AgriEval: A Comprehensive Chinese Agricultural Benchmark for Large Language Modelscited by 2
Built on by
Citing papers per year: 2025: 4; 2026: 7.
11 papers.
- 2025AgriRegion: Region-Aware Retrieval for High-Fidelity Agricultural Advicecited by 4
- 2025AgriGPT-Omni: A Unified Speech-Vision-Text Framework for Multilingual Agricultural Intelligencecited by 4
- 2025CPJ: Explainable Agricultural Pest Diagnosis via Caption-Prompt-Judge with LLM-Judged Refinementcited by 2
- 2026AgriChat: A Multimodal Large Language Model for Agriculture Image Understandingcited by 2
- 2026HarvestFlex: Strawberry Harvesting via Vision-Language-Action Policy Adaptation in the Wildcited by 1
- 2025AgroCoT: A Chain-of-Thought Benchmark for Evaluating Reasoning in Vision-Language Models for Agriculturecited by 0
- 2026AgroOmni: A Large-Scale Multi-view Agricultural Dataset for Cross-Scale Multimodal Reasoningcited by 0
- 2026AgriChain Visually Grounded Expert Verified Reasoning for Interpretable Agricultural Vision Language Modelscited by 0
- 2026Agri-CPJ: A Training-Free Explainable Framework for Agricultural Pest Diagnosis Using Caption-Prompt-Judge and LLM-as-a-Judgecited by 0
- 2026From Vision to Harvest: Benchmarking Vision-Language Models for Multi-Arm Robotic Fruit Harvestingcited by 0
- 2026AgriScope: Pixel-Grounded Multimodal Understanding for Agricultural Imagescited by 0
- 2026AgriScope: Pixel-Grounded Multimodal Understanding for Agricultural Images17 Sep 2026
- 2026From Vision to Harvest: Benchmarking Vision-Language Models for Multi-Arm Robotic Fruit Harvesting11 Sep 2026
- 2026Agri-CPJ: A Training-Free Explainable Framework for Agricultural Pest Diagnosis Using Caption-Prompt-Judge and LLM-as-a-Judge26 Apr 2026
- 2026AgriChain Visually Grounded Expert Verified Reasoning for Interpretable Agricultural Vision Language Models9 Apr 2026
- 2026AgroOmni: A Large-Scale Multi-view Agricultural Dataset for Cross-Scale Multimodal Reasoning15 Mar 2026
- 2026AgriChat: A Multimodal Large Language Model for Agriculture Image Understanding14 Mar 2026
- 2026HarvestFlex: Strawberry Harvesting via Vision-Language-Action Policy Adaptation in the Wild6 Mar 2026
- 2025CPJ: Explainable Agricultural Pest Diagnosis via Caption-Prompt-Judge with LLM-Judged Refinement31 Dec 2025
- 2025AgriGPT-Omni: A Unified Speech-Vision-Text Framework for Multilingual Agricultural Intelligence11 Dec 2025
- 2025AgriRegion: Region-Aware Retrieval for High-Fidelity Agricultural Advice10 Dec 2025
- 2025AgroCoT: A Chain-of-Thought Benchmark for Evaluating Reasoning in Vision-Language Models for Agriculture28 Nov 2025
Similar, not cited
Close in wording, no citation either way
- 2024AgroGPT: Efficient Agricultural Vision-Language Model with Expert Tuning
- 2025AgMMU: A Comprehensive Agricultural Multimodal Understanding Benchmark
- 2026Vision-language models know more about agriculture than they show and rubric-grounded verifications close the gap
- 2025Are vision-language models ready to zero-shot replace supervised classification models in agriculture?
- 2024Harnessing Large Vision and Language Models in Agriculture: A Review
- 2025AgriDoctor: A Multimodal Intelligent Assistant for Agriculture
- 2026AgroTools: A Benchmark for Tool-Augmented Multimodal Agents in Agriculture
- 2025A Multimodal Benchmark Dataset and Model for Crop Disease Diagnosis