mlsanityData to 7 Oct 2026

AgroOmni: A Large-Scale Multi-view Agricultural Dataset for Cross-Scale Multimodal Reasoning

arXiv 2603.14342 ↗First posted 15 Mar 2026cs.CV cs.AIcited by 0

On the map: LLM reasoning → Clinical and biomedical applications

Abstract (arXiv)

Modern agricultural data is sourced from diverse platforms and spans multiple spatial scales, ranging from ground-level close-up photography to Unmanned Aerial Vehicle (UAV) aerial observation and satellite remote sensing imagery. Accordingly, agricultural multimodal reasoning demands robust cross-scale spatial understanding. However, due to the lack of multi-view agricultural benchmark datasets, existing multimodal large language models (MLLMs) exhibit severe ground-level bias, which leads to scale confusion then semantic collapse in agricultural perception tasks, such as misinterpreting farmland imagery as walls or floors. To address this, we introduce AgroOmni, a large-scale multi-view training corpus with 288K Visual Question Answering pairs covering 56 specialized task categories across 14 task types, designed to capture diverse scales in modern precision agriculture. Built on this dataset, we propose AgroNVILA, which achieves a new state-of-the-art of 62.32% on the AgroMind benchmark (+15.03% over GPT-5.2), effectively mitigating the multi-view cross-scale gap for holistic agricultural understanding. Diagnostic evaluations on AgMMU further reveal an inherent heterogeneity between macro-priors and micro-diagnostics through constrained zero-shot performance. Meanwhile, even minimal fine-tuning leads to a dramatic performance gain of AgroNVILA on AgMMU, strongly demonstrating its generalization capability empowered by AgroOmni. Full training scripts are publicly available at https://anonymous.4open.science/r/AgroOmni-6510.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Clinical and biomedical applications, one of 17 directions in LLM reasoning. Builds on 41 of its 54 references that are in the map. First posted on arXiv 15 Mar 2026.

Builds on

41 of 54 references.

Closest ancestors · 3

Same direction, newest first

  1. 2026AgriWorld:A World Tools Protocol Framework for Verifiable Agricultural Reasoning with Code-Executing LLM Agents17 Feb
  2. 2025AgriGPT-VL: Agricultural Vision-Language Understanding Suite5 Oct
  3. 2025QoQ-Med: Building Multimodal Clinical Foundation Models with Domain-Aware GRPO Training31 May

Other references · 38

  1. 2023GPT-4 Technical Reportcited by 18,132
  2. 2017Proximal Policy Optimization Algorithmscited by 14,441
  3. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
  4. 2023Visual Instruction Tuningcited by 7,792
  5. 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,069
  6. 2024GPT-4o System Cardcited by 4,467
  7. 2024Gemini 1.5: Unlocking multimodal understanding across millions of tokens of contextcited by 3,175
  8. 2023InstructBLIP: Towards General-purpose Vision-Language Models with Instruction Tuningcited by 2,855
  9. 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,669
  10. 2023InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Taskscited by 2,534
  11. 2025Qwen3-VL Technical Reportcited by 2,534
  12. 2023Qwen-VL: A Versatile Vision-Language Model for Understanding, Localization, Text Reading, and Beyondcited by 2,179
26 more
  1. 2024How Far Are We to GPT-4V? Closing the Gap to Commercial Multimodal Models with Open-Source Suitescited by 1,033
  2. 2025OpenAI GPT-5 System Cardcited by 910
  3. 2023A Survey on Multimodal Large Language Modelscited by 898
  4. 2024Cambrian-1: A Fully Open, Vision-Centric Exploration of Multimodal LLMscited by 822
  5. 2024DeepSeek-VL: Towards Real-World Vision-Language Understandingcited by 718
  6. 2023GeoChat: Grounded Large Vision-Language Model for Remote Sensingcited by 320
  7. 2024MANTIS: Interleaved Multi-Image Instruction Tuningcited by 212
  8. 2024NVILA: Efficient Frontier Visual Language Modelscited by 206
  9. 2024TinyLLaVA: A Framework of Small-scale Large Multimodal Modelscited by 164
  10. 2024InternLM-XComposer2-4KHD: A Pioneering Large Vision-Language Model Handling Resolutions from 336 Pixels to 4K HDcited by 156
  11. 2015An open access repository of images on plant health to enable the development of mobile disease diagnosticscited by 132
  12. 2020Agriculture-Vision: A Large Aerial Image Database for Agricultural Pattern Analysiscited by 61
  13. 2023EarthVQA: Towards Queryable Earth via Relational Reasoning-Based Remote Sensing Visual Question Answeringcited by 51
  14. 2025GeoLLaVA-8K: Scaling Remote-Sensing Multimodal Large Language Models to 8K Resolutioncited by 41
  15. 2016Deep Fruit Detection in Orchardscited by 38
  16. 2023PhenoBench -- A Large Dataset and Benchmarks for Semantic Image Interpretation in the Agricultural Domaincited by 31
  17. 2024Leveraging Vision Language Models for Specialized Agricultural Taskscited by 24
  18. 2024AgroGPT: Efficient Agricultural Vision-Language Model with Expert Tuningcited by 23
  19. 2025AgroBench: Vision-Language Model Benchmark in Agriculturecited by 19
  20. 2024OAM-TCD: A globally diverse dataset of high-resolution tree cover mapscited by 14
  21. 2024Agri-LLaVA: Knowledge-Infused Large Multimodal Assistant on Agricultural Pests and Diseasescited by 14
  22. 2025AgriGPT: a Large Language Model Ecosystem for Agriculturecited by 11
  23. 2024ShizishanGPT: An Agricultural Large Language Model Integrating Tools and Resourcescited by 9
  24. 2025AgroLLM: Connecting Farmers and Agricultural Practices through Large Language Models for Enhanced Knowledge Transfer and Practical Applicationcited by 8
  25. 2025Can Large Multimodal Models Understand Agricultural Scenes? Benchmarking with AgroMindcited by 7
  26. 2025AgriGPT-Omni: A Unified Speech-Vision-Text Framework for Multilingual Agricultural Intelligencecited by 4

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025AgMMU: A Comprehensive Agricultural Multimodal Understanding Benchmark
  2. 2024AgriBench: A Hierarchical Agriculture Benchmark for Multimodal Large Language Models
  3. 2026AgriChat: A Multimodal Large Language Model for Agriculture Image Understanding
  4. 2026AgroTools: A Benchmark for Tool-Augmented Multimodal Agents in Agriculture
  5. 2025AgroCoT: A Chain-of-Thought Benchmark for Evaluating Reasoning in Vision-Language Models for Agriculture
  6. 2026AgriScope: Pixel-Grounded Multimodal Understanding for Agricultural Images
  7. 2025Towards Large Reasoning Models for Agriculture
  8. 2025PlantExpertVQA: A Visual Question Answering Dataset for Benchmarking Vision-Language Models in Plant Science