Hallucination Behavior in Multimodal LLMs Across Agricultural Image Interpretation and Generation Tasks
On the map: Multimodal LLMs / vision-language models → Hallucination mitigation in LVLMs
Abstract (arXiv)
Large Language Models (LLMs) are being rapidly adopted in agricultural imaging applications, ranging from crop interpretation to synthetic field image generation. However, these models frequently exhibit hallucinations outputs that appear confident yet deviate from biological or environmental reality potentially leading to misinformed agronomic insights. This study investigates such hallucinations in two complementary directions: image-to-text, where LLMs interpret crop or field imagery to describe conditions such as biotic and abiotic stresses, and text-to-image, where models generate synthetic agricultural scenes based on descriptive prompts. We examine errors involving biological inconsistency, contextual inaccuracy, and agronomic implausibility, evaluating the outputs under domain-informed criteria across multiple imaging modalities. Our analysis identifies recurring hallucination patterns within both interpretive and generative tasks. In image interpretation, LLMs (e.g., Gemma, LLAVA, Qwen, and MiniCPM) achieved modest zero-shot accuracy (63 to 75 percent), whereas few-shot prompting improved performance up to 86.8 percent, exhibiting false detections and missed infections, indicating residual hallucination effects. In text-to-image tasks, advanced models such as GPT-5 and Gemini 2.5 Flash generate up to 91 percent biologically inconsistent scenes under relaxed prompt constraints, revealing fundamental weaknesses in current LLMs. This systematic assessment of visual reasoning and generation offers critical insights toward enhancing the reliability and trustworthiness of LLM-based agricultural imaging platforms.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Hallucination mitigation in LVLMs, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 16 of its 32 references that are in the map. First posted on arXiv 26 May 2026.
Builds on
16 of 32 references.
Closest ancestors · 2
Same direction, newest first
- 2024Hallucination of Multimodal Large Language Models: A Survey29 Apr
- 2023Analyzing and Mitigating Object Hallucination in Large Vision-Language Models1 Oct
Other references · 14
- 2023A Survey on Hallucination in Large Language Models: Principles, Taxonomy, Challenges, and Open Questionscited by 1,582
- 2023Inference-Time Intervention: Eliciting Truthful Answers from a Language Modelcited by 1,259
- 2023A Survey on Evaluation of Large Language Modelscited by 1,227
- 2023DoLa: Decoding by Contrasting Layers Improves Factuality in Large Language Modelscited by 367
- 2023Trusting Your Evidence: Hallucinate Less with Context-aware Decodingcited by 319
- 2023Med-HALT: Medical Domain Hallucination Test for Large Language Modelscited by 156
- 2025Medical Hallucinations in Foundation Models and Their Impact on Healthcarecited by 89
- 2022Large-scale Text-to-Image Generation Models for Visual Artists' Creative Workscited by 60
- 2022DALLE-URBAN: Capturing the urban design expertise of large text to image transformerscited by 12
- 2024Snap and Diagnose: An Advanced Multimodal Retrieval System for Identifying Plant Diseases in the Wildcited by 12
- 2025AgriGPT: a Large Language Model Ecosystem for Agriculturecited by 11
- 2022What Does DALL-E 2 Know About Radiology?cited by 7
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026CRoPS: A Training-Free Hallucination Mitigation Framework for Vision-Language Models
- 2025AgMMU: A Comprehensive Agricultural Multimodal Understanding Benchmark
- 2024Hallucination in Multimodal Foundation Models: A Survey on Causes, Corrections, and Evaluations
- 2026Reducing Object Hallucination in LVLMs via Emphasizing Image-negative Tokens
- 2026AgriChat: A Multimodal Large Language Model for Agriculture Image Understanding
- 2026What Do Hallucinations Reveal About Multimodal Reasoning? Diagnosing Visual Grounding Failures via Contrastive Decoding Probes
- 2025Hallucination as an Upper Bound: A New Perspective on Text-to-Image Evaluation
- 2025Two Causes, Not One: Rethinking Omission and Fabrication Hallucinations in MLLMs