BananaVLM: A Domain-Adapted Vision Language Model for Banana Crop Disease Diagnosis
On the map: Multimodal LLMs / vision-language models → Agricultural vision-language models
Abstract (arXiv)
Banana crop diseases threaten food security across the world, yet field diagnosis remains difficult because of limited expert access and visual similarity among disease classes. We present BananaVLM, a domain-adapted vision-language model for banana disease diagnosis built on LLaVA-v1.5-7B and fine-tuned with Low-Rank Adaptation (LoRA). To address the lack of multimodal agricultural instruction data, we introduce BananaInstruct, an automated pipeline that converts raw disease images into ≈80,000 question--answer pairs without manual annotation, using LLaVA-1.5-13B for symptom descriptions and Mistral-7B for agricultural Q&A generation and label grounding. Evaluated against 14 open-source and 5 closed-source VLMs on a nine-class benchmark, BananaVLM achieves 92.21% in-domain and 83.28% out-of-domain (OOD) classification accuracy, outperforming the best closed-source baseline, Gemini~2.5~Pro, by 49.8 and 63.3 percentage points, respectively. Binary healthy/diseased identification reaches 98.38% OOD accuracy with 1.00 recall. A controlled LoRA--DoRA comparison shows that DoRA performance degrades across epochs, while LoRA remains more effective for fine-grained classification. Qualitative evaluation using nine LLM judges yields G-Eval win rates of 0.81--0.96, while five domain experts prefer BananaVLM in 98.48% of 990 blind pairwise comparisons. These results show that lightweight domain adaptation with automated instruction tuning is an effective and scalable approach for specialized agricultural AI. Code, datasets, and model weights are available at https://github.com/samy101/banana-vlm
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Agricultural vision-language models, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 26 of its 38 references that are in the map. First posted on arXiv 27 Aug 2026.
Builds on
26 of 38 references.
Closest ancestors · 4
Same direction, newest first
- 2025AgroBench: Vision-Language Model Benchmark in Agriculture28 Jul
- 2025Self-Consistency in Vision-Language Models for Precision Agriculture: Multi-Response Consensus for Crop Disease Management8 Jul
- 2025AgMMU: A Comprehensive Agricultural Multimodal Understanding Benchmark14 Apr
- 2024AgroGPT: Efficient Agricultural Vision-Language Model with Expert Tuning10 Oct
Other references · 22
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
- 2023Visual Instruction Tuningcited by 7,869
- 2025Qwen2.5-VL Technical Reportcited by 5,587
- 2023Improved Baselines with Visual Instruction Tuningcited by 4,418
- 2022Flamingo: a Visual Language Model for Few-Shot Learningcited by 4,386
- 2021Scaling Up Visual and Vision-Language Representation Learning With Noisy Text Supervisioncited by 3,864
- 2022Self-Instruct: Aligning Language Models with Self-Generated Instructionscited by 2,724
- 2023G-Eval: NLG Evaluation using GPT-4 with Better Human Alignmentcited by 2,276
- 2023Qwen-VL: A Versatile Vision-Language Model for Understanding, Localization, Text Reading, and Beyondcited by 2,224
- 2024Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phonecited by 1,917
10 more
- 2019ZeRO: Memory Optimizations Toward Training Trillion Parameter Modelscited by 1,301
- 2024MiniCPM-V: A GPT-4V Level MLLM on Your Phonecited by 1,079
- 2024Gemma: Open Models Based on Gemini Research and Technologycited by 916
- 2024DoRA: Weight-Decomposed Low-Rank Adaptationcited by 758
- 2024LLMs-as-Judges: A Comprehensive Survey on LLM-based Evaluation Methodscited by 465
- 2016Using Deep Learning for Image-Based Plant Disease Detectioncited by 219
- 2025Synthetic Data Generation Using Large Language Models: Advances in Text and Codecited by 61
- 2024From Generalist to Specialist: Adapting Vision Language Models via Task-Specific Visual Instruction Tuningcited by 5
- 2024From Holistic to Localized: Local Enhanced Adapters for Efficient Visual Instruction Fine-Tuningcited by 3
- 2025Leveraging Synthetic Data for Question Answering with Multilingual LLMs in the Agricultural Domaincited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026SAGE: Scalable Agentic Grounded Evaluation for Crop Disease Diagnosis ↗
- 2026LeafNet: A Large-Scale Dataset and Comprehensive Benchmark for Foundational Vision-Language Understanding of Plant Diseases
- 2026AgriChain Visually Grounded Expert Verified Reasoning for Interpretable Agricultural Vision Language Models
- 2025A Multimodal Benchmark Dataset and Model for Crop Disease Diagnosis
- 2026AgroGround: Multi-Granularity Grounded Recognition in Agriculture
- 2025PlantExpertVQA: A Visual Question Answering Dataset for Benchmarking Vision-Language Models in Plant Science
- 2026Vision-language models know more about agriculture than they show and rubric-grounded verifications close the gap
- 2025CPJ: Explainable Agricultural Pest Diagnosis via Caption-Prompt-Judge with LLM-Judged Refinement