Look, Recite, Then Answer: Enhancing VLM Performance via Self-Generated Knowledge Hints
On the map: Multimodal LLMs / vision-language models → Agricultural vision-language models
also in 1 more
Abstract (arXiv)
Vision-Language Models (VLMs) exhibit significant performance plateaus in specialized domains like precision agriculture, primarily due to "Reasoning-Driven Hallucination" where linguistic priors override visual perception. A key bottleneck is the "Modality Gap": visual embeddings fail to reliably activate the fine-grained expert knowledge already encoded in model parameters. We propose "Look, Recite, Then Answer," a parameter-efficient framework that enhances VLMs via self-generated knowledge hints while keeping backbone models frozen. The framework decouples inference into three stages: (1) Look generates objective visual descriptions and candidate sets; (2) Recite employs a lightweight 1.7B router to transform visual cues into targeted queries that trigger candidate-specific parametric knowledge; (3) Answer performs parallel evidence alignment between descriptions and recited knowledge to select the most consistent label. On AgroBench, our method achieves state-of-the-art results, improving Weed Identification accuracy by 23.52% over Qwen2-VL-72B and surpassing GPT-4o without external search overhead. This modular design mitigates hallucinations by transforming passive perception into active, controllable knowledge retrieval
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Agricultural vision-language models, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 0 of its 1 references that are in the map. First posted on arXiv 30 Nov 2025.
Builds on
0 of 1 references.
No references here yet.
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026Vision-language models know more about agriculture than they show and rubric-grounded verifications close the gap
- 2025Are vision-language models ready to zero-shot replace supervised classification models in agriculture?
- 2025AgriGPT-VL: Agricultural Vision-Language Understanding Suite
- 2026AgriChat: A Multimodal Large Language Model for Agriculture Image Understanding
- 2026StackTok: Accelerating VLMs Inference with Budget-Adaptive Visual Token Selection
- 2026Look Where It Matters: High-Resolution Crops Retrieval for Efficient VLMs
- 2026Learning to Look Again: Loss-Gap Supervision for Free-form Crop Routing in Vision-Language Models
- 2025AgroCoT: A Chain-of-Thought Benchmark for Evaluating Reasoning in Vision-Language Models for Agriculture