Are VLMs Really Blind
On the map: LLM reasoning → Multimodal reasoning
Abstract (arXiv)
Vision Language Models excel in handling a wide range of complex tasks, including Optical Character Recognition (OCR), Visual Question Answering (VQA), and advanced geometric reasoning. However, these models fail to perform well on low-level basic visual tasks which are especially easy for humans. Our goal in this work was to determine if these models are truly "blind" to geometric reasoning or if there are ways to enhance their capabilities in this area. Our work presents a novel automatic pipeline designed to extract key information from images in response to specific questions. Instead of just relying on direct VQA, we use question-derived keywords to create a caption that highlights important details in the image related to the question. This caption is then used by a language model to provide a precise answer to the question without requiring external fine-tuning.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. First posted on arXiv 29 Oct 2024.
Builds on
0 of 0 references.
No references here yet.
Built on by
Citing papers per year: 2026: 1.
1 paper.
- 2026Image-Space Rule Discoverycited by 1
- 2026Image-Space Rule Discovery1 Aug 2026
Similar, not cited
Close in wording, no citation either way
- 2024Can Visual Language Models Replace OCR-Based Visual Question Answering Pipelines in Production? A Case Study in Retail
- 2024Natural Language Understanding and Inference with MLLM in Visual Question Answering: A Survey
- 2024Right this way: Can VLMs Guide Us to See More to Answer Questions?
- 2025Visual question answering: from early developments to recent advances -- a survey
- 2024Guiding Vision-Language Model Selection for Visual Question-Answering Across Tasks, Domains, and Knowledge Types
- 2024DARE: Diverse Visual Question Answering with Robustness Evaluation
- 2023From Image to Language: A Critical Analysis of Visual Question Answering (VQA) Approaches, Challenges, and Opportunities
- 2025Exploring Advanced Techniques for Visual Question Answering: A Comprehensive Comparison