mlsanityData to 7 Oct 2026

Less Detail, Better Answers: Degradation-Driven Prompting for VQA

arXiv 2604.04838 ↗First posted 6 Apr 2026cs.CVcited by 1

On the map: Multimodal LLMs / vision-language models → VLM benchmarks and visual reasoning

Abstract (arXiv)

Recent advancements in Vision-Language Models (VLMs) have significantly pushed the boundaries of Visual Question Answering (VQA).However,high-resolution details can sometimes become noise that leads to hallucinations or reasoning errors. In this paper,we propose Degradation-Driven Prompting (DDP), a novel framework that improves VQA performance by strategically reducing image fidelity to force models to focus on essential structural information. We evaluate DDP across two distinct tasks. Physical attributes targets images prone to human misjudgment, where DDP employs a combination of 80p downsampling, structural visual aids (white background masks and orthometric lines), and In-Context Learning (ICL) to calibrate the model's focus. Perceptual phenomena addresses various machine-susceptible visual anomalies and illusions, including Visual Anomaly (VA), Color (CI), Motion(MI),Gestalt (GI), Geometric (GSI), and Visual Illusions (VI).For this task, DDP integrates a task-classification stage with specialized tools such as blur masks and contrast enhancement alongside downsampling. Our experimental results demonstrate that less is more: by intentionally degrading visual inputs and providing targeted structural prompts, DDP enables VLMs to bypass distracting textures and achieve superior reasoning accuracy on challenging visual benchmarks.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in VLM benchmarks and visual reasoning, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 29 of its 42 references that are in the map. First posted on arXiv 6 Apr 2026.

Builds on

29 of 42 references.

Closest ancestors · 5

Same direction, newest first

  1. 2026Seeing Is Believing? A Benchmark for Multimodal Large Language Models on Visual Illusions and Anomalies2 Feb
  2. 2026Do VLMs Perceive or Recall? Probing Visual Perception vs. Memory with Classic Visual Illusions29 Jan
  3. 2024MathVerse: Does Your Multi-modal LLM Truly See the Diagrams in Visual Math Problems?21 Mar
  4. 2023GLaMM: Pixel Grounding Large Multimodal Model6 Nov
  5. 2023Ferret: Refer and Ground Anything Anywhere at Any Granularity11 Oct

Other references · 24

  1. 2024Gemini 1.5: Unlocking multimodal understanding across millions of tokens of contextcited by 3,175
  2. 2016Making the V in VQA Matter: Elevating the Role of Image Understanding in Visual Question Answeringcited by 2,498
  3. 2023ToolLLM: Facilitating Large Language Models to Master 16000+ Real-world APIscited by 1,880
  4. 2023MME: A Comprehensive Evaluation Benchmark for Multimodal Large Language Modelscited by 1,624
  5. 2023HuggingGPT: Solving AI Tasks with ChatGPT and its Friends in Hugging Facecited by 1,173
  6. 2023SEED-Bench: Benchmarking Multimodal LLMs with Generative Comprehensioncited by 929
  7. 2023Visual ChatGPT: Talking, Drawing and Editing with Visual Foundation Modelscited by 659
  8. 2024SeeClick: Harnessing GUI Grounding for Advanced Visual GUI Agentscited by 553
  9. 2022Visual Programming: Compositional visual reasoning without trainingcited by 507
  10. 2023V*: Guided Visual Search as a Core Mechanism in Multimodal LLMscited by 459
  11. 2023Monkey: Image Resolution and Text Label Are Important Things for Large Multi-modal Modelscited by 356
  12. 2024InternLM-XComposer2: Mastering Free-form Text-Image Composition and Comprehension in Vision-Language Large Modelcited by 326
12 more
  1. 2024Mobile-Agent: Autonomous Multi-Modal Mobile Device Agent with Visual Perceptioncited by 283
  2. 2023What does CLIP know about a red circle? Visual prompt engineering for VLMscited by 215
  3. 2024MANTIS: Interleaved Multi-Image Instruction Tuningcited by 212
  4. 2023G-LLaVA: Solving Geometric Problem with Multi-Modal Large Language Modelcited by 208
  5. 2024LLaVA-UHD: an LMM Perceiving Any Aspect Ratio and High-Resolution Imagescited by 193
  6. 2023LLaVA-Plus: Learning to Use Tools for Creating Multimodal Agentscited by 188
  7. 2023ViP-LLaVA: Making Large Multimodal Models Understand Arbitrary Visual Promptscited by 160
  8. 2024Draw-and-Understand: Leveraging Visual Prompts to Enable MLLMs to Comprehend What You Wantcited by 98
  9. 2024MMSearch: Benchmarking the Potential of Large Models as Multi-modal Search Enginescited by 98
  10. 2024V-IRL: Grounding Virtual Intelligence in Real Lifecited by 35
  11. 2025Position: Reasoning After Perception Means Reasoning Without Visioncited by 8
  12. 2025V-Agent: An Interactive Video Search System Using Vision-Language Modelscited by 3

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2025The Quest for Visual Understanding: A Journey Through the Evolution of Visual Question Answering
  2. 2023Investigating Prompting Techniques for Zero- and Few-Shot Visual Question Answering
  3. 2025Visual question answering: from early developments to recent advances -- a survey
  4. 2023Exploring Question Decomposition for Zero-Shot VQA
  5. 2026Rethinking Token Reduction for Large Vision-Language Models
  6. 2024Joint Visual and Text Prompting for Improved Object-Centric Perception with Multimodal Large Language Models
  7. 2023From Image to Language: A Critical Analysis of Visual Question Answering (VQA) Approaches, Challenges, and Opportunities
  8. 2024Guiding Vision-Language Model Selection for Visual Question-Answering Across Tasks, Domains, and Knowledge Types