mlsanityData to 14 Oct 2026

SMSP: A Plug-and-Play Strategy of Multi-Scale Perception for MLLMs to Perceive Visual Illusions

arXiv 2603.23118 ↗First posted 24 Mar 2026cs.CV cs.MMcited by 2

On the map: Multimodal LLMs / vision-language models → VLM benchmarks and visual reasoning

Abstract (arXiv)

Recent works have shown that multimodal large language models (MLLMs) are highly vulnerable to hidden-pattern visual illusions, where the hidden content is imperceptible to models but obvious to humans. This deficiency highlights a perceptual misalignment between current MLLMs and humans, and also introduces potential safety concerns. To systematically investigate this failure, we introduce IlluChar, a comprehensive and challenging illusion dataset, and uncover a key underlying mechanism for the models' failure: high-frequency attention bias, where the models are easily distracted by high-frequency background textures in illusion images, causing them to overlook hidden patterns. To address the issue, we propose the Strategy of Multi-Scale Perception (SMSP), a plug-and-play framework that aligns with human visual perceptual strategies. By suppressing distracting high-frequency background signals, SMSP generates images closer to human perception. Our experiments demonstrate that SMSP significantly improves the performance of all evaluated MLLMs on illusion images, for instance, increasing the accuracy of Qwen3-VL-8B-Instruct from 13.0% to 84.0%. Our work provides novel insights into MLLMs' visual perception, and offers a practical and robust solution to enhance it. Our code is publicly available at https://github.com/Tujz2023/SMSP.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Placed in VLM benchmarks and visual reasoning, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 11 of its 33 references that are in the map. First posted on arXiv 24 Mar 2026.

Builds on

11 of 33 references.

Closest ancestors · 3

Same direction, newest first

  1. 2025IllusionBench+: A Large-scale and Comprehensive Benchmark for Visual Illusion Understanding in Vision-Language Models1 Jan
  2. 2024Evaluating Vision-Language Models on Bistable Images29 May
  3. 2023Grounding Visual Illusions in Language: Do Vision-Language Models Perceive Illusions Like Humans?31 Oct

Other references · 8

  1. 2017Fashion-MNIST: a Novel Image Dataset for Benchmarking Machine Learning Algorithmscited by 4,349
  2. 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,796
  3. 2025GLM-4.5V and GLM-4.1V-Thinking: Towards Versatile Multimodal Reasoning with Scalable Reinforcement Learningcited by 466
  4. 2021Generic Attention-model Explainability for Interpreting Bi-Modal and Encoder-Decoder Transformerscited by 320
  5. 2023Visual Anagrams: Generating Multi-View Optical Illusions with Diffusion Modelscited by 46
  6. 2023Diffusion Illusions: Hiding Images in Plain Sightcited by 26
  7. 2025Hate in Plain Sight: On the Risks of Moderating AI-Generated Hateful Illusionscited by 6
  8. 2025The Perceptual Observatory Characterizing Robustness and Grounding in MLLMscited by 3

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2024The Instinctive Bias: Spurious Images lead to Illusion in MLLMs
  2. 2026Seeing Is Believing? A Benchmark for Multimodal Large Language Models on Visual Illusions and Anomalies
  3. 2026Illusion-Aware Visual Preprocessing and Anti-Illusion Prompting for Classic Illusion Understanding in Vision-Language Models
  4. 2025SemVink: Advancing VLMs' Semantic Understanding of Optical Illusions via Visual Global Thinking
  5. 2025Contrast Sensitivity in Multimodal Large Language Models: A Psychophysics-Inspired Evaluation
  6. 2026Beyond What Meets the Eye: Unveiling Situational Illusions for Multimodal Large Language Models
  7. 2026Seeing the Evidence, Missing the Answer: Tool-Guided Vision-Language Models on Visual Illusions
  8. 2024MM-SAP: A Comprehensive Benchmark for Assessing Self-Awareness of Multimodal Large Language Models in Perception