Illusions in Humans and AI: How Visual Perception Aligns and Diverges
Not on the map. Why?
Abstract (arXiv)
By comparing biological and artificial perception through the lens of illusions, we highlight critical differences in how each system constructs visual reality. Understanding these divergences can inform the development of more robust, interpretable, and human-aligned artificial intelligence (AI) vision systems. In particular, visual illusions expose how human perception is based on contextual assumptions rather than raw sensory data. As artificial vision systems increasingly perform human-like tasks, it is important to ask: does AI experience illusions, too? Does it have unique illusions? This article explores how AI responds to classic visual illusions that involve color, size, shape, and motion. We find that some illusion-like effects can emerge in these models, either through targeted training or as by-products of pattern recognition. In contrast, we also identify illusions unique to AI, such as pixel-level sensitivity and hallucinations, that lack human counterparts. By systematically comparing human and AI responses to visual illusions, we uncover alignment gaps and AI-specific perceptual vulnerabilities invisible to human perception. These findings provide insights for future research on vision systems that preserve human-beneficial perceptual biases while avoiding distortions that undermine trust and safety.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 10 of its 36 references that are in the map. First posted on arXiv 17 Aug 2025.
Builds on
10 of 36 references.
References · 10
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
- 2024A Survey on Hallucination in Large Vision-Language Modelscited by 357
- 2023Grounding Visual Illusions in Language: Do Vision-Language Models Perceive Illusions Like Humans?cited by 32
- 2024IllusionVQA: A Challenging Optical Illusion Dataset for Vision Language Modelscited by 31
- 2024The Illusion-Illusion: Vision Language Models See Illusions Where There Are Nonecited by 14
- 2025IllusionBench+: A Large-scale and Comprehensive Benchmark for Visual Illusion Understanding in Vision-Language Modelscited by 12
- 2024Efficient Black-box Adversarial Attacks via Bayesian Optimization Guided by a Function Priorcited by 11
- 2015Depth Perception in Autostereograms: 1/f-Noise is Bestcited by 1
Built on by
Citing papers per year: 2026: 3.
3 papers.