Humanity's Sixth Sense: Benchmarking Intuitive Visual Reasoning in Multimodal Models
On the map: LLM reasoning → Multimodal reasoning
Abstract (arXiv)
Humans perceive far more in a scene than what is explicitly depicted: a single glance captures past causes and future trajectories; a quick peek determines if a vehicle can fit between two parked cars; a few seconds of video reveals who holds authority in a room; and a fleeting clip highlights subtle abstract patterns like unwritten rules or hidden labels. This capacity reflects a form of humanity's sixth sense: an intuitive reasoning mechanism that recovers implicit information beyond raw sensory perception. Crucially, this rapid, zero-shot visual intuition underpins everyday navigation and social interaction, making it a vital capability for Multimodal Large Language Models (MLLMs) deployed alongside people. Existing visual benchmarks, however, target either deliberate expert-level analysis in academic and mathematical domains or low-level perception, leaving the intuitive reasoning that people perform largely untested. To bridge this gap, we introduce Humanity's Sixth Sense (HSS), a benchmark for intuitive visual reasoning. HSS spans diverse image and video inputs, organizes items under a structured taxonomy, and pairs each with human-written prompts probing the implicit temporal, spatial, social, and abstract structure that people infer at a glance. Frontier MLLMs fall short of human performance: participants reach 93.1% accuracy, while the strongest model, GPT-6-astra, reaches only 53.6% even at maximum reasoning effort. Despite excelling in many complex tasks that require advanced perception and knowledge, current models still struggle significantly on these visual tasks that are intuitive for humans. We further explore agentic setup that apply dynamic visual manipulation to HSS, which narrows but does not close the gap. HSS establishes intuitive visual reasoning as a measurable axis and directs attention to a capability that scaling on current benchmarks has so far left behind.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 21 of its 40 references that are in the map. First posted on arXiv 6 Oct 2026.
Builds on
21 of 40 references.
Closest ancestors · 4
Same direction, newest first
- 2026BabyVision: Visual Reasoning Beyond Language10 Jan
- 2025Beyond Seeing: Evaluating Multimodal LLMs on Tool-Enabled Image Perception, Transformation, and Reasoning14 Oct
- 2024Visual Sketchpad: Sketching as a Visual Chain of Thought for Multimodal Language Models13 Jun
- 2023MMBench: Is Your Multi-modal Model an All-around Player?12 Jul
Other references · 17
- 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
- 2021Evaluating Large Language Models Trained on Codecited by 8,320
- 2016Making the V in VQA Matter: Elevating the Role of Image Understanding in Visual Question Answeringcited by 2,516
- 2023MMMU: A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for Expert AGIcited by 2,080
- 2024Video-MME: The First-Ever Comprehensive Evaluation Benchmark of Multi-modal LLMs in Video Analysiscited by 1,413
- 2023MVBench: A Comprehensive Multi-modal Video Understanding Benchmarkcited by 1,109
- 2024LLM Evaluators Recognize and Favor Their Own Generationscited by 686
- 2024BLINK: Multimodal Large Language Models Can See but Not Perceivecited by 550
- 2025Humanity's Last Examcited by 491
- 2019CLEVRER: CoLlision Events for Video REpresentation and Reasoningcited by 484
- 2023V*: Guided Visual Search as a Core Mechanism in Multimodal LLMscited by 482
- 2023What's "up" with vision-language models? Investigating their struggle with spatial reasoningcited by 254
5 more
- 2021Physion: Evaluating Physical Prediction from Vision in Humans and Machinescited by 153
- 2024MMToM-QA: Multimodal Theory of Mind Question Answeringcited by 85
- 2025ZeroBench: An Impossible Visual Benchmark for Contemporary Large Multimodal Modelscited by 58
- 2026Video-MME-v2: Towards the Next Stage in Benchmarks for Comprehensive Video Understandingcited by 55
- 2019SocialIQA: Commonsense Reasoning about Social Interactionscited by 37
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025From Perception to Cognition: A Survey of Vision-Language Interactive Reasoning in Multimodal Large Language Models
- 2023Visual cognition in multimodal large language models
- 2025VERIFY: A Benchmark of Visual Explanation and Reasoning for Investigating Multimodal Reasoning Fidelity
- 2026MM-OPD: Towards One More Bottleneck Between Perception and Reasoning
- 2026Beyond Visual Memory: Mechanistic Diagnostics of Latent Visual Reasoning
- 2026Position: The Systemic Lack of Agency in Visual Reasoning
- 2026Mind's Eye: A Benchmark of Visual Abstraction, Transformation and Composition for Multimodal LLMs
- 2025Uni-MMMU: A Massive Multi-discipline Multimodal Unified Benchmark