Let Androids Dream of Electric Sheep: A Human-Inspired Image Implication Understanding and Reasoning Framework
On the map: LLM reasoning → Multimodal reasoning
Abstract (arXiv)
Metaphorical comprehension in images remains a critical challenge for AI systems, as existing models struggle to grasp the nuanced cultural, emotional, and contextual implications embedded in visual content. While multimodal large language models (MLLMs) excel in general Visual Question Answer (VQA) tasks, they struggle with a fundamental limitation on image implication tasks: contextual gaps that obscure the relationships between different visual elements and their abstract meanings. Inspired by the human cognitive process, we propose Let Androids Dream (LAD), a novel framework for image implication understanding and reasoning. LAD addresses contextual missing through the three-stage framework: (1) Perception: converting visual information into rich and multi-level textual representations, (2) Search: iteratively searching and integrating cross-domain knowledge to resolve ambiguity, and (3) Reasoning: generating context-alignment image implication via explicit reasoning. Our framework with the lightweight GPT-4o-mini model achieves SOTA performance compared to 15+ MLLMs on English image implication benchmark and a huge improvement on Chinese benchmark, performing comparable with the Gemini-3.0-pro model on Multiple-Choice Question (MCQ) and outperforms the GPT-4o model 36.7% on Open-Style Question (OSQ). Generalization experiments also show that our framework can effectively benefit general VQA and visual reasoning tasks. Additionally, our work provides new insights into how AI can more effectively interpret image implications, advancing the field of vision-language reasoning and human-AI interaction. Our project is publicly available at https://github.com/MING-ZCH/Let-Androids-Dream-of-Electric-Sheep.
Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 31 of its 39 references that are in the map. First posted on arXiv 22 May 2025.
Builds on
31 of 39 references.
Closest ancestors · 5
Same direction, newest first
- 2024LLaVA-CoT: Let Vision Language Models Reason Step-by-Step15 Nov
- 2024Whiteboard-of-Thought: Thinking Step-by-Step Across Modalities20 Jun
- 2024Visual Sketchpad: Sketching as a Visual Chain of Thought for Multimodal Language Models13 Jun
- 2024Measuring Multimodal Mathematical Reasoning with MATH-Vision Dataset22 Feb
- 2023MathVista: Evaluating Mathematical Reasoning of Foundation Models in Visual Contexts3 Oct
Other references · 26
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
- 2025Qwen2.5-VL Technical Reportcited by 5,587
- 2024GPT-4o System Cardcited by 4,588
- 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,234
- 2023Let's Verify Step by Stepcited by 3,789
- 2024Qwen2 Technical Reportcited by 2,120
- 2023MMMU: A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for Expert AGIcited by 2,080
- 2024LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Codecited by 2,004
- 2025InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Modelscited by 1,834
- 2025Kimi k1.5: Scaling Reinforcement Learning with LLMscited by 1,210
- 2024DeepSeek-VL2: Mixture-of-Experts Vision-Language Models for Advanced Multimodal Understandingcited by 572
- 2023Large Language Models Are Not Robust Multiple Choice Selectorscited by 486
14 more
- 2023V*: Guided Visual Search as a Core Mechanism in Multimodal LLMscited by 482
- 2024Mulberry: Empowering MLLM with o1-like Reasoning and Reflection via Collective Monte Carlo Tree Searchcited by 175
- 2022Do Androids Laugh at Electric Sheep? Humor "Understanding" Benchmarks from The New Yorker Caption Contestcited by 98
- 2024Open-LLM-Leaderboard: From Multi-choice to Open-style Questions for LLMs Evaluation, Benchmark, and Arenacited by 76
- 2024Can multiple-choice questions really be useful in detecting the abilities of LLMs?cited by 69
- 2024MindSearch: Mimicking Human Minds Elicits Deep AI Searchercited by 66
- 2023Let's Think Outside the Box: Exploring Leap-of-Thought in Large Language Models with Creative Humor Generationcited by 56
- 2024VoCoT: Unleashing Visually Grounded Multi-Step Reasoning in Large Multi-Modal Modelscited by 43
- 2025Hypothesis-Driven Theory-of-Mind Reasoning for Large Language Modelscited by 29
- 2021Nice perfume. How long did you marinate in it? Multimodal Sarcasm Explanationcited by 25
- 2024Can Large Multimodal Models Uncover Deep Semantics Behind Images?cited by 17
- 2024II-Bench: An Image Implication Understanding Benchmark for Multimodal Large Language Modelscited by 16
- 2024Can MLLMs Understand the Deep Implication Behind Chinese Images?cited by 14
- 2024Getting Serious about Humor: Crafting Humor Datasets with Unfunny Large Language Modelscited by 9
Built on by
Citing papers per year: 2025: 2; 2026: 3.
5 papers.
- 2026MetaphorStar: Image Metaphor Understanding and Reasoning with End-to-End Visual Reinforcement Learningcited by 2
- 2025From Perception to Punchline: Empowering VLM with the Art of In-the-wild Memecited by 1
- 2025Seeing is Not Understanding: A Benchmark on Perception-Cognition Disparities in Large Language Modelscited by 0
- 2026Towards Faithful Reasoning in Comics for Small MLLMscited by 0
- 2026Towards High-Level Semantic Intelligencecited by 0
- 2026Towards High-Level Semantic Intelligence27 Jul 2026
- 2026MetaphorStar: Image Metaphor Understanding and Reasoning with End-to-End Visual Reinforcement Learning11 Feb 2026
- 2026Towards Faithful Reasoning in Comics for Small MLLMs6 Jan 2026
- 2025From Perception to Punchline: Empowering VLM with the Art of In-the-wild Meme31 Dec 2025
- 2025Seeing is Not Understanding: A Benchmark on Perception-Cognition Disparities in Large Language Models14 Sep 2025
Similar, not cited
Close in wording, no citation either way
- 2025Taming a Retrieval Framework to Read Images in Humanlike Manner for Augmenting Generation of MLLMs
- 2025Visual Graph Arena: Evaluating Visual Conceptualization of Vision and Multimodal Large Language Models
- 2025Fast or Slow? Integrating Fast Intuition and Deliberate Thinking for Enhancing Visual Question Answering
- 2025VisualQuest: A Benchmark for Abstract Visual Reasoning in MLLMs
- 2023Language Guided Visual Question Answering: Elevate Your Multimodal Language Model Using Knowledge-Enriched Prompts
- 2024Zero-Shot Visual Reasoning by Vision-Language Models: Benchmarking and Analysis
- 2025ROVER: Benchmarking Reciprocal Cross-Modal Reasoning for Omnimodal Generation
- 2025UR-Bench: A Benchmark for Multi-Hop Reasoning over Ultra-High-Resolution Images