Assessing Consciousness-Related Behaviors in Large Language Models Using the Maze Test
Not on the map. Why?
Abstract (arXiv)
We investigate consciousness-like behaviors in Large Language Models (LLMs) using the Maze Test, challenging models to navigate mazes from a first-person perspective. This test simultaneously probes spatial awareness, perspective-taking, goal-directed behavior, and temporal sequencing-key consciousness-associated characteristics. After synthesizing consciousness theories into 13 essential characteristics, we evaluated 12 leading LLMs across zero-shot, one-shot, and few-shot learning scenarios. Results showed reasoning-capable LLMs consistently outperforming standard versions, with Gemini 2.0 Pro achieving 52.9% Complete Path Accuracy and DeepSeek-R1 reaching 80.5% Partial Path Accuracy. The gap between these metrics indicates LLMs struggle to maintain coherent self-models throughout solutions -- a fundamental consciousness aspect. While LLMs show progress in consciousness-related behaviors through reasoning mechanisms, they lack the integrated, persistent self-awareness characteristic of consciousness.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 22 of its 98 references that are in the map. First posted on arXiv 22 Aug 2025.
Builds on
22 of 98 references.
References · 22
- 2017Attention Is All You Needcited by 59,932
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
- 2022Flamingo: a Visual Language Model for Few-Shot Learningcited by 4,337
- 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,500
- 2023Sparks of Artificial General Intelligence: Early experiments with GPT-4cited by 2,579
- 2022Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language modelscited by 1,970
- 2019Transformer-XL: Attentive Language Models Beyond a Fixed-Length Contextcited by 1,830
- 2023A Survey on Evaluation of Large Language Modelscited by 1,227
- 2022Using cognitive psychology to understand GPT-3cited by 389
- 2021Time-Aware Language Models as Temporal Knowledge Basescited by 290
10 more
- 2020Experience Grounds Languagecited by 241
- 2023Grounding Large Language Models in Interactive Environments with Online Reinforcement Learningcited by 193
- 2023Embers of Autoregression: Understanding Large Language Models Through the Problem They are Trained to Solvecited by 175
- 2022The Debate Over Understanding in AI's Large Language Modelscited by 142
- 2023Taken out of context: On measuring situational awareness in LLMscited by 131
- 2016Towards an integration of deep learning and neurosciencecited by 77
- 2024People cannot distinguish GPT-4 from a human in a Turing testcited by 46
- 2025AlphaMaze: Enhancing Large Language Models' Spatial Intelligence via GRPOcited by 33
- 2024Needle in the Haystack for Memory Based Large Language Modelscited by 32
- 2024Do Language Models Understand Time?cited by 14
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025MazeEval: A Benchmark for Testing Sequential Decision-Making in Language Models
- 2026Understanding Large Language Models
- 2022Thinking Fast and Slow in Large Language Models
- 2025Identifying Features that Shape Perceived Consciousness in Large Language Model-based AI: A Quantitative Study of Human Responses
- 2026PRISM: Probing Reasoning, Instruction, and Source Memory in LLM Hallucinations
- 2025Latent Debate: A Surrogate Framework for Interpreting LLM Thinking
- 2026Video-Only ToM: Enhancing Theory of Mind in Multimodal Large Language Models
- 2025Triggering Hallucinations in LLMs: A Quantitative Study of Prompt-Induced Hallucination in Large Language Models