mlsanityData to 7 Oct 2026

Assessing Consciousness-Related Behaviors in Large Language Models Using the Maze Test

arXiv 2508.16705 ↗First posted 22 Aug 2025cs.CL cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

We investigate consciousness-like behaviors in Large Language Models (LLMs) using the Maze Test, challenging models to navigate mazes from a first-person perspective. This test simultaneously probes spatial awareness, perspective-taking, goal-directed behavior, and temporal sequencing-key consciousness-associated characteristics. After synthesizing consciousness theories into 13 essential characteristics, we evaluated 12 leading LLMs across zero-shot, one-shot, and few-shot learning scenarios. Results showed reasoning-capable LLMs consistently outperforming standard versions, with Gemini 2.0 Pro achieving 52.9% Complete Path Accuracy and DeepSeek-R1 reaching 80.5% Partial Path Accuracy. The gap between these metrics indicates LLMs struggle to maintain coherent self-models throughout solutions -- a fundamental consciousness aspect. While LLMs show progress in consciousness-related behaviors through reasoning mechanisms, they lack the integrated, persistent self-awareness characteristic of consciousness.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 22 of its 98 references that are in the map. First posted on arXiv 22 Aug 2025.

Builds on

22 of 98 references.

References · 22

  1. 2017Attention Is All You Needcited by 59,932
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  3. 2020Language Models are Few-Shot Learnerscited by 32,199
  4. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
  5. 2022Flamingo: a Visual Language Model for Few-Shot Learningcited by 4,337
  6. 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,500
  7. 2023Sparks of Artificial General Intelligence: Early experiments with GPT-4cited by 2,579
  8. 2022Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language modelscited by 1,970
  9. 2019Transformer-XL: Attentive Language Models Beyond a Fixed-Length Contextcited by 1,830
  10. 2023A Survey on Evaluation of Large Language Modelscited by 1,227
  11. 2022Using cognitive psychology to understand GPT-3cited by 389
  12. 2021Time-Aware Language Models as Temporal Knowledge Basescited by 290
10 more
  1. 2020Experience Grounds Languagecited by 241
  2. 2023Grounding Large Language Models in Interactive Environments with Online Reinforcement Learningcited by 193
  3. 2023Embers of Autoregression: Understanding Large Language Models Through the Problem They are Trained to Solvecited by 175
  4. 2022The Debate Over Understanding in AI's Large Language Modelscited by 142
  5. 2023Taken out of context: On measuring situational awareness in LLMscited by 131
  6. 2016Towards an integration of deep learning and neurosciencecited by 77
  7. 2024People cannot distinguish GPT-4 from a human in a Turing testcited by 46
  8. 2025AlphaMaze: Enhancing Large Language Models' Spatial Intelligence via GRPOcited by 33
  9. 2024Needle in the Haystack for Memory Based Large Language Modelscited by 32
  10. 2024Do Language Models Understand Time?cited by 14

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025MazeEval: A Benchmark for Testing Sequential Decision-Making in Language Models
  2. 2026Understanding Large Language Models
  3. 2022Thinking Fast and Slow in Large Language Models
  4. 2025Identifying Features that Shape Perceived Consciousness in Large Language Model-based AI: A Quantitative Study of Human Responses
  5. 2026PRISM: Probing Reasoning, Instruction, and Source Memory in LLM Hallucinations
  6. 2025Latent Debate: A Surrogate Framework for Interpreting LLM Thinking
  7. 2026Video-Only ToM: Enhancing Theory of Mind in Multimodal Large Language Models
  8. 2025Triggering Hallucinations in LLMs: A Quantitative Study of Prompt-Induced Hallucination in Large Language Models