mlsanityData to 7 Oct 2026

Probing for Consciousness in Machines

arXiv 2411.16262 ↗First posted 25 Nov 2024cs.AI q-bio.NCcited by 1

Not on the map. Why?

Abstract (arXiv)

This study explores the potential for artificial agents to develop core consciousness, as proposed by Antonio Damasio's theory of consciousness. According to Damasio, the emergence of core consciousness relies on the integration of a self model, informed by representations of emotions and feelings, and a world model. We hypothesize that an artificial agent, trained via reinforcement learning (RL) in a virtual environment, can develop preliminary forms of these models as a byproduct of its primary task. The agent's main objective is to learn to play a video game and explore the environment. To evaluate the emergence of world and self models, we employ probes-feedforward classifiers that use the activations of the trained agent's neural networks to predict the spatial positions of the agent itself. Our results demonstrate that the agent can form rudimentary world and self models, suggesting a pathway toward developing machine consciousness. This research provides foundational insights into the capabilities of artificial agents in mirroring aspects of human consciousness, with implications for future advancements in artificial intelligence.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 28 of its 63 references that are in the map. First posted on arXiv 25 Nov 2024.

Builds on

28 of 63 references.

References · 28

  1. 2017Proximal Policy Optimization Algorithmscited by 14,441
  2. 2018Soft Actor-Critic: Off-Policy Maximum Entropy Deep Reinforcement Learning with a Stochastic Actorcited by 4,635
  3. 2013Playing Atari with Deep Reinforcement Learningcited by 3,211
  4. 2015High-Dimensional Continuous Control Using Generalized Advantage Estimationcited by 1,916
  5. 2018World Modelscited by 1,444
  6. 2019Mastering Atari, Go, Chess and Shogi by Planning with a Learned Modelcited by 1,327
  7. 2016Understanding intermediate layers using linear classifier probescited by 1,279
  8. 2023Mastering Diverse Domains through World Modelscited by 1,193
  9. 2017Curiosity-driven Exploration by Self-supervised Predictioncited by 1,173
  10. 2018Exploration by Random Network Distillationcited by 966
  11. 2021Probing Classifiers: Promises, Shortcomings, and Advancescited by 831
  12. 2022Emergent World Representations: Exploring a Sequence Model Trained on a Synthetic Taskcited by 417
16 more
  1. 2016Deep Reinforcement Learning for Robotic Manipulation with Asynchronous Off-Policy Updatescited by 342
  2. 2019Go-Explore: a New Approach for Hard-Exploration Problemscited by 207
  3. 2020The NetHack Learning Environmentcited by 196
  4. 2022Evolving Curricula with Regret-Based Environment Designcited by 166
  5. 2023Motif: Intrinsic Motivation from Artificial Intelligence Feedbackcited by 99
  6. 2021MiniHack the Planet: A Sandbox for Open-Ended Reinforcement Learning Researchcited by 96
  7. 2024People cannot distinguish GPT-4 from a human in a Turing testcited by 46
  8. 2021CORA: Benchmarks, Baselines, and Metrics as a Platform for Continual Reinforcement Learning Agentscited by 36
  9. 2022Insights From the NeurIPS 2021 NetHack Challengecited by 20
  10. 2022Neural Network based Successor Representations of Space and Languagecited by 9
  11. 2023Word class representations spontaneously emerge in a deep neural network trained on next word predictioncited by 9
  12. 2022Neural Network based Formation of Cognitive Maps of Semantic Spaces and the Emergence of Abstract Conceptscited by 8
  13. 2020Will we ever have Conscious Machines?cited by 7
  14. 2023Conceptual Cognitive Maps Formation with Neural Successor Networks and Word Embeddingscited by 4
  15. 2022Learning to Query Internet Text for Informing Reinforcement Learning Agentscited by 3
  16. 2023Multi-Modal Cognitive Maps based on Neural Networks trained on Successor Representationscited by 3

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2024The Phenomenology of Machine: A Comprehensive Analysis of the Sentience of the OpenAI-o1 Model Integrating Functionalism, Consciousness Theories, Active Inference, and AI Architectures
  2. 2026Categorical AI phenomenology: A first-person approach
  3. 2026From S3Q Theory to Implementation: Towards an Architecture for Machine Qualia
  4. 2025Sentience Quest: Towards Embodied, Emotionally Adaptive, Self-Evolving, Ethically Aligned Artificial General Intelligence
  5. 2026Exploration Through Introspection: A Self-Aware Reward Model
  6. 2026CTM-AI: A Blueprint for General AI Inspired by a Model of Consciousness
  7. 2026Grounded world models in biological organisms and future embodied AI
  8. 2016Discovering Latent States for Model Learning: Applying Sensorimotor Contingencies Theory and Predictive Processing to Model Context