mlsanityData to 7 Oct 2026

On the link between conscious function and general intelligence in humans and machines

arXiv 2204.05133 ↗First posted 24 Mar 2022cs.AI cs.NEcited by 15

Not on the map. Why?

Abstract (arXiv)

In popular media, there is often a connection drawn between the advent of awareness in artificial agents and those same agents simultaneously achieving human or superhuman level intelligence. In this work, we explore the validity and potential application of this seemingly intuitive link between consciousness and intelligence. We do so by examining the cognitive abilities associated with three contemporary theories of conscious function: Global Workspace Theory (GWT), Information Generation Theory (IGT), and Attention Schema Theory (AST). We find that all three theories specifically relate conscious function to some aspect of domain-general intelligence in humans. With this insight, we turn to the field of Artificial Intelligence (AI) and find that, while still far from demonstrating general intelligence, many state-of-the-art deep learning methods have begun to incorporate key aspects of each of the three functional theories. Having identified this trend, we use the motivating example of mental time travel in humans to propose ways in which insights from each of the three theories may be combined into a single unified and implementable model. Given that it is made possible by cognitive abilities underlying each of the three functional theories, artificial agents capable of mental time travel would not only possess greater general intelligence than current approaches, but also be more consistent with our current understanding of the functional role of consciousness in humans, thus making it a promising near-term goal for AI research.

Key facts. Cited by 15 papers in the map (data through 7 Oct 2026). Builds on 92 of its 248 references that are in the map. First posted on arXiv 24 Mar 2022.

Builds on

92 of 248 references.

References · 92

  1. 2017Attention Is All You Needcited by 59,932
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  3. 2020Language Models are Few-Shot Learnerscited by 32,199
  4. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  5. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
  6. 2014Neural Machine Translation by Jointly Learning to Align and Translatecited by 4,530
  7. 2021On the Opportunities and Risks of Foundation Modelscited by 3,961
  8. 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,595
  9. 2017Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layercited by 3,413
  10. 2021Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsitycited by 3,014
  11. 2013Visualizing and Understanding Convolutional Networkscited by 2,278
  12. 2020The Many Faces of Robustness: A Critical Analysis of Out-of-Distribution Generalizationcited by 1,842
38 more
  1. 2019Invariant Risk Minimizationcited by 1,832
  2. 2020GShard: Scaling Giant Models with Conditional Computation and Automatic Shardingcited by 1,601
  3. 2020Rethinking Attention with Performerscited by 1,584
  4. 2018World Modelscited by 1,444
  5. 2015Show, Attend and Tell: Neural Image Caption Generation with Visual Attentioncited by 1,421
  6. 2020DiffWave: A Versatile Diffusion Model for Audio Synthesiscited by 1,339
  7. 2016Progressive Neural Networkscited by 1,332
  8. 2019Mastering Atari, Go, Chess and Shogi by Planning with a Learned Modelcited by 1,327
  9. 2018Continual Lifelong Learning with Neural Networks: A Reviewcited by 1,313
  10. 2018Learning Latent Dynamics for Planning from Pixelscited by 1,221
  11. 2019Dota 2 with Large Scale Deep Reinforcement Learningcited by 1,084
  12. 2015Prioritized Experience Replaycited by 1,070
  13. 2016Geometric deep learning: going beyond Euclidean datacited by 1,042
  14. 2020Mastering Atari with Discrete World Modelscited by 990
  15. 2014Deep Learning in Neural Networks: An Overviewcited by 765
  16. 2019Deep Double Descent: Where Bigger Models and More Data Hurtcited by 667
  17. 2018Taskonomy: Disentangling Task Transfer Learningcited by 631
  18. 2014Neural Turing Machinescited by 630
  19. 2021CLIPort: What and Where Pathways for Robotic Manipulationcited by 617
  20. 2021Perceiver IO: A General Architecture for Structured Inputs & Outputscited by 616
  21. 2021CoAtNet: Marrying Convolution and Attention for All Data Sizescited by 566
  22. 2016RL2: Fast Reinforcement Learning via Slow Reinforcement Learningcited by 490
  23. 2016Adaptive Computation Time for Recurrent Neural Networkscited by 479
  24. 2021Linear Transformers Are Secretly Fast Weight Programmerscited by 471
  25. 2016Learning to reinforcement learncited by 369
  26. 2017PathNet: Evolution Channels Gradient Descent in Super Neural Networkscited by 362
  27. 2020Agent57: Outperforming the Atari Human Benchmarkcited by 300
  28. 2020Inductive Biases for Deep Learning of Higher-Level Cognitioncited by 273
  29. 2020Neurosymbolic AI: The 3rd Wavecited by 253
  30. 2020Experience Grounds Languagecited by 241
  31. 2018Selective Experience Replay for Lifelong Learningcited by 239
  32. 2014A Survey of Multi-Objective Sequential Decision-Makingcited by 229
  33. 2017DeepStack: Expert-Level Artificial Intelligence in No-Limit Pokercited by 228
  34. 2018Machine Theory of Mindcited by 222
  35. 2019Recurrent Independent Mechanismscited by 219
  36. 2018Deep Learning: A Critical Appraisalcited by 214
  37. 2013k-Sparse Autoencoderscited by 209
  38. 2019Task2Vec: Task Embedding for Meta-Learningcited by 197

50 most cited of 92 All 92 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 9; 2024: 2; 2025: 2; 2026: 2.

15 papers.

Sort:

By area: