Building Human-like Communicative Intelligence: A Grounded Perspective
Not on the map. Why?
Abstract (arXiv)
Modern Artificial Intelligence (AI) systems excel at diverse tasks, from image classification to strategy games, even outperforming humans in many of these domains. After making astounding progress in language learning in the recent decade, AI systems, however, seem to approach the ceiling that does not reflect important aspects of human communicative capacities. Unlike human learners, communicative AI systems often fail to systematically generalize to new data, suffer from sample inefficiency, fail to capture common-sense semantic knowledge, and do not translate to real-world communicative situations. Cognitive Science offers several insights on how AI could move forward from this point. This paper aims to: (1) suggest that the dominant cognitively-inspired AI directions, based on nativist and symbolic paradigms, lack necessary substantiation and concreteness to guide progress in modern AI, and (2) articulate an alternative, "grounded", perspective on AI advancement, inspired by Embodied, Embedded, Extended, and Enactive Cognition (4E) research. I review results on 4E research lines in Cognitive Science to distinguish the main aspects of naturalistic learning conditions that play causal roles for human language development. I then use this analysis to propose a list of concrete, implementable components for building "grounded" linguistic intelligence. These components include embodying machines in a perception-action cycle, equipping agents with active exploration mechanisms so they can build their own curriculum, allowing agents to gradually develop motor abilities to promote piecemeal language development, and endowing the agents with adaptive feedback from their physical and social environment. I hope that these ideas can direct AI research towards building machines that develop human-like language abilities through their experiences with the world.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 33 of its 175 references that are in the map. First posted on arXiv 2 Jan 2022.
Builds on
33 of 175 references.
References · 33
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2020Shortcut Learning in Deep Neural Networkscited by 1,928
- 2016Learning to Communicate with Deep Multi-Agent Reinforcement Learningcited by 561
- 2019Emergent Tool Use From Multi-Agent Autocurriculacited by 308
- 2019Learn to Grow: A Continual Structure Learning Framework for Overcoming Catastrophic Forgettingcited by 302
- 2017Emergence of Grounded Compositional Language in Multi-Agent Populationscited by 257
- 2020Experience Grounds Languagecited by 241
- 2020The Next Decade in AI: Four Steps Towards Robust Artificial Intelligencecited by 194
- 2018Measuring abstract reasoning in neural networkscited by 165
- 2018Breaking NLI Systems with Sentences that Require Simple Lexical Inferencescited by 134
- 2018Emergence of Linguistic Communication from Referential Games with Symbolic and Pixel Inputcited by 102
21 more
- 2017Building machines that adapt and compute like brainscited by 99
- 2020Graph Neural Networks Meet Neural-Symbolic Computing: A Survey and Perspectivecited by 93
- 2019BERTs of a feather do not generalize together: Large variability in generalization across models with similar test set performancecited by 89
- 2018Evolved Policy Gradientscited by 86
- 2018Evolution-Guided Policy Gradient in Reinforcement Learningcited by 78
- 2016Towards an integration of deep learning and neurosciencecited by 77
- 2016Towards deep learning with segregated dendritescited by 71
- 2020Self-supervised learning through the eyes of a childcited by 61
- 2020Grounded Language Learning Fast and Slowcited by 54
- 2018CEM-RL: Combining evolutionary and gradient-based methods for policy searchcited by 53
- 2019Environmental drivers of systematicity and generalization in a situated agentcited by 50
- 2020Learning Dynamic Belief Graphs to Generalize on Text-Based Gamescited by 49
- 2020Evaluating Models' Local Decision Boundaries via Contrast Setscited by 24
- 2020Language (Re)modelling: Towards Embodied Language Understandingcited by 16
- 2019Knowledge is Never Enough: Towards Web Aided Deep Open World Recognitioncited by 12
- 2016Virtual Embodiment: A Scalable Long-Term Strategy for Artificial Intelligence Researchcited by 5
- 2020Deep Predictive Learning in Neocortex and Pulvinarcited by 5
- 2016A Paradigm for Situated and Goal-Driven Language Learningcited by 4
- 2020Rat big, cat eaten! Ideas for a useful deep-agent protolanguagecited by 4
- 2019Computational and Robotic Models of Early Language Development: A Reviewcited by 3
- 2021Updater-Extractor Architecture for Inductive World State Representationscited by 3
Built on by
Citing papers per year: 2022: 1; 2023: 2; 2024: 1.
4 papers.
- 2024InterIntent: Investigating Social Intelligence of LLMs via Intention Understanding in an Interactive Game Contextcited by 25
- 2022Artificial Intelligence for Health Message Generation: Theory, Method, and an Empirical Study Using Prompt Engineeringcited by 14
- 2023Rethinking the Evaluating Framework for Natural Language Understanding in AI Systems: Language Acquisition as a Core for Future Metricscited by 2
- 2023Can humans help BERT gain "confidence"?cited by 0
- 2024InterIntent: Investigating Social Intelligence of LLMs via Intention Understanding in an Interactive Game Context18 Jun 2024
- 2023Rethinking the Evaluating Framework for Natural Language Understanding in AI Systems: Language Acquisition as a Core for Future Metrics21 Sep 2023
- 2023Can humans help BERT gain "confidence"?31 Aug 2023
- 2022Artificial Intelligence for Health Message Generation: Theory, Method, and an Empirical Study Using Prompt Engineering14 Dec 2022