Language Cognition and Language Computation -- Human and Machine Language Understanding
Not on the map. Why?
Abstract (arXiv)
Language understanding is a key scientific issue in the fields of cognitive and computer science. However, the two disciplines differ substantially in the specific research questions. Cognitive science focuses on analyzing the specific mechanism of the brain and investigating the brain's response to language; few studies have examined the brain's language system as a whole. By contrast, computer scientists focus on the efficiency of practical applications when choosing research questions but may ignore the most essential laws of language. Given these differences, can a combination of the disciplines offer new insights for building intelligent language models and studying language cognitive mechanisms? In the following text, we first review the research questions, history, and methods of language understanding in cognitive and computer science, focusing on the current progress and challenges. We then compare and contrast the research of language understanding in cognitive and computer sciences. Finally, we review existing work that combines insights from language cognition and language computation and offer prospects for future development trends.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 39 of its 157 references that are in the map. First posted on arXiv 12 Jan 2023.
Builds on
39 of 157 references.
References · 39
- 2017Attention Is All You Needcited by 59,932
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,304
- 2016Overcoming catastrophic forgetting in neural networkscited by 4,718
- 2013Efficient Estimation of Word Representations in Vector Spacecited by 4,346
- 2019Transformer-XL: Attentive Language Models Beyond a Fixed-Length Contextcited by 1,830
- 2017Dynamic Routing Between Capsulescited by 689
- 2020A Survey on Knowledge Graphs: Representation, Acquisition and Applicationscited by 643
- 2014Neural Turing Machinescited by 630
- 2020Pre-trained Models for Natural Language Processing: A Surveycited by 504
- 2016A Corpus and Evaluation Framework for Deeper Understanding of Commonsense Storiescited by 413
27 more
- 2014Memory Networkscited by 354
- 2019Knowledge Enhanced Contextual Word Representationscited by 294
- 2018Generalisation in humans and deep neural networkscited by 237
- 2014Word Representations via Gaussian Embeddingcited by 96
- 2019The emergence of number and syntax units in LSTM language modelscited by 92
- 2020Convolutional Neural Networks as a Model of the Visual System: Past, Present, and Futurecited by 83
- 2019NCLS: Neural Cross-Lingual Summarizationcited by 64
- 2018A Survey on Semantic Parsingcited by 62
- 2017Knowledge Graph Embedding with Iterative Guidance from Soft Rulescited by 51
- 2016Attention Correctness in Neural Image Captioningcited by 35
- 2018Straight to the Tree: Constituency Parsing with Neural Syntactic Distancecited by 32
- 2015Finding Function in Form: Compositional Character Models for Open Vocabulary Word Representationcited by 28
- 2019Still a Pain in the Neck: Evaluating Text Representations on Lexical Compositioncited by 27
- 2016Improving sentence compression by learning to predict gazecited by 24
- 2015Tree-structured composition in neural networks without tree-structured architecturescited by 23
- 2020Bridging Information-Seeking Human Gaze and Machine Reading Comprehensioncited by 20
- 2020Neural Machine Translation: A Review of Methods, Resources, and Toolscited by 18
- 2021Can a Fruit Fly Learn Word Embeddings?cited by 17
- 2021Probing artificial neural networks: insights from neurosciencecited by 17
- 2019Incremental Learning from Scratch for Task-Oriented Dialogue Systemscited by 11
- 2018Learning Multimodal Word Representation via Dynamic Fusion Methodscited by 7
- 2020Modeling Task Effects on Meaning Representation in the Brain via Zero-Shot MEG Predictioncited by 7
- 2022Connecting Neural Response measurements & Computational Models of language: a non-comprehensive guidecited by 6
- 2016Learning Sentence Representation with Guidance of Human Attentioncited by 2
- 2020Towards a Universal Continuous Knowledge Basecited by 2
- 2017Investigating Inner Properties of Multimodal Representation and Semantic Compositionality with Brain-based Componential Semanticscited by 1
- 2020Mapping the Timescale Organization of Neural Language Modelscited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.