Generalizable Neuro-symbolic Systems for Commonsense Question Answering
Not on the map. Why?
Abstract (arXiv)
This chapter illustrates how suitable neuro-symbolic models for language understanding can enable domain generalizability and robustness in downstream tasks. Different methods for integrating neural language models and knowledge graphs are discussed. The situations in which this combination is most appropriate are characterized, including quantitative evaluation and qualitative error analysis on a variety of commonsense question answering benchmark datasets.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 40 of its 66 references that are in the map. First posted on arXiv 17 Jan 2022.
Builds on
40 of 66 references.
References · 40
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
- 2019HellaSwag: Can a Machine Really Finish Your Sentence?cited by 4,018
- 2019PIQA: Reasoning about Physical Commonsense in Natural Languagecited by 2,818
- 2019XLNet: Generalized Autoregressive Pretraining for Language Understandingcited by 2,801
- 2016Visual Genome: Connecting Language and Vision Using Crowdsourced Dense Image Annotationscited by 2,646
- 2019ViLBERT: Pretraining Task-Agnostic Visiolinguistic Representations for Vision-and-Language Taskscited by 2,219
- 2018CommonsenseQA: A Question Answering Challenge Targeting Commonsense Knowledgecited by 1,793
- 2019COMET: Commonsense Transformers for Automatic Knowledge Graph Constructioncited by 450
- 2016A Corpus and Evaluation Framework for Deeper Understanding of Commonsense Storiescited by 413
- 2019What BERT is not: Lessons from a new suite of psycholinguistic diagnostics for language modelscited by 317
- 2015Towards AI-Complete Question Answering: A Set of Prerequisite Toy Taskscited by 309
28 more
- 2019Abductive Commonsense Reasoningcited by 300
- 2016Key-Value Memory Networks for Directly Reading Documentscited by 223
- 2019KagNet: Knowledge-Aware Graph Networks for Commonsense Reasoningcited by 216
- 2017Neural-Symbolic Learning and Reasoning: A Survey and Interpretationcited by 195
- 2020Improving Vision-and-Language Navigation with Image-Text Pairs from the Webcited by 177
- 2020Unsupervised Commonsense Question Answering with Self-Talkcited by 161
- 2018Visual Semantic Navigation using Scene Priorscited by 127
- 2019Evaluating Commonsense in Pre-trained Language Modelscited by 95
- 2021SpartQA: : A Textual Question Answering Benchmark for Spatial Reasoningcited by 75
- 2018Improving Question Answering by Commonsense-Based Pre-Trainingcited by 66
- 2021BERT is to NLP what AlexNet is to CV: Can Pre-Trained Language Models Identify Analogies?cited by 56
- 2018Knowledgeable Reader: Enhancing Cloze-Style Reading Comprehension with External Commonsense Knowledgecited by 48
- 2018Commonsense for Generative Multi-Hop Question Answering Taskscited by 48
- 2020ProtoQA: A Question Answering Dataset for Prototypical Common-Sense Reasoningcited by 45
- 2020CSKG: The CommonSense Knowledge Graphcited by 45
- 2019Towards Generalizable Neuro-Symbolic Systems for Commonsense Question Answeringcited by 37
- 2020Pre-training Is (Almost) All You Need: An Application to Commonsense Reasoningcited by 33
- 2021Core Challenges in Embodied Vision-Language Planningcited by 30
- 2020Self-supervised Knowledge Triplet Learning for Zero-shot Question Answeringcited by 29
- 2021Dimensions of Commonsense Knowledgecited by 29
- 2018Machine Common Sense Concept Papercited by 17
- 2019Dynamic Neuro-Symbolic Knowledge Graph Construction for Zero-shot Commonsense Question Answeringcited by 16
- 2019Option Comparison Network for Multiple-choice Reading Comprehensioncited by 14
- 2020Neuro-symbolic Architectures for Context Understandingcited by 13
- 2021Exploring Strategies for Generalizable Commonsense Reasoning with Pre-trained Modelscited by 11
- 2021Identify, Align, and Integrate: Matching Knowledge Graphs to Commonsense Reasoning Taskscited by 9
- 2020Commonsense Knowledge in Wikidatacited by 7
- 2021On the Capabilities of Pointer Networks for Deep Deductive Reasoningcited by 4
Built on by
Citing papers per year: 2023: 2; 2024: 1.
3 papers.
- 2024Cognitive LLMs: Towards Integrating Cognitive Architectures and Large Language Models for Manufacturing Decision-makingcited by 5
- 2023Rethinking the Evaluating Framework for Natural Language Understanding in AI Systems: Language Acquisition as a Core for Future Metricscited by 2
- 2023A Novel Neural-symbolic System under Statistical Relational Learningcited by 1
- 2024Cognitive LLMs: Towards Integrating Cognitive Architectures and Large Language Models for Manufacturing Decision-making17 Aug 2024
- 2023Rethinking the Evaluating Framework for Natural Language Understanding in AI Systems: Language Acquisition as a Core for Future Metrics21 Sep 2023
- 2023A Novel Neural-symbolic System under Statistical Relational Learning16 Sep 2023