Knowledgeable Reader: Enhancing Cloze-Style Reading Comprehension with External Commonsense Knowledge
Not on the map. Why?
Abstract (arXiv)
We introduce a neural reading comprehension model that integrates external commonsense knowledge, encoded as a key-value memory, in a cloze-style setting. Instead of relying only on document-to-question interaction or discrete features as in prior work, our model attends to relevant external knowledge and combines this knowledge with the context representation before inferring the answer. This allows the model to attract and imply knowledge from an external knowledge source that is not explicitly stated in the text, but that is relevant for inferring the answer. Our model improves results over a very strong baseline on a hard Common Nouns dataset, making it a strong competitor of much more complex models. By including knowledge explicitly, our model can also provide evidence about the background knowledge used in the RC process.
Key facts. Cited by 48 papers in the map (data through 14 Oct 2026). First posted on arXiv 21 May 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 19; 2022: 12; 2023: 9; 2024: 6; 2025: 2.
48 papers.
Sort:
By area:
- 2021QA-GNN: Reasoning with Language Models and Knowledge Graphs for Question Answeringcited by 388
- 2022Making Large Language Models Better Reasoners with Step-Aware Verifiercited by 233
- 2022GreaseLM: Graph REASoning Enhanced Language Models for Question Answeringcited by 171
- 2022Deep Bidirectional Language-Knowledge Graph Pretrainingcited by 156
- 2023Active Prompting with Chain-of-Thought for Large Language Modelscited by 154
- 2023Cumulative Reasoning with Large Language Modelscited by 94
- 2022MISC: A MIxed Strategy-Aware Model Integrating COMET for Emotional Support Conversationcited by 85
- 2021Towards Interpreting and Mitigating Shortcut Learning Behavior of NLU Modelscited by 78
- 2023Graph Neural Prompting with Large Language Modelscited by 64
- 2021TIMEDIAL: Temporal Commonsense Reasoning in Dialogcited by 55
- 2021Automatic Story Generation: Challenges and Attemptscited by 28
- 2021Benchmarking Knowledge-Enhanced Commonsense Question Answering via Knowledge-to-Text Transformationcited by 19
36 more
- 2021Joint Biomedical Entity and Relation Extraction with Knowledge-Enhanced Collective Inferencecited by 19
- 2021Reasoning Over Virtual Knowledge Bases With Open Predicate Relationscited by 18
- 2021Dynamic Semantic Graph Construction and Reasoning for Explainable Multi-hop Science Question Answeringcited by 17
- 2023Meta Prompting for AI Systemscited by 16
- 2022BIC: Twitter Bot Detection with Text-Graph Interaction and Semantic Consistencycited by 14
- 2024Question-guided Knowledge Graph Re-scoring and Injection for Knowledge Graph Question Answeringcited by 13
- 2021Guiding Neural Story Generation with Reader Modelscited by 12
- 2022ComFact: A Benchmark for Linking Contextual Commonsense Knowledgecited by 11
- 2021Multi-turn Dialogue Reading Comprehension with Pivot Turns and Knowledgecited by 10
- 2022Elaboration-Generating Commonsense Question Answering at Scalecited by 9
- 2023FiTs: Fine-grained Two-stage Training for Knowledge-aware Question Answeringcited by 8
- 2022Relation-Aware Language-Graph Transformer for Question Answeringcited by 7
- 2024First Train to Generate, then Generate to Train: UnitedSynT5 for Few-Shot NLIcited by 7
- 2021Natural Language Processing with Commonsense Knowledge: A Surveycited by 4
- 2021IBERT: Idiom Cloze-style reading comprehension with Attentioncited by 4
- 2023KGQuiz: Evaluating the Generalization of Encoded Knowledge in Large Language Modelscited by 4
- 2021ArT: All-round Thinker for Unsupervised Commonsense Question-Answeringcited by 3
- 2022Generalizable Neuro-symbolic Systems for Commonsense Question Answeringcited by 3
- 2023Towards Faithful Knowledge Graph Explanation Through Deep Alignment in Commonsense Question Answeringcited by 3
- 2023Knowledge Rumination for Pre-trained Language Modelscited by 2
- 2021Incorporating Connections Beyond Knowledge Embeddings: A Plug-and-Play Module to Enhance Commonsense Reasoning in Machine Reading Comprehensioncited by 1
- 2022A Commonsense-Infused Language-Agnostic Learning Framework for Enhancing Prediction of Political Polarity in Multilingual News Headlinescited by 1
- 2024SemPool: Simple, robust, and interpretable KG pooling for enhancing language modelscited by 1
- 2024The Master-Slave Encoder Model for Improving Patent Text Summarization: A New Approach to Combining Specifications and Claimscited by 1
- 2025Beyond Completion: A Foundation Model for General Knowledge Graph Reasoningcited by 1
- 2021Understanding in Artificial Intelligencecited by 0
- 2021Prediction, Selection, and Generation: Exploration of Knowledge-Driven Conversation Systemcited by 0
- 2021Coarse-to-Careful: Seeking Semantic-related Knowledge for Open-domain Commonsense Question Answeringcited by 0
- 2021Knowledge-Aware Neural Networks for Medical Forum Question Classificationcited by 0
- 2021ActKnow: Active External Knowledge Infusion Learning for Question Answering in Low Data Regimecited by 0
- 2022elBERto: Self-supervised Commonsense Learning for Question Answeringcited by 0
- 2022Why Do Neural Language Models Still Need Commonsense Knowledge to Handle Semantic Variations in Question Answering?cited by 0
- 2023Answering Subjective Induction Questions on Products by Summarizing Multi-sources Multi-viewpoints Knowledgecited by 0
- 2024How to Understand Named Entities: Using Common Sense for News Captioningcited by 0
- 2024Differentiating Choices via Commonality for Multiple-Choice Question Answeringcited by 0
- 2025MetaXCR: Reinforcement-Based Meta-Transfer Learning for Cross-Lingual Commonsense Reasoningcited by 0
- 2025Beyond Completion: A Foundation Model for General Knowledge Graph Reasoning28 May 2025
- 2025MetaXCR: Reinforcement-Based Meta-Transfer Learning for Cross-Lingual Commonsense Reasoning9 Mar 2025
- 2024First Train to Generate, then Generate to Train: UnitedSynT5 for Few-Shot NLI12 Dec 2024
- 2024The Master-Slave Encoder Model for Improving Patent Text Summarization: A New Approach to Combining Specifications and Claims21 Nov 2024
- 2024Question-guided Knowledge Graph Re-scoring and Injection for Knowledge Graph Question Answering2 Oct 2024
- 2024Differentiating Choices via Commonality for Multiple-Choice Question Answering21 Aug 2024
- 2024How to Understand Named Entities: Using Common Sense for News Captioning11 Mar 2024
- 2024SemPool: Simple, robust, and interpretable KG pooling for enhancing language models3 Feb 2024
- 2023Meta Prompting for AI Systems20 Nov 2023
- 2023KGQuiz: Evaluating the Generalization of Encoded Knowledge in Large Language Models15 Oct 2023
- 2023Towards Faithful Knowledge Graph Explanation Through Deep Alignment in Commonsense Question Answering7 Oct 2023
- 2023Graph Neural Prompting with Large Language Models27 Sep 2023
36 more
- 2023Answering Subjective Induction Questions on Products by Summarizing Multi-sources Multi-viewpoints Knowledge12 Sep 2023
- 2023Cumulative Reasoning with Large Language Models8 Aug 2023
- 2023Knowledge Rumination for Pre-trained Language Models15 May 2023
- 2023Active Prompting with Chain-of-Thought for Large Language Models23 Feb 2023
- 2023FiTs: Fine-grained Two-stage Training for Knowledge-aware Question Answering23 Feb 2023
- 2022Relation-Aware Language-Graph Transformer for Question Answering2 Dec 2022
- 2022A Commonsense-Infused Language-Agnostic Learning Framework for Enhancing Prediction of Political Polarity in Multilingual News Headlines1 Dec 2022
- 2022ComFact: A Benchmark for Linking Contextual Commonsense Knowledge23 Oct 2022
- 2022Deep Bidirectional Language-Knowledge Graph Pretraining17 Oct 2022
- 2022Elaboration-Generating Commonsense Question Answering at Scale2 Sep 2022
- 2022Why Do Neural Language Models Still Need Commonsense Knowledge to Handle Semantic Variations in Question Answering?1 Sep 2022
- 2022BIC: Twitter Bot Detection with Text-Graph Interaction and Semantic Consistency17 Aug 2022
- 2022Making Large Language Models Better Reasoners with Step-Aware Verifier6 Jun 2022
- 2022MISC: A MIxed Strategy-Aware Model Integrating COMET for Emotional Support Conversation25 Mar 2022
- 2022elBERto: Self-supervised Commonsense Learning for Question Answering17 Mar 2022
- 2022GreaseLM: Graph REASoning Enhanced Language Models for Question Answering21 Jan 2022
- 2022Generalizable Neuro-symbolic Systems for Commonsense Question Answering17 Jan 2022
- 2021ArT: All-round Thinker for Unsupervised Commonsense Question-Answering26 Dec 2021
- 2021ActKnow: Active External Knowledge Infusion Learning for Question Answering in Low Data Regime17 Dec 2021
- 2021Guiding Neural Story Generation with Reader Models16 Dec 2021
- 2021IBERT: Idiom Cloze-style reading comprehension with Attention5 Nov 2021
- 2021Knowledge-Aware Neural Networks for Medical Forum Question Classification27 Sep 2021
- 2021Natural Language Processing with Commonsense Knowledge: A Survey10 Aug 2021
- 2021Coarse-to-Careful: Seeking Semantic-related Knowledge for Open-domain Commonsense Question Answering4 Jul 2021
- 2021TIMEDIAL: Temporal Commonsense Reasoning in Dialog8 Jun 2021
- 2021Joint Biomedical Entity and Relation Extraction with Knowledge-Enhanced Collective Inference27 May 2021
- 2021Dynamic Semantic Graph Construction and Reasoning for Explainable Multi-hop Science Question Answering25 May 2021
- 2021Prediction, Selection, and Generation: Exploration of Knowledge-Driven Conversation System23 Apr 2021
- 2021QA-GNN: Reasoning with Language Models and Knowledge Graphs for Question Answering13 Apr 2021
- 2021Incorporating Connections Beyond Knowledge Embeddings: A Plug-and-Play Module to Enhance Commonsense Reasoning in Machine Reading Comprehension26 Mar 2021
- 2021Towards Interpreting and Mitigating Shortcut Learning Behavior of NLU Models11 Mar 2021
- 2021Automatic Story Generation: Challenges and Attempts25 Feb 2021
- 2021Reasoning Over Virtual Knowledge Bases With Open Predicate Relations14 Feb 2021
- 2021Multi-turn Dialogue Reading Comprehension with Pivot Turns and Knowledge10 Feb 2021
- 2021Understanding in Artificial Intelligence17 Jan 2021
- 2021Benchmarking Knowledge-Enhanced Commonsense Question Answering via Knowledge-to-Text Transformation4 Jan 2021
- 2022Making Large Language Models Better Reasoners with Step-Aware Verifiercited by 233
- 2022GreaseLM: Graph REASoning Enhanced Language Models for Question Answeringcited by 171
- 2023Active Prompting with Chain-of-Thought for Large Language Modelscited by 154
- 2023Cumulative Reasoning with Large Language Modelscited by 94
- 2025MetaXCR: Reinforcement-Based Meta-Transfer Learning for Cross-Lingual Commonsense Reasoningcited by 0
- 2025MetaXCR: Reinforcement-Based Meta-Transfer Learning for Cross-Lingual Commonsense Reasoning9 Mar 2025
- 2023Cumulative Reasoning with Large Language Models8 Aug 2023
- 2023Active Prompting with Chain-of-Thought for Large Language Models23 Feb 2023
- 2022Making Large Language Models Better Reasoners with Step-Aware Verifier6 Jun 2022
- 2022GreaseLM: Graph REASoning Enhanced Language Models for Question Answering21 Jan 2022
- 2021QA-GNN: Reasoning with Language Models and Knowledge Graphs for Question Answeringcited by 388
- 2022Deep Bidirectional Language-Knowledge Graph Pretrainingcited by 156
- 2022MISC: A MIxed Strategy-Aware Model Integrating COMET for Emotional Support Conversationcited by 85
- 2021Towards Interpreting and Mitigating Shortcut Learning Behavior of NLU Modelscited by 78
- 2023Graph Neural Prompting with Large Language Modelscited by 64
- 2021TIMEDIAL: Temporal Commonsense Reasoning in Dialogcited by 55
- 2021Automatic Story Generation: Challenges and Attemptscited by 28
- 2021Benchmarking Knowledge-Enhanced Commonsense Question Answering via Knowledge-to-Text Transformationcited by 19
- 2021Joint Biomedical Entity and Relation Extraction with Knowledge-Enhanced Collective Inferencecited by 19
- 2021Reasoning Over Virtual Knowledge Bases With Open Predicate Relationscited by 18
- 2021Dynamic Semantic Graph Construction and Reasoning for Explainable Multi-hop Science Question Answeringcited by 17
- 2023Meta Prompting for AI Systemscited by 16
12 most cited of 43 All 43 (JSON)
- 2025Beyond Completion: A Foundation Model for General Knowledge Graph Reasoning28 May 2025
- 2024First Train to Generate, then Generate to Train: UnitedSynT5 for Few-Shot NLI12 Dec 2024
- 2024The Master-Slave Encoder Model for Improving Patent Text Summarization: A New Approach to Combining Specifications and Claims21 Nov 2024
- 2024Question-guided Knowledge Graph Re-scoring and Injection for Knowledge Graph Question Answering2 Oct 2024
- 2024Differentiating Choices via Commonality for Multiple-Choice Question Answering21 Aug 2024
- 2024How to Understand Named Entities: Using Common Sense for News Captioning11 Mar 2024
- 2024SemPool: Simple, robust, and interpretable KG pooling for enhancing language models3 Feb 2024
- 2023Meta Prompting for AI Systems20 Nov 2023
- 2023KGQuiz: Evaluating the Generalization of Encoded Knowledge in Large Language Models15 Oct 2023
- 2023Towards Faithful Knowledge Graph Explanation Through Deep Alignment in Commonsense Question Answering7 Oct 2023
- 2023Graph Neural Prompting with Large Language Models27 Sep 2023
- 2023Answering Subjective Induction Questions on Products by Summarizing Multi-sources Multi-viewpoints Knowledge12 Sep 2023
12 newest of 43 All 43 (JSON)