Encoding Explanatory Knowledge for Zero-shot Science Question Answering
Not on the map. Why?
Abstract (arXiv)
This paper describes N-XKT (Neural encoding based on eXplanatory Knowledge Transfer), a novel method for the automatic transfer of explanatory knowledge through neural encoding mechanisms. We demonstrate that N-XKT is able to improve accuracy and generalization on science Question Answering (QA). Specifically, by leveraging facts from background explanatory knowledge corpora, the N-XKT model shows a clear improvement on zero-shot QA. Furthermore, we show that N-XKT can be fine-tuned on a target QA dataset, enabling faster convergence and more accurate results. A systematic analysis is conducted to quantitatively analyze the performance of the N-XKT model and the impact of different categories of knowledge on the zero-shot generalization task.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 36 of its 50 references that are in the map. First posted on arXiv 12 May 2021.
Builds on
36 of 50 references.
References · 36
- 2017Attention Is All You Needcited by 59,932
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2018Think you have Solved Question Answering? Try ARC, the AI2 Reasoning Challengecited by 4,710
- 2018HotpotQA: A Dataset for Diverse, Explainable Multi-hop Question Answeringcited by 3,686
- 2017A Broad-Coverage Challenge Corpus for Sentence Understanding through Inferencecited by 2,665
- 2018Can a Suit of Armor Conduct Electricity? A New Dataset for Open Book Question Answeringcited by 2,114
- 2015A large annotated corpus for learning natural language inferencecited by 1,837
- 2019SciBERT: A Pretrained Language Model for Scientific Textcited by 1,404
- 2016ConceptNet 5.5: An Open Multilingual Graph of General Knowledgecited by 1,065
- 2019DROP: A Reading Comprehension Benchmark Requiring Discrete Reasoning Over Paragraphscited by 883
- 2017RACE: Large-scale ReAding Comprehension Dataset From Examinationscited by 851
- 2019Explain Yourself! Leveraging Language Models for Commonsense Reasoningcited by 367
24 more
- 2019QASC: A Dataset for Question Answering via Sentence Compositioncited by 248
- 2019Learning to Retrieve Reasoning Paths over Wikipedia Graph for Question Answeringcited by 147
- 2018Improving Question Answering by Commonsense-Based Pre-Trainingcited by 66
- 2019Cognitive Graph for Multi-Hop Reading Comprehension at Scalecited by 65
- 2019Dynamically Fused Graph Network for Multi-hop Reasoningcited by 63
- 2018WorldTree: A Corpus of Explanation Graphs for Elementary Science Questions supporting Multi-Hop Inferencecited by 60
- 2019Quick and (not so) Dirty: Unsupervised Selection of Justification Sentences for Multi-hop Question Answeringcited by 58
- 2019Careful Selection of Knowledge to solve Open Book Question Answeringcited by 35
- 2019From 'F' to 'A' on the N.Y. Regents Science Exams: An Overview of the Aristo Projectcited by 33
- 2020A Survey on Explainability in Machine Reading Comprehensioncited by 33
- 2018MCScript: A Novel Dataset for Assessing Machine Comprehension Using Script Knowledgecited by 30
- 2020Self-supervised Knowledge Triplet Learning for Zero-shot Question Answeringcited by 29
- 2017Answering Complex Questions Using Open Information Extractioncited by 25
- 2018Improving Machine Reading Comprehension with General Reading Strategiescited by 20
- 2018Exploiting Explicit Paths for Multi-hop Reading Comprehensioncited by 16
- 2019Question Answering as Global Reasoning over Semantic Abstractionscited by 14
- 2018Yuanfudao at SemEval-2018 Task 11: Three-way Attention and Relational Knowledge for Commonsense Machine Comprehensioncited by 12
- 2018Learning to Attend On Essential Terms: An Enhanced Retriever-Reader Model for Open-domain Question Answeringcited by 12
- 2018KG^2: Learning to Reason Science Exam Questions with Contextual Knowledge Graph Embeddingscited by 7
- 2019Identifying Supporting Facts for Multi-hop Question Answering with Document Graph Networkscited by 7
- 2018Answering Science Exam Questions Using Query Rewriting with Background Knowledgecited by 4
- 2016Science Question Answering using Instructional Materialscited by 2
- 2018Sanity Check: A Strong Alignment and Information Retrieval Baseline for Question Answeringcited by 2
- 2018Improving Retrieval-Based Question Answering with Deep Inference Modelscited by 1
Built on by
Citing papers per year: 2021: 1; 2022: 2.
3 papers.