Careful Selection of Knowledge to solve Open Book Question Answering
Not on the map. Why?
Abstract (arXiv)
Open book question answering is a type of natural language based QA (NLQA) where questions are expected to be answered with respect to a given set of open book facts, and common knowledge about a topic. Recently a challenge involving such QA, OpenBookQA, has been proposed. Unlike most other NLQA tasks that focus on linguistic understanding, OpenBookQA requires deeper reasoning involving linguistic understanding as well as reasoning with common knowledge. In this paper we address QA with respect to the OpenBookQA dataset and combine state of the art language models with abductive information retrieval (IR), information gain based re-ranking, passage selection and weighted scoring to achieve 72.0% accuracy, an 11.6% improvement over the current state of the art.
Key facts. Cited by 35 papers in the map (data through 13 Oct 2026). First posted on arXiv 24 Jul 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 12; 2022: 3; 2023: 3; 2024: 7; 2025: 6; 2026: 4.
35 papers.
Sort:
By area:
- 2021QA-GNN: Reasoning with Language Models and Knowledge Graphs for Question Answeringcited by 386
- 2021Retrieving and Reading: A Comprehensive Survey on Open-domain Question Answeringcited by 178
- 2023On the Impact of Calibration Data in Post-training Quantization and Pruningcited by 53
- 2021Weakly-Supervised Visual-Retriever-Reader for Knowledge-based Question Answeringcited by 50
- 2021JointLK: Joint Reasoning with Language Models and Knowledge Graphs for Commonsense Question Answeringcited by 40
- 2024Basis Sharing: Cross-Layer Parameter Sharing for Large Language Model Compressioncited by 35
- 2024SGLP: A Similarity Guided Fast Layer Partition Pruning for Compressing Large Deep Modelscited by 24
- 2024Wings: Learning Multimodal LLMs without Text-only Forgettingcited by 23
- 2021GNN is a Counter? Revisiting GNN for Question Answeringcited by 21
- 2021Dynamic Semantic Graph Construction and Reasoning for Explainable Multi-hop Science Question Answeringcited by 17
- 2021Question Answering Survey: Directions, Challenges, Datasets, Evaluation Matricescited by 17
- 2024Enhancing Ethical Explanations of Large Language Models through Iterative Symbolic Refinementcited by 16
23 more
- 2021Exploiting Reasoning Chains for Multi-hop Science Question Answeringcited by 15
- 2022"John is 50 years old, can his son be 65?" Evaluating NLP Models' Understanding of Feasibilitycited by 15
- 2024CCI3.0-HQ: a large-scale Chinese dataset of high quality designed for pre-training large language modelscited by 11
- 2024Self-calibration for Language Model Quantization and Pruningcited by 10
- 2022Elaboration-Generating Commonsense Question Answering at Scalecited by 9
- 2025Generalized Fisher-Weighted SVD: Scalable Kronecker-Factored Fisher Approximation for Compressing Large Language Modelscited by 8
- 2023Long-Tailed Question Answering in an Open Worldcited by 7
- 2025Layer-wise dynamic rank for compressing large language modelscited by 7
- 2021Zero-Shot Open-Book Question Answeringcited by 6
- 2025Compressing Language Models for Specialized Domainscited by 4
- 2021Encoding Explanatory Knowledge for Zero-shot Science Question Answeringcited by 3
- 2025HASSLE-free: A unified Framework for Sparse plus Low-Rank Matrix Decomposition for LLMscited by 3
- 2026ADMM-Q: An Improved Hessian-based Weight Quantizer for Post-Training Quantization of Large Language Modelscited by 3
- 2023KEPR: Knowledge Enhancement and Plausibility Ranking for Generative Commonsense Question Answeringcited by 2
- 2026Correctness-Optimized Residual Activation Lens (CORAL): Transferrable and Calibration-Aware Inference-Time Steeringcited by 2
- 20263BASiL: An Algorithmic Framework for Sparse plus Low-Rank Compression of LLMscited by 2
- 2022Semantic Sentence Composition Reasoning for Multi-Hop Question Answeringcited by 1
- 2024Large Language Models aren't all that you needcited by 1
- 2025Rethinking Parameter Sharing as Graph Coloring for Structured Compressioncited by 1
- 2026∞-MoE: Generalizing Mixture of Experts to Infinite Expertscited by 1
- 2021Understanding in Artificial Intelligencecited by 0
- 2021ActKnow: Active External Knowledge Infusion Learning for Question Answering in Low Data Regimecited by 0
- 2025TSENOR: Highly-Efficient Algorithm for Finding Transposable N:M Sparse Maskscited by 0
- 2026ADMM-Q: An Improved Hessian-based Weight Quantizer for Post-Training Quantization of Large Language Models11 May 2026
- 20263BASiL: An Algorithmic Framework for Sparse plus Low-Rank Compression of LLMs2 Mar 2026
- 2026Correctness-Optimized Residual Activation Lens (CORAL): Transferrable and Calibration-Aware Inference-Time Steering5 Feb 2026
- 2026∞-MoE: Generalizing Mixture of Experts to Infinite Experts25 Jan 2026
- 2025Rethinking Parameter Sharing as Graph Coloring for Structured Compression10 Nov 2025
- 2025Layer-wise dynamic rank for compressing large language models30 Sep 2025
- 2025TSENOR: Highly-Efficient Algorithm for Finding Transposable N:M Sparse Masks29 May 2025
- 2025Generalized Fisher-Weighted SVD: Scalable Kronecker-Factored Fisher Approximation for Compressing Large Language Models23 May 2025
- 2025Compressing Language Models for Specialized Domains25 Feb 2025
- 2025HASSLE-free: A unified Framework for Sparse plus Low-Rank Matrix Decomposition for LLMs2 Feb 2025
- 2024CCI3.0-HQ: a large-scale Chinese dataset of high quality designed for pre-training large language models24 Oct 2024
- 2024Self-calibration for Language Model Quantization and Pruning22 Oct 2024
23 more
- 2024SGLP: A Similarity Guided Fast Layer Partition Pruning for Compressing Large Deep Models14 Oct 2024
- 2024Basis Sharing: Cross-Layer Parameter Sharing for Large Language Model Compression2 Oct 2024
- 2024Wings: Learning Multimodal LLMs without Text-only Forgetting5 Jun 2024
- 2024Enhancing Ethical Explanations of Large Language Models through Iterative Symbolic Refinement1 Feb 2024
- 2024Large Language Models aren't all that you need1 Jan 2024
- 2023On the Impact of Calibration Data in Post-training Quantization and Pruning16 Nov 2023
- 2023KEPR: Knowledge Enhancement and Plausibility Ranking for Generative Commonsense Question Answering15 May 2023
- 2023Long-Tailed Question Answering in an Open World11 May 2023
- 2022"John is 50 years old, can his son be 65?" Evaluating NLP Models' Understanding of Feasibility14 Oct 2022
- 2022Elaboration-Generating Commonsense Question Answering at Scale2 Sep 2022
- 2022Semantic Sentence Composition Reasoning for Multi-Hop Question Answering1 Mar 2022
- 2021ActKnow: Active External Knowledge Infusion Learning for Question Answering in Low Data Regime17 Dec 2021
- 2021Question Answering Survey: Directions, Challenges, Datasets, Evaluation Matrices7 Dec 2021
- 2021JointLK: Joint Reasoning with Language Models and Knowledge Graphs for Commonsense Question Answering6 Dec 2021
- 2021Zero-Shot Open-Book Question Answering22 Nov 2021
- 2021GNN is a Counter? Revisiting GNN for Question Answering7 Oct 2021
- 2021Weakly-Supervised Visual-Retriever-Reader for Knowledge-based Question Answering9 Sep 2021
- 2021Exploiting Reasoning Chains for Multi-hop Science Question Answering7 Sep 2021
- 2021Dynamic Semantic Graph Construction and Reasoning for Explainable Multi-hop Science Question Answering25 May 2021
- 2021Encoding Explanatory Knowledge for Zero-shot Science Question Answering12 May 2021
- 2021QA-GNN: Reasoning with Language Models and Knowledge Graphs for Question Answering13 Apr 2021
- 2021Understanding in Artificial Intelligence17 Jan 2021
- 2021Retrieving and Reading: A Comprehensive Survey on Open-domain Question Answering4 Jan 2021
- 2024Wings: Learning Multimodal LLMs without Text-only Forgettingcited by 23
- 2026∞-MoE: Generalizing Mixture of Experts to Infinite Experts25 Jan 2026
- 2021QA-GNN: Reasoning with Language Models and Knowledge Graphs for Question Answeringcited by 386
- 2021Retrieving and Reading: A Comprehensive Survey on Open-domain Question Answeringcited by 178
- 2023On the Impact of Calibration Data in Post-training Quantization and Pruningcited by 53
- 2021Weakly-Supervised Visual-Retriever-Reader for Knowledge-based Question Answeringcited by 50
- 2021JointLK: Joint Reasoning with Language Models and Knowledge Graphs for Commonsense Question Answeringcited by 40
- 2024Basis Sharing: Cross-Layer Parameter Sharing for Large Language Model Compressioncited by 35
- 2024SGLP: A Similarity Guided Fast Layer Partition Pruning for Compressing Large Deep Modelscited by 24
- 2021GNN is a Counter? Revisiting GNN for Question Answeringcited by 21
- 2021Dynamic Semantic Graph Construction and Reasoning for Explainable Multi-hop Science Question Answeringcited by 17
- 2021Question Answering Survey: Directions, Challenges, Datasets, Evaluation Matricescited by 17
- 2021Exploiting Reasoning Chains for Multi-hop Science Question Answeringcited by 15
- 2022"John is 50 years old, can his son be 65?" Evaluating NLP Models' Understanding of Feasibilitycited by 15
12 most cited of 31 All 31 (JSON)
- 2026ADMM-Q: An Improved Hessian-based Weight Quantizer for Post-Training Quantization of Large Language Models11 May 2026
- 20263BASiL: An Algorithmic Framework for Sparse plus Low-Rank Compression of LLMs2 Mar 2026
- 2026Correctness-Optimized Residual Activation Lens (CORAL): Transferrable and Calibration-Aware Inference-Time Steering5 Feb 2026
- 2025Rethinking Parameter Sharing as Graph Coloring for Structured Compression10 Nov 2025
- 2025Layer-wise dynamic rank for compressing large language models30 Sep 2025
- 2025TSENOR: Highly-Efficient Algorithm for Finding Transposable N:M Sparse Masks29 May 2025
- 2025Generalized Fisher-Weighted SVD: Scalable Kronecker-Factored Fisher Approximation for Compressing Large Language Models23 May 2025
- 2025Compressing Language Models for Specialized Domains25 Feb 2025
- 2025HASSLE-free: A unified Framework for Sparse plus Low-Rank Matrix Decomposition for LLMs2 Feb 2025
- 2024CCI3.0-HQ: a large-scale Chinese dataset of high quality designed for pre-training large language models24 Oct 2024
- 2024Self-calibration for Language Model Quantization and Pruning22 Oct 2024
- 2024SGLP: A Similarity Guided Fast Layer Partition Pruning for Compressing Large Deep Models14 Oct 2024
12 newest of 31 All 31 (JSON)