Exploiting Reasoning Chains for Multi-hop Science Question Answering
Not on the map. Why?
Abstract (arXiv)
We propose a novel Chain Guided Retriever-reader (tt CGR) framework to model the reasoning chain for multi-hop Science Question Answering. Our framework is capable of performing explainable reasoning without the need of any corpus-specific annotations, such as the ground-truth reasoning chain, or human-annotated entity mentions. Specifically, we first generate reasoning chains from a semantic graph constructed by Abstract Meaning Representation of retrieved evidence facts. A textitChain-aware loss, concerning both local and global chain information, is also designed to enable the generated chains to serve as distant supervision signals for training the retriever, where reinforcement learning is also adopted to maximize the utility of the reasoning chains. Our framework allows the retriever to capture step-by-step clues of the entire reasoning process, which is not only shown to be effective on two challenging multi-hop Science QA tasks, namely OpenBookQA and ARC-Challenge, but also favors explainability.
Key facts. Cited by 15 papers in the map (data through 7 Oct 2026). Builds on 40 of its 48 references that are in the map. First posted on arXiv 7 Sep 2021.
Builds on
40 of 48 references.
References · 40
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
- 2018Think you have Solved Question Answering? Try ARC, the AI2 Reasoning Challengecited by 4,710
- 2020Dense Passage Retrieval for Open-Domain Question Answeringcited by 3,779
- 2018HotpotQA: A Dataset for Diverse, Explainable Multi-hop Question Answeringcited by 3,686
- 2018Can a Suit of Armor Conduct Electricity? A New Dataset for Open Book Question Answeringcited by 2,114
- 2016ConceptNet 5.5: An Open Multilingual Graph of General Knowledgecited by 1,065
- 2017Reading Wikipedia to Answer Open-Domain Questionscited by 777
- 2021Did Aristotle Use a Laptop? A Question Answering Benchmark with Implicit Reasoning Strategiescited by 736
- 2020UnifiedQA: Crossing Format Boundaries With a Single QA Systemcited by 475
- 2019COMET: Commonsense Transformers for Automatic Knowledge Graph Constructioncited by 450
28 more
- 2021QA-GNN: Reasoning with Language Models and Knowledge Graphs for Question Answeringcited by 386
- 2019FreeLB: Enhanced Adversarial Training for Natural Language Understandingcited by 261
- 2019QASC: A Dataset for Question Answering via Sentence Compositioncited by 248
- 2021Retrieving and Reading: A Comprehensive Survey on Open-domain Question Answeringcited by 178
- 2020Answering Complex Open-Domain Questions with Multi-Hop Dense Retrievalcited by 160
- 2019Learning to Retrieve Reasoning Paths over Wikipedia Graph for Question Answeringcited by 147
- 2020Scalable Multi-Hop Relational Reasoning for Knowledge-Aware Question Answeringcited by 122
- 2018Transforming Question Answering Datasets Into Natural Language Inference Datasetscited by 99
- 2019Hierarchical Graph Network for Multi-hop Question Answeringcited by 83
- 2020Interactive Path Reasoning on Graph for Conversational Recommendationcited by 72
- 2019Dynamically Fused Graph Network for Multi-hop Reasoningcited by 63
- 2019Quick and (not so) Dirty: Unsupervised Selection of Justification Sentences for Multi-hop Question Answeringcited by 58
- 2019Select, Answer and Explain: Interpretable Multi-hop Reading Comprehension over Multiple Documentscited by 57
- 2020IIRC: A Dataset of Incomplete Information Reading Comprehension Questionscited by 52
- 2021NeurIPS 2020 EfficientQA Competition: Systems, Analyses and Lessons Learnedcited by 52
- 2019Revealing the Importance of Semantic Retrieval for Machine Reading at Scalecited by 50
- 2020AMR Parsing via Graph-Sequence Iterative Inferencecited by 47
- 2020Connecting the Dots: A Knowledgeable Path Generator for Commonsense Question Answeringcited by 44
- 2019Multi-hop Question Answering via Reasoning Chainscited by 42
- 2019Semantic Neural Machine Translation using AMRcited by 37
- 2018Abstract Meaning Representation for Multi-Document Summarizationcited by 35
- 2019Careful Selection of Knowledge to solve Open Book Question Answeringcited by 35
- 2020Unsupervised Alignment-based Iterative Evidence Retrieval for Multi-hop Question Answeringcited by 24
- 2021Dynamic Semantic Graph Construction and Reasoning for Explainable Multi-hop Science Question Answeringcited by 17
- 2021Complex Factoid Question Answering with a Free-Text Knowledge Graphcited by 14
- 2020Knowledge Fusion and Semantic Knowledge Ranking for Open Domain Question Answeringcited by 9
- 2020GMH: A General Multi-hop Reasoning Model for KG Completioncited by 6
- 2021Memory Augmented Sequential Paragraph Retrieval for Multi-hop Question Answeringcited by 4
Built on by
Citing papers per year: 2022: 4; 2023: 3; 2024: 4; 2025: 3; 2026: 1.
15 papers.
Sort:
By area:
- 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,601
- 2022ScienceWorld: Is your Agent Smarter than a 5th Grader?cited by 298
- 2024Retrieval-Augmented Generation with Graphs (GraphRAG)cited by 170
- 2023Progressive-Hint Prompting Improves Reasoning in Large Language Modelscited by 147
- 2022Rationale-Augmented Ensembles in Language Modelscited by 111
- 2024Don't Just Say "I don't know"! Self-aligning Large Language Models for Responding to Unknown Questions with Explanationscited by 30
- 2024Enhancing Ethical Explanations of Large Language Models through Iterative Symbolic Refinementcited by 16
- 2025DocHop-QA: Towards Multi-Hop Reasoning over Multimodal Document Collectionscited by 7
- 2022ConReader: Exploring Implicit Relations in Contracts for Contract Clause Extractioncited by 5
- 2023HOP, UNION, GENERATE: Explainable Multi-hop Reasoning without Rationale Supervisioncited by 5
- 2024ConTReGen: Context-driven Tree-structured Retrieval for Open-domain Long-form Text Generationcited by 4
- 2026DF-RAG: Query-Aware Diversity for Retrieval-Augmented Generationcited by 4
3 more
- 2023DepWiGNN: A Depth-wise Graph Neural Network for Multi-hop Spatial Reasoning in Textcited by 3
- 2025Multi-Hop Reasoning for Question Answering with Hyperbolic Representationscited by 1
- 2025When Guessing is Rewarded: Rethinking Language Model Evaluation with Distributional Uncertainty Scoringcited by 0
- 2026DF-RAG: Query-Aware Diversity for Retrieval-Augmented Generation23 Jan 2026
- 2025When Guessing is Rewarded: Rethinking Language Model Evaluation with Distributional Uncertainty Scoring5 Oct 2025
- 2025DocHop-QA: Towards Multi-Hop Reasoning over Multimodal Document Collections20 Aug 2025
- 2025Multi-Hop Reasoning for Question Answering with Hyperbolic Representations4 Jul 2025
- 2024Retrieval-Augmented Generation with Graphs (GraphRAG)31 Dec 2024
- 2024ConTReGen: Context-driven Tree-structured Retrieval for Open-domain Long-form Text Generation20 Oct 2024
- 2024Don't Just Say "I don't know"! Self-aligning Large Language Models for Responding to Unknown Questions with Explanations23 Feb 2024
- 2024Enhancing Ethical Explanations of Large Language Models through Iterative Symbolic Refinement1 Feb 2024
- 2023DepWiGNN: A Depth-wise Graph Neural Network for Multi-hop Spatial Reasoning in Text19 Oct 2023
- 2023HOP, UNION, GENERATE: Explainable Multi-hop Reasoning without Rationale Supervision23 May 2023
- 2023Progressive-Hint Prompting Improves Reasoning in Large Language Models19 Apr 2023
- 2022ConReader: Exploring Implicit Relations in Contracts for Contract Clause Extraction17 Oct 2022
3 more
- 2022Rationale-Augmented Ensembles in Language Models2 Jul 2022
- 2022Self-Consistency Improves Chain of Thought Reasoning in Language Models21 Mar 2022
- 2022ScienceWorld: Is your Agent Smarter than a 5th Grader?14 Mar 2022
- 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,601
- 2022ScienceWorld: Is your Agent Smarter than a 5th Grader?cited by 298
- 2023Progressive-Hint Prompting Improves Reasoning in Large Language Modelscited by 147
- 2024Enhancing Ethical Explanations of Large Language Models through Iterative Symbolic Refinementcited by 16
- 2025DocHop-QA: Towards Multi-Hop Reasoning over Multimodal Document Collectionscited by 7
- 2023HOP, UNION, GENERATE: Explainable Multi-hop Reasoning without Rationale Supervisioncited by 5
- 2023DepWiGNN: A Depth-wise Graph Neural Network for Multi-hop Spatial Reasoning in Textcited by 3
- 2025Multi-Hop Reasoning for Question Answering with Hyperbolic Representationscited by 1
- 2025DocHop-QA: Towards Multi-Hop Reasoning over Multimodal Document Collections20 Aug 2025
- 2025Multi-Hop Reasoning for Question Answering with Hyperbolic Representations4 Jul 2025
- 2024Enhancing Ethical Explanations of Large Language Models through Iterative Symbolic Refinement1 Feb 2024
- 2023DepWiGNN: A Depth-wise Graph Neural Network for Multi-hop Spatial Reasoning in Text19 Oct 2023
- 2023HOP, UNION, GENERATE: Explainable Multi-hop Reasoning without Rationale Supervision23 May 2023
- 2023Progressive-Hint Prompting Improves Reasoning in Large Language Models19 Apr 2023
- 2022Self-Consistency Improves Chain of Thought Reasoning in Language Models21 Mar 2022
- 2022ScienceWorld: Is your Agent Smarter than a 5th Grader?14 Mar 2022