Cognitive Graph for Multi-Hop Reading Comprehension at Scale
Not on the map. Why?
Abstract (arXiv)
We propose a new CogQA framework for multi-hop question answering in web-scale documents. Inspired by the dual process theory in cognitive science, the framework gradually builds a textitcognitive graph in an iterative process by coordinating an implicit extraction module (System 1) and an explicit reasoning module (System 2). While giving accurate answers, our framework further provides explainable reasoning paths. Specifically, our implementation based on BERT and graph neural network efficiently handles millions of documents for multi-hop reasoning questions in the HotpotQA fullwiki dataset, achieving a winning joint F1 score of 34.9 on the leaderboard, compared to 23.6 of the best competitor.
Key facts. Cited by 65 papers in the map (data through 7 Oct 2026). First posted on arXiv 14 May 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 19; 2022: 17; 2023: 15; 2024: 10; 2025: 2; 2026: 2.
65 papers.
Sort:
By area:
- 2023H2O: Heavy-Hitter Oracle for Efficient Generative Inference of Large Language Modelscited by 805
- 2021Pre-Trained Models: Past, Present and Futurecited by 319
- 2024HippoRAG: Neurobiologically Inspired Long-Term Memory for Large Language Modelscited by 273
- 2022Making Large Language Models Better Reasoners with Step-Aware Verifiercited by 231
- 2023Towards Building the Federated GPT: Federated Instruction Tuningcited by 184
- 2021Retrieving and Reading: A Comprehensive Survey on Open-domain Question Answeringcited by 178
- 2023Active Prompting with Chain-of-Thought for Large Language Modelscited by 154
- 2024LongRAG: Enhancing Retrieval-Augmented Generation with Long-context LLMscited by 104
- 2023Cumulative Reasoning with Large Language Modelscited by 94
- 2021TransferNet: An Effective and Transparent Framework for Multi-hop Question Answering over Relation Graphcited by 60
- 2023Sparse MoE as the New Dropout: Scaling Dense and Self-Slimmable Transformerscited by 59
- 2022Reasoning Like Program Executorscited by 45
38 more
- 2023The Emergence of Essential Sparsity in Large Pre-trained Models: The Weights that Mattercited by 42
- 2021Decomposing Complex Questions Makes Multi-Hop QA Easier and More Interpretablecited by 35
- 2021Adaptive Information Seeking for Open-Domain Question Answeringcited by 29
- 2024Cofca: A Step-Wise Counterfactual Multi-hop QA benchmarkcited by 26
- 2023Causal Reasoning of Entities and Events in Procedural Textscited by 23
- 2023Instant Soup: Cheap Pruning Ensembles in A Single Pass Can Draw Lottery Tickets from Large Modelscited by 20
- 2023Chain-of-Skills: A Configurable Model for Open-domain Question Answeringcited by 19
- 2021Towards Accurate and Compact Architectures via Neural Architecture Transformercited by 17
- 2023Meta Prompting for AI Systemscited by 16
- 2021Complex Factoid Question Answering with a Free-Text Knowledge Graphcited by 14
- 2022Open-domain Question Answering via Chain of Reasoning over Heterogeneous Knowledgecited by 14
- 2022Empowering Language Models with Knowledge Graph Reasoning for Question Answeringcited by 14
- 2021Graph-free Multi-hop Reading Comprehension: A Select-to-Guide Strategycited by 13
- 2024GenDec: A robust generative Question-decomposition method for Multi-hop reasoningcited by 13
- 2021Hopper: Multi-hop Transformer for Spatiotemporal Reasoningcited by 12
- 2022From Easy to Hard: Two-stage Selector and Reader for Multi-hop Question Answeringcited by 12
- 2021Learning Reasoning Paths over Semantic Graphs for Video-grounded Dialoguescited by 11
- 2024Fine-Grained Modeling of Narrative Context: A Coherence Perspective via Retrospective Questionscited by 11
- 2022Reasoning over Hybrid Chain for Table-and-Text Open Domain QAcited by 10
- 2024Towards Building Specialized Generalist AI with System 1 and System 2 Fusioncited by 8
- 2022Understanding and Improving Zero-shot Multi-hop Reasoning in Generative Question Answeringcited by 7
- 2022Reflection of Thought: Inversely Eliciting Numerical Reasoning in Language Models via Solving Linear Systemscited by 7
- 2023On the power of graph neural networks and the role of the activation functioncited by 7
- 2022KMIR: A Benchmark for Evaluating Knowledge Memorization, Identification and Reasoning Abilities of Language Modelscited by 6
- 2022Counterfactual Multihop QA: A Cause-Effect Approach for Reducing Disconnected Reasoningcited by 6
- 2024NeuroPath: A Neural Pathway Transformer for Joining the Dots of Human Connectomescited by 6
- 2021Memory Augmented Sequential Paragraph Retrieval for Multi-hop Question Answeringcited by 4
- 2021Reasoning Chain Based Adversarial Attack for Multi-hop Question Answeringcited by 4
- 2023Performance Prediction for Multi-hop Questionscited by 4
- 2026DF-RAG: Query-Aware Diversity for Retrieval-Augmented Generationcited by 4
- 2021Encoding Explanatory Knowledge for Zero-shot Science Question Answeringcited by 3
- 2021Weakly Supervised Pre-Training for Multi-Hop Retrievercited by 3
- 2022Disentangling Reasoning Capabilities from Language Models with Compositional Reasoning Transformerscited by 3
- 2024All Against Some: Efficient Integration of Large Language Models for Message Passing in Graph Neural Networkscited by 3
- 2025StepChain GraphRAG: Reasoning Over Knowledge Graphs for Multi-Hop Question Answeringcited by 3
- 2021Ensemble Learning-Based Approach for Improving Generalization Capability of Machine Reading Comprehension Systemscited by 2
- 2021Improving Low-resource Reading Comprehension via Cross-lingual Transposition Rethinkingcited by 2
- 2022Ask to Understand: Question Generation for Multi-hop Question Answeringcited by 2
50 most cited of 65 All 65 (JSON)
- 2026ConRAG: Lightweight inference of multi-hop relations28 Sep 2026
- 2026DF-RAG: Query-Aware Diversity for Retrieval-Augmented Generation23 Jan 2026
- 2025How Prompts Move Language Model Behavior: Frames, Salience, and Construal as Semantic Control14 Dec 2025
- 2025StepChain GraphRAG: Reasoning Over Knowledge Graphs for Multi-Hop Question Answering3 Oct 2025
- 2024NeuroPath: A Neural Pathway Transformer for Joining the Dots of Human Connectomes26 Sep 2024
- 2024Multi-turn Response Selection with Commonsense-enhanced Language Models26 Jul 2024
- 2024All Against Some: Efficient Integration of Large Language Models for Message Passing in Graph Neural Networks20 Jul 2024
- 2024Towards Building Specialized Generalist AI with System 1 and System 2 Fusion11 Jul 2024
- 2024LongRAG: Enhancing Retrieval-Augmented Generation with Long-context LLMs21 Jun 2024
- 2024HippoRAG: Neurobiologically Inspired Long-Term Memory for Large Language Models23 May 2024
- 2024Fine-Grained Modeling of Narrative Context: A Coherence Perspective via Retrospective Questions21 Feb 2024
- 2024Cofca: A Step-Wise Counterfactual Multi-hop QA benchmark19 Feb 2024
38 more
- 2024GenDec: A robust generative Question-decomposition method for Multi-hop reasoning17 Feb 2024
- 2024Message Detouring: A Simple Yet Effective Cycle Representation for Expressive Graph Learning12 Feb 2024
- 2023Meta Prompting for AI Systems20 Nov 2023
- 2023Perturbation-based Active Learning for Question Answering4 Nov 2023
- 2023Performance Prediction for Multi-hop Questions12 Aug 2023
- 2023Cumulative Reasoning with Large Language Models8 Aug 2023
- 2023On the power of graph neural networks and the role of the activation function10 Jul 2023
- 2023H2O: Heavy-Hitter Oracle for Efficient Generative Inference of Large Language Models24 Jun 2023
- 2023Modeling Hierarchical Reasoning Chains by Linking Discourse Units and Key Phrases for Reading Comprehension21 Jun 2023
- 2023Instant Soup: Cheap Pruning Ensembles in A Single Pass Can Draw Lottery Tickets from Large Models18 Jun 2023
- 2023The Emergence of Essential Sparsity in Large Pre-trained Models: The Weights that Matter6 Jun 2023
- 2023Towards Building the Federated GPT: Federated Instruction Tuning9 May 2023
- 2023Chain-of-Skills: A Configurable Model for Open-domain Question Answering4 May 2023
- 2023Sparse MoE as the New Dropout: Scaling Dense and Self-Slimmable Transformers2 Mar 2023
- 2023Active Prompting with Chain-of-Thought for Large Language Models23 Feb 2023
- 2023Analyzing the Effectiveness of the Underlying Reasoning Tasks in Multi-hop Question Answering12 Feb 2023
- 2023Causal Reasoning of Entities and Events in Procedural Texts26 Jan 2023
- 2022A Comprehensive Survey on Multi-hop Machine Reading Comprehension Approaches8 Dec 2022
- 2022Empowering Language Models with Knowledge Graph Reasoning for Question Answering15 Nov 2022
- 2022Open-domain Question Answering via Chain of Reasoning over Heterogeneous Knowledge22 Oct 2022
- 2022Disentangling Reasoning Capabilities from Language Models with Compositional Reasoning Transformers20 Oct 2022
- 2022RAPS: A Novel Few-Shot Relation Extraction Pipeline with Query-Information Guided Attention and Adaptive Prototype Fusion15 Oct 2022
- 2022Counterfactual Multihop QA: A Cause-Effect Approach for Reducing Disconnected Reasoning13 Oct 2022
- 2022Reflection of Thought: Inversely Eliciting Numerical Reasoning in Language Models via Solving Linear Systems11 Oct 2022
- 2022Understanding and Improving Zero-shot Multi-hop Reasoning in Generative Question Answering9 Oct 2022
- 2022Brain-inspired Graph Spiking Neural Networks for Commonsense Knowledge Representation and Reasoning11 Jul 2022
- 2022Discourse-Aware Graph Networks for Textual Logical Reasoning4 Jul 2022
- 2022KE-QI: A Knowledge Enhanced Article Quality Identification Dataset15 Jun 2022
- 2022Making Large Language Models Better Reasoners with Step-Aware Verifier6 Jun 2022
- 2022From Easy to Hard: Two-stage Selector and Reader for Multi-hop Question Answering24 May 2022
- 2022Ask to Understand: Question Generation for Multi-hop Question Answering17 Mar 2022
- 2022KMIR: A Benchmark for Evaluating Knowledge Memorization, Identification and Reasoning Abilities of Language Models28 Feb 2022
- 2022Reasoning Like Program Executors27 Jan 2022
- 2022Reasoning over Hybrid Chain for Table-and-Text Open Domain QA15 Jan 2022
- 2021Reasoning Chain Based Adversarial Attack for Multi-hop Question Answering17 Dec 2021
- 2021An original model for multi-target learning of logical rules for knowledge graph reasoning12 Dec 2021
- 2021Decomposing Complex Questions Makes Multi-Hop QA Easier and More Interpretable26 Oct 2021
- 2021Adaptive Information Seeking for Open-Domain Question Answering14 Sep 2021
50 newest of 65 All 65 (JSON)
- 2022Making Large Language Models Better Reasoners with Step-Aware Verifiercited by 231
- 2023Active Prompting with Chain-of-Thought for Large Language Modelscited by 154
- 2023Cumulative Reasoning with Large Language Modelscited by 94
- 2022Reasoning Like Program Executorscited by 45
- 2024Cofca: A Step-Wise Counterfactual Multi-hop QA benchmarkcited by 26
- 2023Causal Reasoning of Entities and Events in Procedural Textscited by 23
- 2022Open-domain Question Answering via Chain of Reasoning over Heterogeneous Knowledgecited by 14
- 2022Empowering Language Models with Knowledge Graph Reasoning for Question Answeringcited by 14
- 2024GenDec: A robust generative Question-decomposition method for Multi-hop reasoningcited by 13
- 2022Reasoning over Hybrid Chain for Table-and-Text Open Domain QAcited by 10
- 2022Understanding and Improving Zero-shot Multi-hop Reasoning in Generative Question Answeringcited by 7
- 2022Reflection of Thought: Inversely Eliciting Numerical Reasoning in Language Models via Solving Linear Systemscited by 7
12 most cited of 19 All 19 (JSON)
- 2025StepChain GraphRAG: Reasoning Over Knowledge Graphs for Multi-Hop Question Answering3 Oct 2025
- 2024Cofca: A Step-Wise Counterfactual Multi-hop QA benchmark19 Feb 2024
- 2024GenDec: A robust generative Question-decomposition method for Multi-hop reasoning17 Feb 2024
- 2023Cumulative Reasoning with Large Language Models8 Aug 2023
- 2023Modeling Hierarchical Reasoning Chains by Linking Discourse Units and Key Phrases for Reading Comprehension21 Jun 2023
- 2023Active Prompting with Chain-of-Thought for Large Language Models23 Feb 2023
- 2023Analyzing the Effectiveness of the Underlying Reasoning Tasks in Multi-hop Question Answering12 Feb 2023
- 2023Causal Reasoning of Entities and Events in Procedural Texts26 Jan 2023
- 2022Empowering Language Models with Knowledge Graph Reasoning for Question Answering15 Nov 2022
- 2022Open-domain Question Answering via Chain of Reasoning over Heterogeneous Knowledge22 Oct 2022
- 2022Disentangling Reasoning Capabilities from Language Models with Compositional Reasoning Transformers20 Oct 2022
- 2022Counterfactual Multihop QA: A Cause-Effect Approach for Reducing Disconnected Reasoning13 Oct 2022
12 newest of 19 All 19 (JSON)
- 2021Pre-Trained Models: Past, Present and Futurecited by 319
- 2023Towards Building the Federated GPT: Federated Instruction Tuningcited by 184
- 2021Retrieving and Reading: A Comprehensive Survey on Open-domain Question Answeringcited by 178
- 2021TransferNet: An Effective and Transparent Framework for Multi-hop Question Answering over Relation Graphcited by 60
- 2023The Emergence of Essential Sparsity in Large Pre-trained Models: The Weights that Mattercited by 42
- 2021Decomposing Complex Questions Makes Multi-Hop QA Easier and More Interpretablecited by 35
- 2021Adaptive Information Seeking for Open-Domain Question Answeringcited by 29
- 2023Instant Soup: Cheap Pruning Ensembles in A Single Pass Can Draw Lottery Tickets from Large Modelscited by 20
- 2023Chain-of-Skills: A Configurable Model for Open-domain Question Answeringcited by 19
- 2021Towards Accurate and Compact Architectures via Neural Architecture Transformercited by 17
- 2023Meta Prompting for AI Systemscited by 16
- 2021Complex Factoid Question Answering with a Free-Text Knowledge Graphcited by 14
12 most cited of 41 All 41 (JSON)
- 2026ConRAG: Lightweight inference of multi-hop relations28 Sep 2026
- 2025How Prompts Move Language Model Behavior: Frames, Salience, and Construal as Semantic Control14 Dec 2025
- 2024NeuroPath: A Neural Pathway Transformer for Joining the Dots of Human Connectomes26 Sep 2024
- 2024Multi-turn Response Selection with Commonsense-enhanced Language Models26 Jul 2024
- 2024All Against Some: Efficient Integration of Large Language Models for Message Passing in Graph Neural Networks20 Jul 2024
- 2024Towards Building Specialized Generalist AI with System 1 and System 2 Fusion11 Jul 2024
- 2024Fine-Grained Modeling of Narrative Context: A Coherence Perspective via Retrospective Questions21 Feb 2024
- 2024Message Detouring: A Simple Yet Effective Cycle Representation for Expressive Graph Learning12 Feb 2024
- 2023Meta Prompting for AI Systems20 Nov 2023
- 2023Perturbation-based Active Learning for Question Answering4 Nov 2023
- 2023Performance Prediction for Multi-hop Questions12 Aug 2023
- 2023On the power of graph neural networks and the role of the activation function10 Jul 2023
12 newest of 41 All 41 (JSON)