Prompting Explicit and Implicit Knowledge for Multi-hop Question Answering Based on Human Reading Process
Not on the map. Why?
Abstract (arXiv)
Pre-trained language models (PLMs) leverage chains-of-thought (CoT) to simulate human reasoning and inference processes, achieving proficient performance in multi-hop QA. However, a gap persists between PLMs' reasoning abilities and those of humans when tackling complex problems. Psychological studies suggest a vital connection between explicit information in passages and human prior knowledge during reading. Nevertheless, current research has given insufficient attention to linking input passages and PLMs' pre-training-based knowledge from the perspective of human cognition studies. In this study, we introduce a Prompting Explicit and Implicit knowledge (PEI) framework, which uses prompts to connect explicit and implicit knowledge, aligning with human reading process for multi-hop QA. We consider the input passages as explicit knowledge, employing them to elicit implicit knowledge through unified prompt reasoning. Furthermore, our model incorporates type-specific reasoning via prompts, a form of implicit knowledge. Experimental results show that PEI performs comparably to the state-of-the-art on HotpotQA. Ablation studies confirm the efficacy of our model in bridging and integrating explicit and implicit knowledge.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 25 of its 42 references that are in the map. First posted on arXiv 29 Feb 2024.
Builds on
25 of 42 references.
References · 25
- 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,874
- 2022Large Language Models are Zero-Shot Reasonerscited by 4,323
- 2016SQuAD: 100,000+ Questions for Machine Comprehension of Textcited by 4,115
- 2021Prefix-Tuning: Optimizing Continuous Prompts for Generationcited by 3,878
- 2021The Power of Scale for Parameter-Efficient Prompt Tuningcited by 3,769
- 2018HotpotQA: A Dataset for Diverse, Explainable Multi-hop Question Answeringcited by 3,686
- 2020Longformer: The Long-Document Transformercited by 3,362
- 2020Constructing A Multi-hop QA Dataset for Comprehensive Evaluation of Reasoning Stepscited by 1,259
- 2022Interleaving Retrieval with Chain-of-Thought Reasoning for Knowledge-Intensive Multi-Step Questionscited by 911
- 2021MuSiQue: Multihop Questions via Single-hop Question Compositioncited by 893
- 2021P-Tuning v2: Prompt Tuning Can Be Comparable to Fine-tuning Universally Across Scales and Taskscited by 686
- 2023Navigate through Enigmatic Labyrinth A Survey of Chain of Thought Reasoning: Advances, Frontiers and Futurecited by 184
13 more
- 2019Multi-hop Reading Comprehension through Question Decomposition and Rescoringcited by 119
- 2020Unsupervised Question Decomposition for Question Answeringcited by 118
- 2019Hierarchical Graph Network for Multi-hop Question Answeringcited by 83
- 2022Iteratively Prompt Pre-trained Language Models for Chain of Thoughtcited by 75
- 2019Dynamically Fused Graph Network for Multi-hop Reasoningcited by 63
- 2019Select, Answer and Explain: Interpretable Multi-hop Reading Comprehension over Multiple Documentscited by 57
- 2019Answering while Summarizing: Multi-task Learning for Multi-hop QA with Evidence Extractioncited by 39
- 2023End-to-End Beam Retrieval for Multi-Hop Question Answeringcited by 35
- 2020Do Multi-Hop Question Answering Systems Know How to Answer the Single-Hop Sub-Questions?cited by 29
- 2023Emergent Representations of Program Semantics in Language Models Trained on Programscited by 28
- 2022Few-shot Reranking for Multi-hop QA via Language Model Promptingcited by 19
- 2021Graph-free Multi-hop Reading Comprehension: A Select-to-Guide Strategycited by 13
- 2022Prompt-based Conservation Learning for Multi-hop Question Answeringcited by 3
Built on by
Citing papers per year: 2024: 2; 2025: 1; 2026: 1.
4 papers.
- 2024MLD-EA: Check and Complete Narrative Coherence by Introducing Emotions and Actionscited by 4
- 2025Learning to Play Like Humans: A Framework for LLM Adaptation in Interactive Fiction Gamescited by 3
- 2024Similarity-Dissimilarity Loss for Multi-label Supervised Contrastive Learningcited by 2
- 2026PROPER Agents: Proactivity Driven Personalized Agents for Advancing Knowledge Gap Navigationcited by 2
- 2026PROPER Agents: Proactivity Driven Personalized Agents for Advancing Knowledge Gap Navigation14 Jan 2026
- 2025Learning to Play Like Humans: A Framework for LLM Adaptation in Interactive Fiction Games18 May 2025
- 2024MLD-EA: Check and Complete Narrative Coherence by Introducing Emotions and Actions3 Dec 2024
- 2024Similarity-Dissimilarity Loss for Multi-label Supervised Contrastive Learning17 Oct 2024
Similar, not cited
Close in wording, no citation either way
- 2026MixRea: Benchmarking Explicit-Implicit Reasoning in Large Language Models
- 2023Semi-Structured Chain-of-Thought: Integrating Multiple Sources of Knowledge for Improved Language Model Reasoning
- 2025Multi-Hop Question Answering: When Can Humans Help, and Where do They Struggle?
- 2025DPRM: A Dual Implicit Process Reward Model in Multi-Hop Question Answering
- 2025Unbiased Reasoning for Knowledge-Intensive Tasks in Large Language Models via Conditional Front-Door Adjustment
- 2023Metacognitive Prompting Improves Understanding in Large Language Models
- 2023PokeMQA: Programmable knowledge editing for Multi-hop Question Answering
- 2025π-CoT: Prolog-Initialized Chain-of-Thought Prompting for Multi-Hop Question-Answering