mlsanityData to 7 Oct 2026

Prompting Explicit and Implicit Knowledge for Multi-hop Question Answering Based on Human Reading Process

arXiv 2402.19350 ↗First posted 29 Feb 2024cs.CLcited by 4

Not on the map. Why?

Abstract (arXiv)

Pre-trained language models (PLMs) leverage chains-of-thought (CoT) to simulate human reasoning and inference processes, achieving proficient performance in multi-hop QA. However, a gap persists between PLMs' reasoning abilities and those of humans when tackling complex problems. Psychological studies suggest a vital connection between explicit information in passages and human prior knowledge during reading. Nevertheless, current research has given insufficient attention to linking input passages and PLMs' pre-training-based knowledge from the perspective of human cognition studies. In this study, we introduce a Prompting Explicit and Implicit knowledge (PEI) framework, which uses prompts to connect explicit and implicit knowledge, aligning with human reading process for multi-hop QA. We consider the input passages as explicit knowledge, employing them to elicit implicit knowledge through unified prompt reasoning. Furthermore, our model incorporates type-specific reasoning via prompts, a form of implicit knowledge. Experimental results show that PEI performs comparably to the state-of-the-art on HotpotQA. Ablation studies confirm the efficacy of our model in bridging and integrating explicit and implicit knowledge.

Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 25 of its 42 references that are in the map. First posted on arXiv 29 Feb 2024.

Builds on

25 of 42 references.

References · 25

  1. 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,874
  2. 2022Large Language Models are Zero-Shot Reasonerscited by 4,323
  3. 2016SQuAD: 100,000+ Questions for Machine Comprehension of Textcited by 4,115
  4. 2021Prefix-Tuning: Optimizing Continuous Prompts for Generationcited by 3,878
  5. 2021The Power of Scale for Parameter-Efficient Prompt Tuningcited by 3,769
  6. 2018HotpotQA: A Dataset for Diverse, Explainable Multi-hop Question Answeringcited by 3,686
  7. 2020Longformer: The Long-Document Transformercited by 3,362
  8. 2020Constructing A Multi-hop QA Dataset for Comprehensive Evaluation of Reasoning Stepscited by 1,259
  9. 2022Interleaving Retrieval with Chain-of-Thought Reasoning for Knowledge-Intensive Multi-Step Questionscited by 911
  10. 2021MuSiQue: Multihop Questions via Single-hop Question Compositioncited by 893
  11. 2021P-Tuning v2: Prompt Tuning Can Be Comparable to Fine-tuning Universally Across Scales and Taskscited by 686
  12. 2023Navigate through Enigmatic Labyrinth A Survey of Chain of Thought Reasoning: Advances, Frontiers and Futurecited by 184
13 more
  1. 2019Multi-hop Reading Comprehension through Question Decomposition and Rescoringcited by 119
  2. 2020Unsupervised Question Decomposition for Question Answeringcited by 118
  3. 2019Hierarchical Graph Network for Multi-hop Question Answeringcited by 83
  4. 2022Iteratively Prompt Pre-trained Language Models for Chain of Thoughtcited by 75
  5. 2019Dynamically Fused Graph Network for Multi-hop Reasoningcited by 63
  6. 2019Select, Answer and Explain: Interpretable Multi-hop Reading Comprehension over Multiple Documentscited by 57
  7. 2019Answering while Summarizing: Multi-task Learning for Multi-hop QA with Evidence Extractioncited by 39
  8. 2023End-to-End Beam Retrieval for Multi-Hop Question Answeringcited by 35
  9. 2020Do Multi-Hop Question Answering Systems Know How to Answer the Single-Hop Sub-Questions?cited by 29
  10. 2023Emergent Representations of Program Semantics in Language Models Trained on Programscited by 28
  11. 2022Few-shot Reranking for Multi-hop QA via Language Model Promptingcited by 19
  12. 2021Graph-free Multi-hop Reading Comprehension: A Select-to-Guide Strategycited by 13
  13. 2022Prompt-based Conservation Learning for Multi-hop Question Answeringcited by 3

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 2; 2025: 1; 2026: 1.

4 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026MixRea: Benchmarking Explicit-Implicit Reasoning in Large Language Models
  2. 2023Semi-Structured Chain-of-Thought: Integrating Multiple Sources of Knowledge for Improved Language Model Reasoning
  3. 2025Multi-Hop Question Answering: When Can Humans Help, and Where do They Struggle?
  4. 2025DPRM: A Dual Implicit Process Reward Model in Multi-Hop Question Answering
  5. 2025Unbiased Reasoning for Knowledge-Intensive Tasks in Large Language Models via Conditional Front-Door Adjustment
  6. 2023Metacognitive Prompting Improves Understanding in Large Language Models
  7. 2023PokeMQA: Programmable knowledge editing for Multi-hop Question Answering
  8. 2025π-CoT: Prolog-Initialized Chain-of-Thought Prompting for Multi-Hop Question-Answering