mlsanityData to 7 Oct 2026

QPaug: Question and Passage Augmentation for Open-Domain Question Answering of LLMs

arXiv 2406.14277 ↗First posted 20 Jun 2024cs.CL cs.AIcited by 3

On the map: Retrieval-augmented generation → RAG robustness and adaptive retrieval

Abstract (arXiv)

Retrieval-augmented generation (RAG) has received much attention for Open-domain question-answering (ODQA) tasks as a means to compensate for the parametric knowledge of large language models (LLMs). While previous approaches focused on processing retrieved passages to remove irrelevant context, they still rely heavily on the quality of retrieved passages which can degrade if the question is ambiguous or complex. In this paper, we propose a simple yet efficient method called question and passage augmentation (QPaug) via LLMs for open-domain QA. QPaug first decomposes the original questions into multiple-step sub-questions. By augmenting the original question with detailed sub-questions and planning, we are able to make the query more specific on what needs to be retrieved, improving the retrieval performance. In addition, to compensate for the case where the retrieved passages contain distracting information or divided opinions, we augment the retrieved passages with self-generated passages by LLMs to guide the answer extraction. Experimental results show that QPaug outperforms the previous state-of-the-art and achieves significant performance gain over existing RAG methods. The source code is available at urlhttps://github.com/kmswin1/QPaug.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Placed in RAG robustness and adaptive retrieval, one of 15 directions in Retrieval-augmented generation. Builds on 42 of its 55 references that are in the map. First posted on arXiv 20 Jun 2024.

Builds on

42 of 55 references.

Closest ancestors · 1

Same direction, newest first

  1. 2023Self-RAG: Learning to Retrieve, Generate, and Critique through Self-Reflection17 Oct

Other references · 41

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2020Language Models are Few-Shot Learnerscited by 32,199
  3. 2023GPT-4 Technical Reportcited by 18,132
  4. 2022Training language models to follow instructions with human feedbackcited by 15,712
  5. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  6. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
  7. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
  8. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
  9. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
  10. 2021Evaluating Large Language Models Trained on Codecited by 8,053
  11. 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,874
  12. 2022Large Language Models are Zero-Shot Reasonerscited by 4,323
29 more
  1. 2016SQuAD: 100,000+ Questions for Machine Comprehension of Textcited by 4,115
  2. 2020Dense Passage Retrieval for Open-Domain Question Answeringcited by 3,779
  3. 2018HotpotQA: A Dataset for Diverse, Explainable Multi-hop Question Answeringcited by 3,686
  4. 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,383
  5. 2017Billion-scale similarity search with GPUscited by 2,477
  6. 2020REALM: Retrieval-Augmented Language Model Pre-Trainingcited by 2,126
  7. 2024Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phonecited by 1,883
  8. 2016MS MARCO: A Human Generated MAchine Reading COmprehension Datasetcited by 1,591
  9. 2021Improving language models by retrieving from trillions of tokenscited by 1,278
  10. 2020Constructing A Multi-hop QA Dataset for Comprehensive Evaluation of Reasoning Stepscited by 1,259
  11. 2021BEIR: A Heterogenous Benchmark for Zero-shot Evaluation of Information Retrieval Modelscited by 1,225
  12. 2022Text Embeddings by Weakly-Supervised Contrastive Pre-trainingcited by 1,216
  13. 2020Leveraging Passage Retrieval with Generative Models for Open Domain Question Answeringcited by 1,203
  14. 2021Unsupervised Dense Information Retrieval with Contrastive Learningcited by 1,203
  15. 2022Atlas: Few-shot Learning with Retrieval Augmented Language Modelscited by 940
  16. 2023Graph of Thoughts: Solving Elaborate Problems with Large Language Modelscited by 873
  17. 2020Approximate Nearest Neighbor Negative Contrastive Learning for Dense Text Retrievalcited by 846
  18. 2017Reading Wikipedia to Answer Open-Domain Questionscited by 777
  19. 2023Textbooks Are All You Need II: phi-1.5 technical reportcited by 559
  20. 2024RAPTOR: Recursive Abstractive Processing for Tree-Organized Retrievalcited by 519
  21. 2022Precise Zero-Shot Dense Retrieval without Relevance Labelscited by 508
  22. 2023Larger language models do in-context learning differentlycited by 386
  23. 2022Large Language Models are Better Reasoners with Self-Verificationcited by 304
  24. 2023Can We Edit Factual Knowledge by In-Context Learning?cited by 284
  25. 2022Prompting GPT-3 To Be Reliablecited by 258
  26. 2022Towards Understanding Chain-of-Thought Prompting: An Empirical Study of What Matterscited by 221
  27. 2017Constructing Datasets for Multi-hop Reading Comprehension Across Documentscited by 190
  28. 2024Chain-of-Table: Evolving Tables in the Reasoning Chain for Table Understandingcited by 185
  29. 2023Asking Clarification Questions to Handle Ambiguity in Open-Domain QAcited by 24

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 2; 2026: 1.

3 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2022Improving the Domain Adaptation of Retrieval Augmented Generation (RAG) Models for Open Domain Question Answering
  2. 2025Multiple Abstraction Level Retrieve Augment Generation
  3. 2025QuIM-RAG: Advancing Retrieval-Augmented Generation with Inverted Question Matching for Enhanced QA Performance
  4. 2024RE-RAG: Improving Open-Domain QA Performance and Interpretability with Relevance Estimator in Retrieval-Augmented Generation
  5. 2025Q-RAG: Long Context Multi-step Retrieval via Value-based Embedder Training
  6. 2024RAG-QA Arena: Evaluating Domain Robustness for Long-form Retrieval Augmented Question Answering
  7. 2024W-RAG: Weakly Supervised Dense Retrieval in RAG for Open-domain Question Answering
  8. 2023Modeling Uncertainty and Using Post-fusion as Fallback Improves Retrieval Augmented Generation with LLMs