mlsanityData to 7 Oct 2026

Retrieving Contextual Information for Long-Form Question Answering using Weak Supervision

arXiv 2410.08623 ↗First posted 11 Oct 2024cs.CL cs.IRcited by 0

Not on the map. Why?

Abstract (arXiv)

Long-form question answering (LFQA) aims at generating in-depth answers to end-user questions, providing relevant information beyond the direct answer. However, existing retrievers are typically optimized towards information that directly targets the question, missing out on such contextual information. Furthermore, there is a lack of training data for relevant context. To this end, we propose and compare different weak supervision techniques to optimize retrieval for contextual information. Experiments demonstrate improvements on the end-to-end QA performance on ASQA, a dataset for long-form question answering. Importantly, as more contextual information is retrieved, we improve the relevant page recall for LFQA by 14.7% and the groundedness of generated long-form answers by 12.5%. Finally, we show that long-form answers often anticipate likely follow-up questions, via experiments on a conversational QA dataset.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 36 of its 45 references that are in the map. First posted on arXiv 11 Oct 2024.

Builds on

36 of 45 references.

References · 36

  1. 2017Attention Is All You Needcited by 59,932
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  3. 2020Language Models are Few-Shot Learnerscited by 32,199
  4. 2022Training language models to follow instructions with human feedbackcited by 15,712
  5. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
  6. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
  7. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,393
  8. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
  9. 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,072
  10. 2020Dense Passage Retrieval for Open-Domain Question Answeringcited by 3,779
  11. 2017TriviaQA: A Large Scale Distantly Supervised Challenge Dataset for Reading Comprehensioncited by 2,895
  12. 2020REALM: Retrieval-Augmented Language Model Pre-Trainingcited by 2,126
24 more
  1. 2021WebGPT: Browser-assisted question-answering with human feedbackcited by 1,722
  2. 2020Leveraging Passage Retrieval with Generative Models for Open Domain Question Answeringcited by 1,203
  3. 2015Teaching Machines to Read and Comprehendcited by 1,039
  4. 2019Passage Re-ranking with BERTcited by 629
  5. 2023Enabling Large Language Models to Generate Text with Citationscited by 584
  6. 2019ELI5: Long Form Question Answeringcited by 567
  7. 2021Large Dual Encoders Are Generalizable Retrieverscited by 454
  8. 2020AmbigQA: Answering Ambiguous Open-domain Questionscited by 385
  9. 2023Enhancing Retrieval-Augmented Large Language Models with Iterative Retrieval-Generation Synergycited by 343
  10. 2022ASQA: Factoid Questions Meet Long-Form Answerscited by 231
  11. 2018Open Domain Question Answering Using Early Fusion of Knowledge Bases and Textcited by 167
  12. 2021Hurdles to Progress in Long-form Question Answeringcited by 166
  13. 2020Open-Retrieval Conversational Question Answeringcited by 99
  14. 2020Question Rewriting for Conversational Question Answeringcited by 93
  15. 2021End-to-End Training of Neural Retrievers for Open-Domain Question Answeringcited by 75
  16. 2020Query Resolution for Conversational Search with Limited Supervisioncited by 52
  17. 2022Read before Generate! Faithful Long Form Question Answering with Machine Readingcited by 47
  18. 2021Joint Passage Ranking for Diverse Multi-Answer Retrievalcited by 43
  19. 2024Genie: Achieving Human Parity in Content-Grounded Datasets Generationcited by 31
  20. 2022Conversational Question Answering on Heterogeneous Sourcescited by 26
  21. 2022Query Refinement Prompts for Closed-Book Long-Form Question Answeringcited by 12
  22. 2022Modeling Exemplification in Long-form Question Answering via Retrievalcited by 7
  23. 2023Answering Ambiguous Questions with a Database of Questions, Answers, and Revisionscited by 4
  24. 2023Strong and Efficient Baselines for Open Domain Conversational Question Answeringcited by 2

Built on by

Not cited yet.