mlsanityData to 14 Oct 2026

Generative Long-form Question Answering: Relevance, Faithfulness and Succinctness

arXiv 2211.08386 ↗First posted 15 Nov 2022cs.CL cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

In this thesis, we investigated the relevance, faithfulness, and succinctness aspects of Long Form Question Answering (LFQA). LFQA aims to generate an in-depth, paragraph-length answer for a given question, to help bridge the gap between real scenarios and the existing open-domain QA models which can only extract short-span answers. LFQA is quite challenging and under-explored. Few works have been done to build an effective LFQA system. It is even more challenging to generate a good-quality long-form answer relevant to the query and faithful to facts, since a considerable amount of redundant, complementary, or contradictory information will be contained in the retrieved documents. Moreover, no prior work has been investigated to generate succinct answers. We are among the first to research the LFQA task. We pioneered the research direction to improve the answer quality in terms of 1) query-relevance, 2) answer faithfulness, and 3) answer succinctness.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 45 of its 142 references that are in the map. First posted on arXiv 15 Nov 2022.

Builds on

45 of 142 references.

References · 45

  1. 2020Language Models are Few-Shot Learnerscited by 32,419
  2. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
  3. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
  4. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
  5. 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,893
  6. 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,708
  7. 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,326
  8. 2016SQuAD: 100,000+ Questions for Machine Comprehension of Textcited by 4,148
  9. 2021TruthfulQA: Measuring How Models Mimic Human Falsehoodscited by 2,975
  10. 2017TriviaQA: A Large Scale Distantly Supervised Challenge Dataset for Reading Comprehensioncited by 2,955
  11. 2019XLNet: Generalized Autoregressive Pretraining for Language Understandingcited by 2,811
  12. 2019ALBERT: A Lite BERT for Self-supervised Learning of Language Representationscited by 2,790
33 more
  1. 2021Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processingcited by 2,234
  2. 2020REALM: Retrieval-Augmented Language Model Pre-Trainingcited by 2,141
  3. 2022Survey of Hallucination in Natural Language Generationcited by 2,075
  4. 2019Language Models as Knowledge Bases?cited by 1,936
  5. 2021WebGPT: Browser-assisted question-answering with human feedbackcited by 1,745
  6. 2018Don't Give Me the Details, Just the Summary! Topic-Aware Convolutional Neural Networks for Extreme Summarizationcited by 1,317
  7. 2021Scaling Language Models: Methods, Analysis & Insights from Training Gophercited by 1,202
  8. 2021Retrieval Augmentation Reduces Hallucination in Conversationcited by 692
  9. 2022Using DeepSpeed and Megatron to Train Megatron-Turing NLG 530B, A Large-Scale Generative Language Modelcited by 559
  10. 2019Text Summarization with Pretrained Encoderscited by 556
  11. 2015Compositional Semantic Parsing on Semi-Structured Tablescited by 515
  12. 2017A Deep Reinforced Model for Abstractive Summarizationcited by 365
  13. 2016NewsQA: A Machine Comprehension Datasetcited by 331
  14. 2017SearchQA: A New Q&A Dataset Augmented with Context from a Search Enginecited by 225
  15. 2021PAQ: 65 Million Probably-Asked Questions and What You Can Do With Themcited by 200
  16. 2018Bottom-Up Abstractive Summarizationcited by 177
  17. 2019End-to-End Open-Domain Question Answering with BERTserinicited by 152
  18. 2022Internet-augmented language models through few-shot prompting for open-domain question answeringcited by 131
  19. 2020CrossNER: Evaluating Cross-Domain Named Entity Recognitioncited by 104
  20. 2021AdaptSum: Towards Low-Resource Domain Adaptation for Abstractive Summarizationcited by 51
  21. 2017Diversity driven Attention Model for Query-based Abstractive Summarizationcited by 42
  22. 2018Query Focused Abstractive Summarization: Incorporating Query Relevance, Multi-Document Coverage, and Summary Length Constraints into seq2seq Modelscited by 39
  23. 2020Question-Driven Summarization of Answers to Consumer Health Questionscited by 39
  24. 2020Generating Query Focused Summaries from Query-Free Resourcescited by 27
  25. 2019Technical report on Conversational Question Answeringcited by 19
  26. 2021Rethinking Search: Making Domain Experts out of Dilettantescited by 18
  27. 2020Rapidly Bootstrapping a Question Answering Dataset for COVID-19cited by 14
  28. 2017A Pilot Study of Domain Adaptation Effect for Neural Abstractive Summarizationcited by 12
  29. 2020Studying Strategically: Learning to Mask for Closed-book QAcited by 10
  30. 2022Context Generation Improves Open Domain Question Answeringcited by 7
  31. 2020Conditional Self-Attention for Query-based Summarizationcited by 6
  32. 2020Query Focused Multi-Document Summarization with Distant Supervisioncited by 6
  33. 2021A Hybrid Task-Oriented Dialog System with Domain and Task Adaptive Pretrainingcited by 3

Built on by

Not cited yet.