Correct after Answer: Enhancing Multi-Span Question Answering with Post-Processing Method
Not on the map. Why?
Abstract (arXiv)
Multi-Span Question Answering (MSQA) requires models to extract one or multiple answer spans from a given context to answer a question. Prior work mainly focuses on designing specific methods or applying heuristic strategies to encourage models to predict more correct predictions. However, these models are trained on gold answers and fail to consider the incorrect predictions. Through a statistical analysis, we observe that models with stronger abilities do not predict less incorrect predictions compared with other models. In this work, we propose Answering-Classifying-Correcting (ACC) framework, which employs a post-processing strategy to handle incorrect predictions. Specifically, the ACC framework first introduces a classifier to classify the predictions into three types and exclude "wrong predictions", then introduces a corrector to modify "partially correct predictions". Experiments on several MSQA datasets show that ACC framework significantly improves the Exact Match (EM) scores, and further analysis demostrates that ACC framework efficiently reduces the number of incorrect predictions, improving the quality of predictions.
Key facts. No citing papers in the map yet (data through 13 Oct 2026). Builds on 23 of its 40 references that are in the map. First posted on arXiv 22 Oct 2024.
Builds on
23 of 40 references.
References · 23
- 2017Attention Is All You Needcited by 60,106
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,304
- 2020Language Models are Few-Shot Learnerscited by 32,320
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,549
- 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,884
- 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,657
- 2019BERTScore: Evaluating Text Generation with BERTcited by 5,480
- 2022Large Language Models are Zero-Shot Reasonerscited by 4,348
- 2020Learning to summarize from human feedbackcited by 2,575
- 2018Know What You Don't Know: Unanswerable Questions for SQuADcited by 1,546
- 2015Pointer Networkscited by 884
- 2017RACE: Large-scale ReAding Comprehension Dataset From Examinationscited by 854
11 more
- 2020GeDi: Generative Discriminator Guided Sequence Generationcited by 378
- 2021FUDGE: Controlled Text Generation With Future Discriminatorscited by 375
- 2016Bidirectional Attention Flow for Machine Comprehensioncited by 278
- 2018QANet: Combining Local Convolution with Global Self-Attention for Reading Comprehensioncited by 164
- 2019A Multi-Type Multi-Span Network for Reading Comprehension that Requires Discrete Reasoningcited by 41
- 2023GRACE: Discriminator-Guided Chain-of-Thought Reasoningcited by 35
- 2020DUMA: Reading Comprehension with Transposition Thinkingcited by 8
- 2020Multi-span Style Extraction for Generative Reading Comprehensioncited by 7
- 2023How Many Answers Should I Give? An Empirical Study of Multi-Answer Reading Comprehensioncited by 5
- 2023GTA: Gated Toxicity Avoidance for LM Performance Preservationcited by 3
- 2020Answer Span Correction in Machine Reading Comprehensioncited by 2
Built on by
Not cited yet.