mlsanityData to 7 Oct 2026

SCAI-QReCC Shared Task on Conversational Question Answering

arXiv 2201.11094 ↗First posted 26 Jan 2022cs.IR cs.CLcited by 4

Not on the map. Why?

Abstract (arXiv)

Search-Oriented Conversational AI (SCAI) is an established venue that regularly puts a spotlight upon the recent work advancing the field of conversational search. SCAI'21 was organised as an independent on-line event and featured a shared task on conversational question answering. Since all of the participant teams experimented with answer generation models for this task, we identified evaluation of answer correctness in this settings as the major challenge and a current research gap. Alongside the automatic evaluation, we conducted two crowdsourcing experiments to collect annotations for answer plausibility and faithfulness. As a result of this shared task, the original conversational QA dataset used for evaluation was further extended with alternative correct answers produced by the participant systems.

Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 18 of its 31 references that are in the map. First posted on arXiv 26 Jan 2022.

Builds on

18 of 31 references.

References · 18

  1. 2020Language Models are Few-Shot Learnerscited by 32,199
  2. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  3. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
  4. 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,874
  5. 2019BERTScore: Evaluating Text Generation with BERTcited by 5,462
  6. 2019PEGASUS: Pre-training with Extracted Gap-sentences for Abstractive Summarizationcited by 1,100
  7. 2020Sparse, Dense, and Attentional Representations for Text Retrievalcited by 213
  8. 2021Hurdles to Progress in Long-form Question Answeringcited by 166
  9. 2020Open-Domain Question Answering Goes Conversational via Question Rewritingcited by 147
  10. 2020Question Rewriting for Conversational Question Answeringcited by 93
  11. 2020Few-Shot Generative Conversational Query Rewritingcited by 85
  12. 2021Semantic Answer Similarity for Evaluating Question Answering Modelscited by 47
6 more
  1. 2021Learn to Resolve Conversational Dependency: A Consistency Training Framework for Conversational Question Answeringcited by 27
  2. 2021Ditch the Gold Standard: Re-evaluating Conversational Question Answeringcited by 19
  3. 2022Question rewriting? Assessing its importance for conversational question answeringcited by 15
  4. 2020A Wrong Answer or a Wrong Question? An Intricate Relationship between Question Reformulation and Answer Selection in Conversational Question Answeringcited by 7
  5. 2021OpenMatch: An Open Source Library for Neu-IR Researchcited by 6
  6. 2021POSSCORE: A Simple Yet Effective Evaluation of Conversational Search with Part of Speech Labellingcited by 2

Built on by

Cited by year

Citing papers per year: 2022: 2; 2023: 0; 2024: 0; 2025: 2.

4 papers.