SCAI-QReCC Shared Task on Conversational Question Answering
Not on the map. Why?
Abstract (arXiv)
Search-Oriented Conversational AI (SCAI) is an established venue that regularly puts a spotlight upon the recent work advancing the field of conversational search. SCAI'21 was organised as an independent on-line event and featured a shared task on conversational question answering. Since all of the participant teams experimented with answer generation models for this task, we identified evaluation of answer correctness in this settings as the major challenge and a current research gap. Alongside the automatic evaluation, we conducted two crowdsourcing experiments to collect annotations for answer plausibility and faithfulness. As a result of this shared task, the original conversational QA dataset used for evaluation was further extended with alternative correct answers produced by the participant systems.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 18 of its 31 references that are in the map. First posted on arXiv 26 Jan 2022.
Builds on
18 of 31 references.
References · 18
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
- 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,874
- 2019BERTScore: Evaluating Text Generation with BERTcited by 5,462
- 2019PEGASUS: Pre-training with Extracted Gap-sentences for Abstractive Summarizationcited by 1,100
- 2020Sparse, Dense, and Attentional Representations for Text Retrievalcited by 213
- 2021Hurdles to Progress in Long-form Question Answeringcited by 166
- 2020Open-Domain Question Answering Goes Conversational via Question Rewritingcited by 147
- 2020Question Rewriting for Conversational Question Answeringcited by 93
- 2020Few-Shot Generative Conversational Query Rewritingcited by 85
- 2021Semantic Answer Similarity for Evaluating Question Answering Modelscited by 47
6 more
- 2021Learn to Resolve Conversational Dependency: A Consistency Training Framework for Conversational Question Answeringcited by 27
- 2021Ditch the Gold Standard: Re-evaluating Conversational Question Answeringcited by 19
- 2022Question rewriting? Assessing its importance for conversational question answeringcited by 15
- 2020A Wrong Answer or a Wrong Question? An Intricate Relationship between Question Reformulation and Answer Selection in Conversational Question Answeringcited by 7
- 2021OpenMatch: An Open Source Library for Neu-IR Researchcited by 6
- 2021POSSCORE: A Simple Yet Effective Evaluation of Conversational Search with Part of Speech Labellingcited by 2
Built on by
Citing papers per year: 2022: 2; 2023: 0; 2024: 0; 2025: 2.
4 papers.
- 2022Demonstrate-Search-Predict: Composing retrieval and language models for knowledge-intensive NLPcited by 316
- 2022Saving Dense Retriever from Shortcut Dependency in Conversational Searchcited by 18
- 2025A Survey of the State-of-the-Art in Conversational Question Answering Systemscited by 1
- 2025CFDA & CLIP at TREC iKAT 2025: Enhancing Personalized Conversational Search via Query Reformulation and Rank Fusioncited by 0
- 2025CFDA & CLIP at TREC iKAT 2025: Enhancing Personalized Conversational Search via Query Reformulation and Rank Fusion19 Sep 2025
- 2025A Survey of the State-of-the-Art in Conversational Question Answering Systems6 Sep 2025
- 2022Demonstrate-Search-Predict: Composing retrieval and language models for knowledge-intensive NLP28 Dec 2022
- 2022Saving Dense Retriever from Shortcut Dependency in Conversational Search15 Feb 2022