mlsanityData to 7 Oct 2026

SF-QA: Simple and Fair Evaluation Library for Open-domain Question Answering

arXiv 2101.01910 ↗First posted 6 Jan 2021cs.CL cs.IRcited by 0

Not on the map. Why?

Abstract (arXiv)

Although open-domain question answering (QA) draws great attention in recent years, it requires large amounts of resources for building the full system and is often difficult to reproduce previous results due to complex configurations. In this paper, we introduce SF-QA: simple and fair evaluation framework for open-domain QA. SF-QA framework modularizes the pipeline open-domain QA system, which makes the task itself easily accessible and reproducible to research groups without enough computing resources. The proposed evaluation framework is publicly available and anyone can contribute to the code and evaluations.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 17 of its 22 references that are in the map. First posted on arXiv 6 Jan 2021.

Builds on

17 of 22 references.

References · 17

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  3. 2016SQuAD: 100,000+ Questions for Machine Comprehension of Textcited by 4,115
  4. 2018HotpotQA: A Dataset for Diverse, Explainable Multi-hop Question Answeringcited by 3,686
  5. 2020REALM: Retrieval-Augmented Language Model Pre-Trainingcited by 2,126
  6. 2019SpanBERT: Improving Pre-training by Representing and Predicting Spanscited by 832
  7. 2017Reading Wikipedia to Answer Open-Domain Questionscited by 777
  8. 2019Latent Retrieval for Weakly Supervised Open Domain Question Answeringcited by 691
  9. 2019End-to-End Open-Domain Question Answering with BERTserinicited by 152
  10. 2019Learning to Retrieve Reasoning Paths over Wikipedia Graph for Question Answeringcited by 147
  11. 2017Simple and Effective Multi-Paragraph Reading Comprehensioncited by 120
  12. 2019Multi-passage BERT: A Globally Normalized BERT Model for Open-domain Question Answeringcited by 96
5 more
  1. 2017Rasa: Open Source Language Understanding and Dialogue Managementcited by 67
  2. 2019Real-Time Open-Domain Question Answering with Dense-Sparse Phrase Indexcited by 64
  3. 2019Answering Complex Open-domain Questions Through Iterative Query Generationcited by 60
  4. 2020SPARTA: Efficient Open-Domain Question Answering via Sparse Transformer Matching Retrievalcited by 50
  5. 2018Ranking Paragraphs for Improving Answer Recall in Open-Domain Question Answeringcited by 24

Built on by

Not cited yet.