mlsanityData to 7 Oct 2026

UKP-SQUARE: An Online Platform for Question Answering Research

arXiv 2203.13693 ↗First posted 25 Mar 2022cs.CL cs.IRcited by 6

Not on the map. Why?

Abstract (arXiv)

Recent advances in NLP and information retrieval have given rise to a diverse set of question answering tasks that are of different formats (e.g., extractive, abstractive), require different model architectures (e.g., generative, discriminative), and setups (e.g., with or without retrieval). Despite having a large number of powerful, specialized QA pipelines (which we refer to as Skills) that consider a single domain, model or setup, there exists no framework where users can easily explore and compare such pipelines and can extend them according to their needs. To address this issue, we present UKP-SQUARE, an extensible online QA platform for researchers which allows users to query and analyze a large collection of modern Skills via a user-friendly web interface and integrated behavioural tests. In addition, QA researchers can develop, manage, and share their custom Skills using our microservices that support a wide range of models (Transformers, Adapters, ONNX), datastores and retrieval techniques (e.g., sparse and dense). UKP-SQUARE is available on https://square.ukp-lab.de.

Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Builds on 34 of its 48 references that are in the map. First posted on arXiv 25 Mar 2022.

Builds on

34 of 48 references.

References · 34

  1. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
  2. 2019Parameter-Efficient Transfer Learning for NLPcited by 4,195
  3. 2016SQuAD: 100,000+ Questions for Machine Comprehension of Textcited by 4,115
  4. 2020Dense Passage Retrieval for Open-Domain Question Answeringcited by 3,779
  5. 2018HotpotQA: A Dataset for Diverse, Explainable Multi-hop Question Answeringcited by 3,686
  6. 2017TriviaQA: A Large Scale Distantly Supervised Challenge Dataset for Reading Comprehensioncited by 2,895
  7. 2017Billion-scale similarity search with GPUscited by 2,477
  8. 2019BoolQ: Exploring the Surprising Difficulty of Natural Yes/No Questionscited by 2,140
  9. 2018CommonsenseQA: A Question Answering Challenge Targeting Commonsense Knowledgecited by 1,793
  10. 2016MS MARCO: A Human Generated MAchine Reading COmprehension Datasetcited by 1,591
  11. 2018Know What You Don't Know: Unanswerable Questions for SQuADcited by 1,538
  12. 2020Beyond Accuracy: Behavioral Testing of NLP models with CheckListcited by 979
22 more
  1. 2019DROP: A Reading Comprehension Benchmark Requiring Discrete Reasoning Over Paragraphscited by 883
  2. 2017RACE: Large-scale ReAding Comprehension Dataset From Examinationscited by 851
  3. 2020Approximate Nearest Neighbor Negative Contrastive Learning for Dense Text Retrievalcited by 846
  4. 2017Reading Wikipedia to Answer Open-Domain Questionscited by 777
  5. 2017The NarrativeQA Reading Comprehension Challengecited by 590
  6. 2020UnifiedQA: Crossing Format Boundaries With a Single QA Systemcited by 475
  7. 2020AdapterHub: A Framework for Adapting Transformerscited by 441
  8. 2021QA-GNN: Reasoning with Language Models and Knowledge Graphs for Question Answeringcited by 386
  9. 2016NewsQA: A Machine Comprehension Datasetcited by 330
  10. 2019Cosmos QA: Machine Reading Comprehension with Contextual Commonsense Reasoningcited by 281
  11. 2021Efficiently Teaching an Effective Dense Retriever with Balanced Topic Aware Samplingcited by 238
  12. 2015Visualizing and Understanding Neural Models in NLPcited by 199
  13. 2021Post-hoc Interpretability for Neural NLP: A Surveycited by 155
  14. 2019Quoref: A Reading Comprehension Dataset with Questions Requiring Coreferential Reasoningcited by 100
  15. 2021QA Dataset Explosion: A Taxonomy of NLP Resources for Question Answering and Reading Comprehensioncited by 91
  16. 2019QuaRTz: An Open-Domain Dataset of Qualitative Relationship Questionscited by 89
  17. 2018DuoRC: Towards Complex Language Understanding with Paraphrased Reading Comprehensioncited by 70
  18. 2021Structural Adapters in Pretrained Language Models for AMR-to-text Generationcited by 48
  19. 2021TWEAC: Transformer with Extendable QA Agent Classifierscited by 37
  20. 2021MetaQA: Combining Expert Agents for Multi-Skill Question Answeringcited by 15
  21. 2021Overview of BioASQ 2020: The eighth BioASQ challenge on Large-Scale Biomedical Semantic Indexing and Question Answeringcited by 13
  22. 2020NeuralQA: A Usable Library for Question Answering (Contextual Query Expansion + BERT) on Large Datasetscited by 3

Built on by

Cited by year

Citing papers per year: 2022: 1; 2023: 3; 2024: 2.

6 papers.

  1. 2023CARE: Collaborative AI-Assisted Reading Environmentcited by 7
  2. 2024Survey of Natural Language Processing for Education: Taxonomy, Systematic Review, and Future Trendscited by 3
  3. 2024Measuring Retrieval Complexity in Question Answering Systemscited by 3
  4. 2022UKP-SQuARE v2: Explainability and Adversarial Attacks for Trustworthy QAcited by 2
  5. 2023UKP-SQuARE v3: A Platform for Multi-Agent QA Researchcited by 1
  6. 2023UKP-SQuARE: An Interactive Tool for Teaching Question Answeringcited by 0