mlsanityData to 7 Oct 2026

UnifiedQA-v2: Stronger Generalization via Broader Cross-Format Training

arXiv 2202.12359 ↗First posted 23 Feb 2022cs.CL cs.AIcited by 57

Not on the map. Why?

Abstract (arXiv)

We present UnifiedQA-v2, a QA model built with the same process as UnifiedQA, except that it utilizes more supervision -- roughly 3x the number of datasets used for UnifiedQA. This generally leads to better in-domain and cross-domain results.

Key facts. Cited by 57 papers in the map (data through 7 Oct 2026). Builds on 54 of its 67 references that are in the map. First posted on arXiv 23 Feb 2022.

Builds on

54 of 67 references.

References · 54

  1. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  2. 2020Measuring Massive Multitask Language Understandingcited by 7,768
  3. 2018Think you have Solved Question Answering? Try ARC, the AI2 Reasoning Challengecited by 4,710
  4. 2016SQuAD: 100,000+ Questions for Machine Comprehension of Textcited by 4,115
  5. 2019BoolQ: Exploring the Surprising Difficulty of Natural Yes/No Questionscited by 2,140
  6. 2018Can a Suit of Armor Conduct Electricity? A New Dataset for Open Book Question Answeringcited by 2,114
  7. 2018CommonsenseQA: A Question Answering Challenge Targeting Commonsense Knowledgecited by 1,793
  8. 2018Know What You Don't Know: Unanswerable Questions for SQuADcited by 1,538
  9. 2019PubMedQA: A Dataset for Biomedical Research Question Answeringcited by 1,271
  10. 2021Scaling Language Models: Methods, Analysis & Insights from Training Gophercited by 1,199
  11. 2019DROP: A Reading Comprehension Benchmark Requiring Discrete Reasoning Over Paragraphscited by 883
  12. 2017RACE: Large-scale ReAding Comprehension Dataset From Examinationscited by 851
38 more
  1. 2021Did Aristotle Use a Laptop? A Question Answering Benchmark with Implicit Reasoning Strategiescited by 736
  2. 2021Cross-Task Generalization via Natural Language Crowdsourcing Instructionscited by 696
  3. 2017The NarrativeQA Reading Comprehension Challengecited by 590
  4. 2020UnifiedQA: Crossing Format Boundaries With a Single QA Systemcited by 475
  5. 2021A Dataset of Information-Seeking Questions and Answers Anchored in Research Paperscited by 475
  6. 2016NewsQA: A Machine Comprehension Datasetcited by 330
  7. 2020LUKE: Deep Contextualized Entity Representations with Entity-aware Self-attentioncited by 326
  8. 2019Cosmos QA: Machine Reading Comprehension with Contextual Commonsense Reasoningcited by 281
  9. 2019Measuring Compositional Generalization: A Comprehensive Method on Realistic Datacited by 280
  10. 2021ERNIE 3.0: Large-scale Knowledge Enhanced Pre-training for Language Understanding and Generationcited by 258
  11. 2019QASC: A Dataset for Question Answering via Sentence Compositioncited by 248
  12. 2020ReClor: A Reading Comprehension Dataset Requiring Logical Reasoningcited by 211
  13. 2018ReCoRD: Bridging the Gap between Human and Machine Commonsense Reading Comprehensioncited by 198
  14. 2019WinoGrande: An Adversarial Winograd Schema Challenge at Scalecited by 194
  15. 2021Muppet: Massive Multi-task Representations with Pre-Finetuningcited by 192
  16. 2020Beyond I.I.D.: Three Levels of Generalization for Question Answering on Knowledge Basescited by 169
  17. 2021Meta-learning via Language Model In-context Tuningcited by 163
  18. 2021ExT5: Towards Extreme Multi-Task Scaling for Transfer Learningcited by 161
  19. 2019DREAM: A Challenge Dataset and Models for Dialogue-Based Reading Comprehensioncited by 156
  20. 2020Beat the AI: Investigating Adversarial Human Annotation for Reading Comprehensioncited by 131
  21. 2021Adapting Language Models for Zero-shot Learning by Meta-tuning on Dataset and Prompt Collectionscited by 128
  22. 2019HEAD-QA: A Healthcare Dataset for Complex Reasoningcited by 100
  23. 2019Quoref: A Reading Comprehension Dataset with Questions Requiring Coreferential Reasoningcited by 100
  24. 2021UNICORN on RAINBOW: A Universal Commonsense Reasoning Model on a New Multitask Benchmarkcited by 98
  25. 2020Retrospective Reader for Machine Reading Comprehensioncited by 86
  26. 2019Reasoning Over Paragraph Effects in Situationscited by 79
  27. 2021FLEX: Unifying Evaluation for Few-Shot NLPcited by 67
  28. 2019TWEETQA: A Social Media Focused Question Answering Datasetcited by 55
  29. 2021GooAQ: Open Question Answering with Diverse Answer Typescited by 53
  30. 2021PROST: Physical Reasoning of Objects through Space and Timecited by 48
  31. 2021Towards General Purpose Vision Systemscited by 46
  32. 2021General-Purpose Question-Answering with Macawcited by 40
  33. 2018MCScript: A Novel Dataset for Assessing Machine Comprehension Using Script Knowledgecited by 30
  34. 2022Unobserved Local Structures Make Compositional Generalization Hardcited by 29
  35. 2019MCScript2.0: A Machine Comprehension Corpus Focused on Script Events and Participantscited by 20
  36. 2020STARC: Structured Annotations for Reading Comprehensioncited by 17
  37. 2021QAConv: Question Answering on Informative Conversationscited by 17
  38. 2019Improving Question Answering with External Knowledgecited by 16

50 most cited of 54 All 54 (JSON)

Built on by

Cited by year

Citing papers per year: 2022: 13; 2023: 28; 2024: 12; 2025: 4.

57 papers.

Sort:

By area:

  1. 2022UL2: Unifying Language Learning Paradigmscited by 292
  2. 2022Large Language Models with Controllable Working Memorycited by 169
  3. 2024Large Language Models(LLMs) on Tabular Data: Prediction, Generation, and Understanding -- A Surveycited by 157
  4. 2022Rethinking with Retrieval: Faithful Large Language Model Inferencecited by 145
  5. 2023ESC: Exploration with Soft Commonsense Constraints for Zero-shot Object Navigationcited by 126
  6. 2022Plug-and-Play VQA: Zero-shot VQA by Conjoining Large Pretrained Models with Zero Trainingcited by 88
  7. 2023Dense X Retrieval: What Retrieval Granularity Should We Use?cited by 88
  8. 2022Forecasting Future World Events with Neural Networkscited by 63
  9. 2023Large Language Models are Visual Reasoning Coordinatorscited by 58
  10. 2023CONFORM: Contrast is All You Need For High-Fidelity Text-to-Image Diffusion Modelscited by 54
  11. 2023Vera: A General-Purpose Plausibility Estimation Model for Commonsense Statementscited by 44
  12. 2022Rainier: Reinforced Knowledge Introspector for Commonsense Question Answeringcited by 43
38 more
  1. 2022CONDAQA: A Contrastive Reading Comprehension Dataset for Reasoning about Negationcited by 38
  2. 2023Are Machine Rationales (Not) Useful to Humans? Measuring and Improving Human Utility of Free-Text Rationalescited by 37
  3. 2023Peek Across: Improving Multi-Document Modeling via Cross-Document Question-Answeringcited by 28
  4. 2023Zero-shot Faithful Factual Error Correctioncited by 26
  5. 2022Visconde: Multi-document QA with GPT-3 and Neural Rerankingcited by 23
  6. 2023Multitask Instruction-based Prompting for Fallacy Recognitioncited by 22
  7. 2023AutoCast++: Enhancing World Event Prediction with Zero-shot Ranking-based Context Retrievalcited by 18
  8. 2022RQUGE: Reference-Free Metric for Evaluating Question Generation by Answering the Questioncited by 17
  9. 2023Generate then Select: Open-ended Visual Question Answering Guided by World Knowledgecited by 16
  10. 2023A Study of Situational Reasoning for Traffic Understandingcited by 13
  11. 2024AnaloBench: Benchmarking the Identification of Abstract and Long-context Analogiescited by 13
  12. 2024Visual Robustness Benchmark for Visual Question Answering (VQA)cited by 12
  13. 2023Zero-shot Visual Question Answering with Language Model Feedbackcited by 11
  14. 2024Complex Reasoning over Logical Queries on Commonsense Knowledge Graphscited by 8
  15. 2023Long-Tailed Question Answering in an Open Worldcited by 7
  16. 2024Paraphrasing in Affirmative Terms Improves Negation Understandingcited by 7
  17. 2023Evaluating the Rationale Understanding of Critical Reasoning in Logical Reading Comprehensioncited by 6
  18. 2024Document-level Claim Extraction and Decontextualisation for Fact-Checkingcited by 6
  19. 2024A Survey of Event Causality Identification: Taxonomy, Challenges, Assessment, and Prospectscited by 6
  20. 2023How Many Answers Should I Give? An Empirical Study of Multi-Answer Reading Comprehensioncited by 5
  21. 2023MPrompt: Exploring Multi-level Prompt Tuning for Machine Reading Comprehensioncited by 5
  22. 2023Causal Question Answering with Reinforcement Learningcited by 5
  23. 2024ProMotion: Prototypes As Motion Learnerscited by 5
  24. 2022Detect, Retrieve, Comprehend: A Flexible Framework for Zero-Shot Document-Level Question Answeringcited by 4
  25. 2023PromptRE: Weakly-Supervised Document-Level Relation Extraction via Prompting-Based Data Programmingcited by 4
  26. 2024Promptly Predicting Structures: The Return of Inferencecited by 4
  27. 2025Robust 3D-Masked Part-level Editing in 3D Gaussian Splatting with Regularized Score Distillation Samplingcited by 4
  28. 2022Improving Cross-task Generalization of Unified Table-to-text Models with Compositional Task Configurationscited by 3
  29. 2023AutoConv: Automatically Generating Information-seeking Conversations with Large Language Modelscited by 3
  30. 2025Making Language Models Robust Against Negationcited by 3
  31. 2022Utilizing Background Knowledge for Robust Reasoning over Traffic Situationscited by 2
  32. 2022When Do Decompositions Help for Machine Reading?cited by 2
  33. 2023Meta-training with Demonstration Retrieval for Efficient Few-shot Learningcited by 2
  34. 2023CommonsenseVIS: Visualizing and Understanding Commonsense Reasoning Capabilities of Natural Language Modelscited by 2
  35. 2023Teaching Smaller Language Models To Generalise To Unseen Compositional Questionscited by 2
  36. 2024From Text to Insight: Leveraging Large Language Models for Performance Evaluation in Managementcited by 2
  37. 2024Increasing the Difficulty of Automatically Generated Questions via Reinforcement Learning with Synthetic Preferencecited by 2
  38. 2025Chronological Passage Assembling in RAG framework for Temporal Question Answeringcited by 2

50 most cited of 57 All 57 (JSON)