mlsanityData to 7 Oct 2026

RACE: Large-scale ReAding Comprehension Dataset From Examinations

arXiv 1704.04683 ↗First posted 15 Apr 2017cs.CL cs.AI cs.LGcited by 851

Not on the map. Why?

Cited by 65 in LLM reasoning, but placed by its own abstract, which didn’t fit.

Abstract (arXiv)

We present RACE, a new dataset for benchmark evaluation of methods in the reading comprehension task. Collected from the English exams for middle and high school Chinese students in the age range between 12 to 18, RACE consists of near 28,000 passages and near 100,000 questions generated by human experts (English instructors), and covers a variety of topics which are carefully designed for evaluating the students' ability in understanding and reasoning. In particular, the proportion of questions that requires reasoning is much larger in RACE than that in other benchmark datasets for reading comprehension, and there is a significant gap between the performance of the state-of-the-art models (43%) and the ceiling human performance (95%). We hope this new dataset can serve as a valuable resource for research and evaluation in machine comprehension. The dataset is freely available at http://www.cs.cmu.edu/~glai1/data/race/ and the code is available at https://github.com/qizhex/RACE_AR_baselines.

Key facts. Cited by 851 papers in the map (data through 7 Oct 2026). First posted on arXiv 15 Apr 2017.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 114; 2022: 104; 2023: 127; 2024: 184; 2025: 178; 2026: 144.

851 papers.

Sort:

By area:

  1. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
  2. 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,304
  3. 2021The Power of Scale for Parameter-Efficient Prompt Tuningcited by 3,769
  4. 2022Training Compute-Optimal Large Language Modelscited by 2,927
  5. 2021Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processingcited by 2,222
  6. 2025InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Modelscited by 1,769
  7. 2024Expanding Performance Boundaries of Open-Source Multimodal Models with Model, Data, and Test-Time Scalingcited by 1,573
  8. 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiencycited by 1,419
  9. 2021DeBERTaV3: Improving DeBERTa using ELECTRA-Style Pre-Training with Gradient-Disentangled Embedding Sharingcited by 1,219
  10. 2023PaLM 2 Technical Reportcited by 1,154
  11. 2024DeepSeek-V2: A Strong, Economical, and Efficient Mixture-of-Experts Language Modelcited by 1,093
  12. 2022Editing Models with Task Arithmeticcited by 1,076
38 more
  1. 2022Atlas: Few-shot Learning with Retrieval Augmented Language Modelscited by 940
  2. 2023BloombergGPT: A Large Language Model for Financecited by 923
  3. 2021GLaM: Efficient Scaling of Language Models with Mixture-of-Expertscited by 890
  4. 2024DeepSeekMoE: Towards Ultimate Expert Specialization in Mixture-of-Experts Language Modelscited by 834
  5. 2022Discovering Language Model Behaviors with Model-Written Evaluationscited by 805
  6. 2023SelfCheckGPT: Zero-Resource Black-Box Hallucination Detection for Generative Large Language Modelscited by 787
  7. 2021BBQ: A Hand-Built Bias Benchmark for Question Answeringcited by 683
  8. 2023A Comprehensive Overview of Large Language Modelscited by 639
  9. 2023An Empirical Study of Catastrophic Forgetting in Large Language Models During Continual Fine-tuningcited by 622
  10. 2024DeepSeek LLM: Scaling Open-Source Language Models with Longtermismcited by 621
  11. 2022Using DeepSpeed and Megatron to Train Megatron-Turing NLG 530B, A Large-Scale Generative Language Modelcited by 557
  12. 2022MedMCQA : A Large-scale Multi-Subject Multi-Choice Dataset for Medical domain Question Answeringcited by 525
  13. 2022ZeroQuant: Efficient and Affordable Post-Training Quantization for Large-Scale Transformerscited by 517
  14. 2025Dream 7B: Diffusion Large Language Modelscited by 515
  15. 2024Large Language Models: A Surveycited by 506
  16. 2021MetaICL: Learning to Learn In Contextcited by 450
  17. 2023Symbolic Discovery of Optimization Algorithmscited by 423
  18. 2022DeepSpeed-MoE: Advancing Mixture-of-Experts Inference and Training to Power Next-Generation AI Scalecited by 400
  19. 2023UltraFeedback: Boosting Language Models with Scaled AI Feedbackcited by 394
  20. 2022Self-critiquing models for assisting human evaluatorscited by 372
  21. 2024ShortGPT: Layers in Large Language Models are More Redundant Than You Expectcited by 369
  22. 2023Efficient and Effective Text Encoding for Chinese LLaMA and Alpacacited by 302
  23. 2024LayerSkip: Enabling Early Exit Inference and Self-Speculative Decodingcited by 302
  24. 2023The Belebele Benchmark: a Parallel Reading Comprehension Dataset in 122 Language Variantscited by 300
  25. 2022UL2: Unifying Language Learning Paradigmscited by 292
  26. 2023AlignScore: Evaluating Factual Consistency with a Unified Alignment Functioncited by 284
  27. 2021Surface Form Competition: Why the Highest Probability Answer Isn't Always Rightcited by 256
  28. 2022RealTime QA: What's the Answer Right Now?cited by 239
  29. 2024Enhancing the Reasoning Ability of Multimodal Large Language Models via Mixed Preference Optimizationcited by 238
  30. 2021SPoT: Better Frozen Model Adaptation through Soft Prompt Transfercited by 235
  31. 2021PPT: Pre-trained Prompt Tuning for Few-shot Learningcited by 232
  32. 2024Continual Learning of Large Language Models: A Comprehensive Surveycited by 228
  33. 2024MobileLLM: Optimizing Sub-billion Parameter Language Models for On-Device Use Casescited by 216
  34. 2021QuALITY: Question Answering with Long Input Texts, Yes!cited by 204
  35. 2022Leveraging Large Language Models for Multiple Choice Question Answeringcited by 199
  36. 2024Scaling up Masked Diffusion Models on Textcited by 195
  37. 2023Don't Make Your LLM an Evaluation Benchmark Cheatercited by 194
  38. 2021Muppet: Massive Multi-task Representations with Pre-Finetuningcited by 192

50 most cited of 851 All 851 (JSON)