mlsanityData to 7 Oct 2026

MedMCQA : A Large-scale Multi-Subject Multi-Choice Dataset for Medical domain Question Answering

arXiv 2203.14371 ↗First posted 27 Mar 2022cs.CL cs.AI cs.LGcited by 525

Not on the map. Why?

Cited by 77 in LLM reasoning, but placed by its own abstract, which didn’t fit.

Abstract (arXiv)

This paper introduces MedMCQA, a new large-scale, Multiple-Choice Question Answering (MCQA) dataset designed to address real-world medical entrance exam questions. More than 194k high-quality AIIMS & NEET PG entrance exam MCQs covering 2.4k healthcare topics and 21 medical subjects are collected with an average token length of 12.77 and high topical diversity. Each sample contains a question, correct answer(s), and other options which requires a deeper language understanding as it tests the 10+ reasoning abilities of a model across a wide range of medical subjects & topics. A detailed explanation of the solution, along with the above information, is provided in this study.

Key facts. Cited by 525 papers in the map (data through 7 Oct 2026). Builds on 24 of its 29 references that are in the map. First posted on arXiv 27 Mar 2022.

Builds on

24 of 29 references.

References · 24

  1. 2017Attention Is All You Needcited by 59,932
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  3. 2018Think you have Solved Question Answering? Try ARC, the AI2 Reasoning Challengecited by 4,710
  4. 2016SQuAD: 100,000+ Questions for Machine Comprehension of Textcited by 4,115
  5. 2020Dense Passage Retrieval for Open-Domain Question Answeringcited by 3,779
  6. 2018HotpotQA: A Dataset for Diverse, Explainable Multi-hop Question Answeringcited by 3,686
  7. 2019BioBERT: a pre-trained biomedical language representation model for biomedical text miningcited by 1,935
  8. 2016MS MARCO: A Human Generated MAchine Reading COmprehension Datasetcited by 1,591
  9. 2018Know What You Don't Know: Unanswerable Questions for SQuADcited by 1,538
  10. 2019SciBERT: A Pretrained Language Model for Scientific Textcited by 1,404
  11. 2019PubMedQA: A Dataset for Biomedical Research Question Answeringcited by 1,271
  12. 2015Teaching Machines to Read and Comprehendcited by 1,039
12 more
  1. 2019DROP: A Reading Comprehension Benchmark Requiring Discrete Reasoning Over Paragraphscited by 883
  2. 2017RACE: Large-scale ReAding Comprehension Dataset From Examinationscited by 851
  3. 2017Reading Wikipedia to Answer Open-Domain Questionscited by 777
  4. 2018CoQA: A Conversational Question Answering Challengecited by 674
  5. 2018SWAG: A Large-Scale Adversarial Dataset for Grounded Commonsense Inferencecited by 333
  6. 2016NewsQA: A Machine Comprehension Datasetcited by 330
  7. 2019Cosmos QA: Machine Reading Comprehension with Contextual Commonsense Reasoningcited by 281
  8. 2019HEAD-QA: A Healthcare Dataset for Complex Reasoningcited by 100
  9. 2018RecipeQA: A Challenge Dataset for Multimodal Comprehension of Cooking Recipescited by 74
  10. 2018CliCR: A Dataset of Clinical Case Reports for Machine Reading Comprehensioncited by 34
  11. 2018Medical Exam Question Answering with Large-scale Reading Comprehensioncited by 29
  12. 2020Results of the seventh edition of the BioASQ Challengecited by 28

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2022: 7; 2023: 45; 2024: 121; 2025: 165; 2026: 187.

525 papers.

Sort:

By area:

  1. 2022Large Language Models Encode Clinical Knowledgecited by 1,807
  2. 2022Galactica: A Large Language Model for Sciencecited by 736
  3. 2023Baichuan 2: Open Large-scale Language Modelscited by 664
  4. 2023Capabilities of GPT-4 on Medical Challenge Problemscited by 630
  5. 2023Towards Expert-Level Medical Question Answering with Large Language Modelscited by 382
  6. 2022One Embedder, Any Task: Instruction-Finetuned Text Embeddingscited by 329
  7. 2023Can Generalist Foundation Models Outcompete Special-Purpose Tuning? Case Study in Medicinecited by 319
  8. 2023MedAgents: Large Language Models as Collaborators for Zero-shot Medical Reasoningcited by 311
  9. 2023Towards Generalist Biomedical AIcited by 286
  10. 2024HuatuoGPT-o1, Towards Medical Complex Reasoning with LLMscited by 257
  11. 2024Generative Representational Instruction Tuningcited by 227
  12. 2024AgentClinic: a multimodal agent benchmark to evaluate AI in simulated clinical environmentscited by 215
38 more
  1. 2025MedXpertQA: Benchmarking Expert-Level Medical Reasoning and Understandingcited by 212
  2. 2024RankRAG: Unifying Context Ranking with Retrieval-Augmented Generation in LLMscited by 200
  3. 2022Leveraging Large Language Models for Multiple Choice Question Answeringcited by 199
  4. 2022Can large language models reason about medical questions?cited by 194
  5. 2024The Effect of Sampling Temperature on Problem Solving in Large Language Modelscited by 168
  6. 2023A Survey of Large Language Models for Healthcare: from Data, Technology, and Applications to Accountability and Ethicscited by 162
  7. 2026On-Policy Context Distillation for Language Modelscited by 161
  8. 2023Med-HALT: Medical Domain Hallucination Test for Large Language Modelscited by 156
  9. 2024MediQ: Question-Asking LLMs and a Benchmark for Reliable Interactive Clinical Reasoningcited by 145
  10. 2023Mol-Instructions: A Large-Scale Biomolecular Instruction Dataset for Large Language Modelscited by 131
  11. 2024OpenFedLLM: Training Large Language Models on Decentralized Private Data via Federated Learningcited by 124
  12. 2023A Survey of Large Language Models in Medicine: Progress, Application, and Challengecited by 123
  13. 2023Almanac: Retrieval-Augmented Language Models for Clinical Medicinecited by 122
  14. 2023Chain-of-Knowledge: Grounding Large Language Models via Dynamic Knowledge Adapting over Heterogeneous Sourcescited by 121
  15. 2023Opportunities and Challenges for ChatGPT and Large Language Models in Biomedicine and Healthcited by 118
  16. 2022Task-aware Retrieval with Instructionscited by 107
  17. 2025MedReason: Eliciting Factual Medical Reasoning Steps in LLMs via Knowledge Graphscited by 105
  18. 2024AI Hospital: Benchmarking Large Language Models in a Multi-agent Medical Interaction Simulatorcited by 99
  19. 2023ExpertQA: Expert-Curated Questions and Attributed Answerscited by 96
  20. 2024A Review of Large Language Models and Autonomous Agents in Chemistrycited by 96
  21. 2024On the Resilience of LLM-Based Multi-Agent Collaboration with Faulty Agentscited by 92
  22. 2023HuatuoGPT-II, One-stage Training for Medical Adaption of LLMscited by 91
  23. 2024Towards Building Multilingual Language Model for Medicinecited by 91
  24. 2023DISC-MedLLM: Bridging General Large Language Models and Real-World Medical Consultationcited by 89
  25. 2024Medical Graph RAG: Towards Safe Medical Large Language Model via Graph Retrieval-Augmented Generationcited by 89
  26. 2024Med42-v2: A Suite of Clinical LLMscited by 89
  27. 2023Towards Mitigating Hallucination in Large Language Models via Self-Reflectioncited by 81
  28. 2024Gecko: Versatile Text Embeddings Distilled from Large Language Modelscited by 81
  29. 2024Open-LLM-Leaderboard: From Multi-choice to Open-style Questions for LLMs Evaluation, Benchmark, and Arenacited by 76
  30. 2024Large language models surpass human experts in predicting neuroscience resultscited by 69
  31. 2024UltraMedical: Building Specialized Generalists in Biomedicinecited by 67
  32. 2024MedCalc-Bench: Evaluating Large Language Models for Medical Calculationscited by 64
  33. 2024The Benefits of a Concise Chain of Thought on Problem-Solving in Large Language Modelscited by 62
  34. 2025MedHELM: Holistic Evaluation of Large Language Models for Medical Taskscited by 60
  35. 2023LMFlow: An Extensible Toolkit for Finetuning and Inference of Large Foundation Modelscited by 58
  36. 2024Understanding LLMs: A Comprehensive Overview from Training to Inferencecited by 58
  37. 2025MegaScience: Pushing the Frontiers of Post-Training Datasets for Science Reasoningcited by 56
  38. 2025Breaking the Exploration Bottleneck: Rubric-Scaffolded Reinforcement Learning for General LLM Reasoningcited by 56

50 most cited of 525 All 525 (JSON)

Similar, not cited

Close in wording, no citation either way

  1. 2024LLM-MedQA: Enhancing Medical Question Answering through Case Studies in Large Language Models
  2. 2025MediQAl: A French Medical Question Answering Dataset for Knowledge and Reasoning Evaluation
  3. 2023Benchmarking Large Language Models on CMExam -- A Comprehensive Chinese Medical Exam Dataset
  4. 2024MedThink: Explaining Medical Visual Question Answering via Multimodal Decision-Making Rationale
  5. 2025MedBioLM: Optimizing Medical and Biological QA with Fine-Tuned Large Language Models and Retrieval-Augmented Generation
  6. 2026Reassessing High-Performing LLMs on Polish Medical Exams: True Competence or Bias-Driven Performance?
  7. 2026MedLLM: An Open Medical Language Model at the Sub-Billion Scale
  8. 2025Benchmarking the Medical Understanding and Reasoning of Large Language Models in Arabic Healthcare Tasks