mlsanityData to 7 Oct 2026

FrenchMedMCQA: A French Multiple-Choice Question Answering Dataset for Medical domain

arXiv 2304.04280 ↗First posted 9 Apr 2023cs.CL cs.AIcited by 25

Not on the map. Why?

Abstract (arXiv)

This paper introduces FrenchMedMCQA, the first publicly available Multiple-Choice Question Answering (MCQA) dataset in French for medical domain. It is composed of 3,105 questions taken from real exams of the French medical specialization diploma in pharmacy, mixing single and multiple answers. Each instance of the dataset contains an identifier, a question, five possible answers and their manual correction(s). We also propose first baseline models to automatically process this MCQA task in order to report on the current performances and to highlight the difficulty of the task. A detailed analysis of the results showed that it is necessary to have representations adapted to the medical domain or to the MCQA task: in our case, English specialized models yielded better results than generic French ones, even though FrenchMedMCQA is in French. Corpus, models and tools are available online.

Key facts. Cited by 25 papers in the map (data through 7 Oct 2026). Builds on 17 of its 25 references that are in the map. First posted on arXiv 9 Apr 2023.

Builds on

17 of 25 references.

References · 17

  1. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
  2. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
  3. 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,874
  4. 2018Think you have Solved Question Answering? Try ARC, the AI2 Reasoning Challengecited by 4,710
  5. 2019Unsupervised Cross-lingual Representation Learning at Scalecited by 3,907
  6. 2019HuggingFace's Transformers: State-of-the-art Natural Language Processingcited by 2,201
  7. 2018Can a Suit of Armor Conduct Electricity? A New Dataset for Open Book Question Answeringcited by 2,114
  8. 2019BioBERT: a pre-trained biomedical language representation model for biomedical text miningcited by 1,935
  9. 2020Leveraging Passage Retrieval with Generative Models for Open Domain Question Answeringcited by 1,203
  10. 2020Domain-Specific Language Model Pretraining for Biomedical Natural Language Processingcited by 996
  11. 2017RACE: Large-scale ReAding Comprehension Dataset From Examinationscited by 851
  12. 2022MedMCQA : A Large-scale Multi-Subject Multi-Choice Dataset for Medical domain Question Answeringcited by 525
5 more
  1. 2020UnifiedQA: Crossing Format Boundaries With a Single QA Systemcited by 475
  2. 2019CamemBERT: a Tasty French Language Modelcited by 368
  3. 2019QASC: A Dataset for Question Answering via Sentence Compositioncited by 248
  4. 2020MiniLMv2: Multi-Head Self-Attention Relation Distillation for Compressing Pretrained Transformerscited by 240
  5. 2019HEAD-QA: A Healthcare Dataset for Complex Reasoningcited by 100

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 12; 2025: 7; 2026: 6.

25 papers.

Sort:

By area:

  1. 2024Towards Building Multilingual Language Model for Medicinecited by 91
  2. 2024Apollo: A Lightweight Multilingual Medical LLM towards Democratizing Medical AI to 6B Peoplecited by 38
  3. 2024Towards Evaluating and Building Versatile Large Language Models for Medicinecited by 38
  4. 2024Distractor Generation in Multiple-Choice Tasks: A Survey of Methods, Datasets, and Evaluationcited by 25
  5. 2024KorMedMCQA: Multi-Choice Question Answering Benchmark for Korean Healthcare Professional Licensing Examinationscited by 22
  6. 2024Efficiently Democratizing Medical LLMs for 50 Languages via a Mixture of Language Family Expertscited by 17
  7. 2024DrBenchmark: A Large Language Understanding Evaluation Benchmark for French Biomedical Domaincited by 11
  8. 2024Multi-OphthaLingua: A Multilingual Benchmark for Assessing and Debiasing LLM Ophthalmological QA in LMICscited by 10
  9. 2024GRAF: Graph Retrieval Augmented by Facts for Romanian Legal Multi-Choice Question Answeringcited by 4
  10. 2025MOLE: Metadata Extraction and Validation in Scientific Papers Using LLMscited by 4
  11. 2025PersianMedQA: Evaluating Large Language Models on a Persian-English Bilingual Medical Question Answering Benchmarkcited by 3
  12. 2024Adaptation of Biomedical and Clinical Pretrained Models to French Long Documents: A Comparative Studycited by 2
13 more
  1. 2025Fact or Guesswork? Evaluating Large Language Models' Medical Knowledge with Structured One-Hop Judgmentscited by 2
  2. 2025Biomed-Enriched: A Biomedical Dataset Enriched with LLMs for Pretraining and Extracting Rare and Hidden Contentcited by 2
  3. 2026Pantagruel: Unified Self-Supervised Encoders for French Text and Speechcited by 2
  4. 2024CollectiveSFT: Scaling Large Language Models for Chinese Medical Benchmark with Collective Instructions in Healthcarecited by 1
  5. 2026MedInjection-FR: Exploring the Role of Native, Synthetic, and Translated Data in Biomedical Instruction Tuningcited by 1
  6. 2024Domain-specific or Uncertainty-aware models: Does it really make a difference for biomedical text classification?cited by 0
  7. 2025From Guidelines to Guarantees: A Graph-Based Evaluation Harness for Domain-Specific Evaluation of LLMscited by 0
  8. 2025CareMedEval dataset: Evaluating Critical Appraisal and Reasoning in the Biomedical Fieldcited by 0
  9. 2025HEAD-QA v2: Expanding a Healthcare Benchmark for Reasoningcited by 0
  10. 2026KALE: Enhancing Knowledge Manipulation in Large Language Models via Knowledge-aware Learningcited by 0
  11. 2026When Tables Go Crazy: Evaluating Multimodal Models on French Financial Documentscited by 0
  12. 2026Is Biomedical Specialization Still Worth It? Insights from Domain-Adaptive Language Modelling with a New French Health Corpuscited by 0
  13. 2026Trade-offs in Medical LLM Adaptation: An Empirical Study in French QAcited by 0