mlsanityData to 7 Oct 2026

Huatuo-26M, a Large-scale Chinese Medical QA Dataset

arXiv 2305.01526 ↗First posted 2 May 2023cs.CL cs.AIcited by 46

Not on the map. Why?

Abstract (arXiv)

In this paper, we release a largest ever medical Question Answering (QA) dataset with 26 million QA pairs. We benchmark many existing approaches in our dataset in terms of both retrieval and generation. Experimental results show that the existing models perform far lower than expected and the released dataset is still challenging in the pre-trained language model era. Moreover, we also experimentally show the benefit of the proposed dataset in many aspects: (i) trained models for other QA datasets in a zero-shot fashion; and (ii) as external knowledge for retrieval-augmented generation (RAG); and (iii) improving existing pre-trained language models by using the QA pairs as a pre-training corpus in continued training manner. We believe that this dataset will not only contribute to medical research but also facilitate both the patients and clinical doctors. See urlhttps://github.com/FreedomIntelligence/Huatuo-26M.

Key facts. Cited by 46 papers in the map (data through 7 Oct 2026). Builds on 25 of its 65 references that are in the map. First posted on arXiv 2 May 2023.

Builds on

25 of 65 references.

References · 25

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2020Language Models are Few-Shot Learnerscited by 32,199
  3. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  4. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
  5. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
  6. 2016SQuAD: 100,000+ Questions for Machine Comprehension of Textcited by 4,115
  7. 2020Dense Passage Retrieval for Open-Domain Question Answeringcited by 3,779
  8. 2018HotpotQA: A Dataset for Diverse, Explainable Multi-hop Question Answeringcited by 3,686
  9. 2017TriviaQA: A Large Scale Distantly Supervised Challenge Dataset for Reading Comprehensioncited by 2,895
  10. 2017Billion-scale similarity search with GPUscited by 2,477
  11. 2016MS MARCO: A Human Generated MAchine Reading COmprehension Datasetcited by 1,591
  12. 2020What Disease does this Patient Have? A Large-scale Open Domain Question Answering Dataset from Medical Examscited by 1,324
13 more
  1. 2017Get To The Point: Summarization with Pointer-Generator Networkscited by 1,281
  2. 2019PubMedQA: A Dataset for Biomedical Research Question Answeringcited by 1,271
  3. 2020How Much Knowledge Can You Pack Into the Parameters of a Language Model?cited by 713
  4. 2020Revisiting Pre-Trained Models for Chinese Natural Language Processingcited by 262
  5. 2021PAQ: 65 Million Probably-Asked Questions and What You Can Do With Themcited by 198
  6. 2017Constructing Datasets for Multi-hop Reading Comprehension Across Documentscited by 190
  7. 2019A Question-Entailment Approach to Question Answeringcited by 133
  8. 2017DuReader: a Chinese Machine Reading Comprehension Dataset from Real-world Applicationscited by 110
  9. 2021CBLUE: A Chinese Biomedical Language Understanding Evaluation Benchmarkcited by 99
  10. 2019Context-Aware Sentence/Passage Term Importance Estimation For First Stage Retrievalcited by 65
  11. 2019ZEN: Pre-training Chinese Text Encoder Enhanced by N-gram Representationscited by 35
  12. 2018CliCR: A Dataset of Clinical Case Reports for Machine Reading Comprehensioncited by 34
  13. 2020Conceptualized Representation Learning for Chinese Biomedical Text Miningcited by 19

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 13; 2024: 20; 2025: 7; 2026: 6.

46 papers.

Sort:

By area:

  1. 2023HuatuoGPT, towards Taming Language Model to Be a Doctorcited by 211
  2. 2023Survey on Factuality in Large Language Models: Knowledge, Retrieval and Domain-Specificitycited by 204
  3. 2023A Survey of Large Language Models for Healthcare: from Data, Technology, and Applications to Accountability and Ethicscited by 162
  4. 2023Large language models in healthcare and medical domain: A reviewcited by 126
  5. 2023A Survey of Large Language Models in Medicine: Progress, Application, and Challengecited by 123
  6. 2023Zhongjing: Enhancing the Chinese Medical Capabilities of Large Language Model through Expert Feedback and Real-world Multi-turn Dialoguecited by 118
  7. 2023CMB: A Comprehensive Medical Benchmark in Chinesecited by 113
  8. 2023HuatuoGPT-II, One-stage Training for Medical Adaption of LLMscited by 91
  9. 2023Benchmarking Large Language Models on CMExam -- A Comprehensive Chinese Medical Exam Datasetcited by 90
  10. 2024Survey on Knowledge Distillation for Large Language Models: Methods, Evaluation, and Applicationcited by 55
  11. 2024A Comprehensive Survey of Large Language Models and Multimodal Large Language Models in Medicinecited by 45
  12. 2024Apollo: A Lightweight Multilingual Medical LLM towards Democratizing Medical AI to 6B Peoplecited by 38
34 more
  1. 2024A Survey on Medical Large Language Models: Technology, Application, Trustworthiness, and Future Directionscited by 34
  2. 2023Qilin-Med: Multi-stage Knowledge Injection Advanced Medical Large Language Modelcited by 24
  3. 2024An overview of domain-specific foundation model: key technologies, applications and challengescited by 19
  4. 2024Efficiently Democratizing Medical LLMs for 50 Languages via a Mixture of Language Family Expertscited by 17
  5. 2024PediatricsGPT: Large Language Models as Chinese Medical Assistants for Pediatric Applicationscited by 16
  6. 2024A Survey on Large Language Models from General Purpose to Medical Applications: Datasets, Methodologies, and Evaluationscited by 16
  7. 2024Large Language Model Benchmarks in Medical Taskscited by 16
  8. 2025Multimodal Large Language Models for Medicine: A Comprehensive Surveycited by 16
  9. 2023From Beginner to Expert: Modeling Medical Knowledge into General LLMscited by 14
  10. 2024MedThink: Explaining Medical Visual Question Answering via Multimodal Decision-Making Rationalecited by 14
  11. 2024Qibo: A Large Language Model for Traditional Chinese Medicinecited by 12
  12. 2023ExplainCPE: A Free-text Explanation Benchmark of Chinese Pharmacist Examinationcited by 10
  13. 2026F2LLM-v2: Inclusive, Performant, and Efficient Embeddings for a Multilingual Worldcited by 10
  14. 2024CliMedBench: A Large-Scale Chinese Benchmark for Evaluating Medical Large Language Models in Clinical Scenarioscited by 9
  15. 2024From Intention To Implementation: Automating Biomedical Research via LLMscited by 7
  16. 2024LLMs for Doctors: Leveraging Medical LLMs to Assist Doctors, Not Replace Themcited by 5
  17. 2025TCM-Ladder: A Benchmark for Multimodal Question Answering on Traditional Chinese Medicinecited by 5
  18. 2023Continuous Training and Fine-tuning for Domain-Specific Language Models in Medical Question Answeringcited by 4
  19. 2024Towards Action Hijacking of Large Language Model-based Agentcited by 4
  20. 2026TARSE: Test-Time Adaptation via Retrieval of Skills and Experience for Reasoning Agentscited by 4
  21. 2025Leveraging Online Data to Enhance Medical Knowledge in a Small Persian Language Modelcited by 3
  22. 2025MOSS-Speech: Towards True Speech-to-Speech Models Without Text Guidancecited by 3
  23. 2024CPSDBench: A Large Language Model Evaluation Benchmark and Baseline for Chinese Public Security Domaincited by 2
  24. 2024Diabetica: Adapting Large Language Model to Enhance Multiple Medical Tasks in Diabetes Care and Managementcited by 2
  25. 2024CareBot: A Pioneering Full-Process Open-Source Medical Language Modelcited by 2
  26. 2025LegalEval-Q: A New Benchmark for The Quality Evaluation of LLM-Generated Legal Textcited by 2
  27. 2026Towards Privacy-Preserving LLM Inference via Covariant Obfuscation (Technical Report)cited by 2
  28. 2024The Role of Language Models in Modern Healthcare: A Comprehensive Reviewcited by 1
  29. 2024Towards Democratizing Multilingual Large Language Models For Medicine Through A Two-Stage Instruction Fine-tuning Approachcited by 0
  30. 2025Prompt reinforcing for long-term planning of large language modelscited by 0
  31. 2025Enabling Doctor-Centric Medical AI with LLMs through Workflow-Aligned Tasks and Benchmarkscited by 0
  32. 2026Investigating Gender Stereotypes in Large Language Models via Social Determinants of Healthcited by 0
  33. 2026ML-Embed: Inclusive and Efficient Embeddings for a Multilingual Worldcited by 0
  34. 2026Gaokerena: A Small Persian Medical Language Model Familycited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2023MKRAG: Medical Knowledge Retrieval Augmented Generation for Medical Question Answering
  2. 2025Optimizing Medical Question-Answering Systems: A Comparative Study of Fine-Tuned and Zero-Shot Large Language Models with RAG Framework
  3. 2024Comprehensive and Practical Evaluation of Retrieval-Augmented Generation Systems for Medical Question Answering
  4. 2025MKG-Rank: Enhancing Large Language Models with Knowledge Graph for Multilingual Medical Question Answering
  5. 2026A Systematic Study of Retrieval Pipeline Design for Retrieval-Augmented Medical Question Answering
  6. 2025IMB: An Italian Medical Benchmark for Question Answering
  7. 2025Multilingual Medical Reasoning for Question Answering with Large Language Models
  8. 2024Give me Some Hard Questions: Synthetic Data Generation for Clinical QA