TCM-Eval: An Expert-Level Dynamic and Extensible Benchmark for Traditional Chinese Medicine
Not on the map. Why?
Abstract (arXiv)
Large Language Models (LLMs) have demonstrated remarkable capabilities in modern medicine, yet their application in Traditional Chinese Medicine (TCM) remains severely limited by the absence of standardized benchmarks and the scarcity of high-quality training data. To address these challenges, we introduce TCM-Eval, the first dynamic and extensible benchmark for TCM, meticulously curated from national medical licensing examinations and validated by TCM experts. Furthermore, we construct a large-scale training corpus and propose Self-Iterative Chain-of-Thought Enhancement (SI-CoTE) to autonomously enrich question-answer pairs with validated reasoning chains through rejection sampling, establishing a virtuous cycle of data and model co-evolution. Using this enriched training data, we develop ZhiMingTang (ZMT), a state-of-the-art LLM specifically designed for TCM, which significantly exceeds the passing threshold for human practitioners. To encourage future research and development, we release a public leaderboard, fostering community engagement and continuous improvement.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 16 of its 30 references that are in the map. First posted on arXiv 10 Nov 2025.
Builds on
16 of 30 references.
References · 16
- 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,767
- 2025gpt-oss-120b & gpt-oss-20b Model Cardcited by 1,258
- 2023Statistical Rejection Sampling Improves Preference Optimizationcited by 321
- 2025MiniMax-M1: Scaling Test-Time Compute Efficiently with Lightning Attentioncited by 248
- 2023Adapted Large Language Models Can Outperform Medical Experts in Clinical Text Summarizationcited by 244
- 2025A Survey of Self-Evolving Agents: What, When, How, and Where to Evolve on the Path to Artificial Super Intelligencecited by 155
- 2020Towards Conversational Recommendation over Multi-Type Dialogscited by 107
- 2023BianQue: Balancing the Questioning and Suggestion Ability of Health LLMs with Multi-turn Health Conversations Polished by ChatGPTcited by 64
- 2024ClinicalBench: Can LLMs Beat Traditional ML Models in Clinical Prediction?cited by 31
- 2025OpenTCM: A GraphRAG-Empowered LLM-based System for Traditional Chinese Medicine Knowledge Retrieval and Diagnosiscited by 10
- 2025ToolSpectrum : Towards Personalized Tool Utilization for Large Language Modelscited by 6
- 2024TCM-FTP: Fine-Tuning Large Language Models for Herbal Prescription Predictioncited by 4
4 more
- 2025TCM-3CEval: A Triaxial Benchmark for Assessing Responses from Large Language Models in Traditional Chinese Medicinecited by 4
- 2025Jingfang: An LLM-Based Multi-Agent System for Precise Medical Consultation and Syndrome Differentiation in Traditional Chinese Medicinecited by 2
- 2025Retrieval-Augmented Framework for LLM-Based Clinical Decision Supportcited by 2
- 2025OphthBench: A Comprehensive Benchmark for Evaluating Large Language Models in Chinese Ophthalmologycited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2025MTCMB: A Multi-Task Benchmark Framework for Evaluating LLMs on Knowledge, Reasoning, and Safety in Traditional Chinese Medicine
- 2025TCM-Ladder: A Benchmark for Multimodal Question Answering on Traditional Chinese Medicine
- 2025BenCao: An Instruction-Tuned Large Language Model for Traditional Chinese Medicine
- 2025Leveraging Group Relative Policy Optimization to Advance Large Language Models in Traditional Chinese Medicine
- 2026LingLanMiDian: Systematic Evaluation of LLMs on TCM Knowledge and Clinical Reasoning
- 2025A benchmark dataset for evaluating Syndrome Differentiation and Treatment in large language models
- 2025Improving TCM Question Answering through Tree-Organized Self-Reflective Retrieval with LLMs
- 2024Enhancing the Traditional Chinese Medicine Capabilities of Large Language Model through Reinforcement Learning from AI Feedback