BianCang: A Traditional Chinese Medicine Large Language Model
Not on the map. Why?
Abstract (arXiv)
The surge of large language models (LLMs) has driven significant progress in medical applications, including traditional Chinese medicine (TCM). However, current medical LLMs struggle with TCM diagnosis and syndrome differentiation due to substantial differences between TCM and modern medical theory, and the scarcity of specialized, high-quality corpora. To this end, in this paper we propose BianCang, a TCM-specific LLM, using a two-stage training process that first injects domain-specific knowledge and then aligns it through targeted stimulation to enhance diagnostic and differentiation capabilities. Specifically, we constructed pre-training corpora, instruction-aligned datasets based on real hospital records, and the ChP-TCM dataset derived from the Pharmacopoeia of the People's Republic of China. We compiled extensive TCM and medical corpora for continual pre-training and supervised fine-tuning, building a comprehensive dataset to refine the model's understanding of TCM. Evaluations across 11 test sets involving 31 models and 4 tasks demonstrate the effectiveness of BianCang, offering valuable insights for future research. Code, datasets, and models are available on https://github.com/QLU-NLP/BianCang.
Key facts. Cited by 12 papers in the map (data through 14 Oct 2026). Builds on 36 of its 52 references that are in the map. First posted on arXiv 17 Nov 2024.
Builds on
36 of 52 references.
References · 36
- 2023GPT-4 Technical Reportcited by 18,396
- 2024The Llama 3 Herd of Modelscited by 14,715
- 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
- 2023Qwen Technical Reportcited by 3,344
- 2023A Survey of Large Language Modelscited by 2,576
- 2024Qwen2 Technical Reportcited by 2,120
- 2024ChatGLM: A Family of Large Language Models from GLM-130B to GLM-4 All Toolscited by 1,121
- 2023LIMA: Less Is More for Alignmentcited by 1,100
- 2021GLM: General Language Model Pretraining with Autoregressive Blank Infillingcited by 1,031
- 2023WizardCoder: Empowering Code Large Language Models with Evol-Instructcited by 733
- 2023Baichuan 2: Open Large-scale Language Modelscited by 670
- 2023Textbooks Are All You Needcited by 569
24 more
- 2024SWIFT:A Scalable lightWeight Infrastructure for Fine-Tuningcited by 355
- 2023Efficient and Effective Text Encoding for Chinese LLaMA and Alpacacited by 305
- 2023How Abilities in Large Language Models are Affected by Supervised Fine-tuning Data Compositioncited by 223
- 2023HuatuoGPT, towards Taming Language Model to Be a Doctorcited by 214
- 2023A Survey of Large Language Models for Healthcare: from Data, Technology, and Applications to Accountability and Ethicscited by 163
- 2023HuaTuo: Tuning LLaMA Model with Chinese Medical Knowledgecited by 162
- 2023DoctorGLM: Fine-tuning your Chinese Doctor is not a Herculean Taskcited by 131
- 2023DISC-LawLLM: Fine-tuning Large Language Models for Intelligent Legal Servicescited by 120
- 2023Zhongjing: Enhancing the Chinese Medical Capabilities of Large Language Model through Expert Feedback and Real-world Multi-turn Dialoguecited by 119
- 2023LawBench: Benchmarking Legal Knowledge of Large Language Modelscited by 117
- 2023CMB: A Comprehensive Medical Benchmark in Chinesecited by 115
- 2023HuatuoGPT-II, One-stage Training for Medical Adaption of LLMscited by 92
- 2023DISC-MedLLM: Bridging General Large Language Models and Real-World Medical Consultationcited by 90
- 2022Fengshenbang 1.0: Being the Foundation of Chinese Cognitive Intelligencecited by 70
- 2023BianQue: Balancing the Questioning and Suggestion Ability of Health LLMs with Multi-turn Health Conversations Polished by ChatGPTcited by 65
- 2023DISC-FinLLM: A Chinese Financial Large Language Model based on Multiple Experts Fine-tuningcited by 64
- 2020Ape210K: A Large-Scale and Template-Rich Dataset of Math Word Problemscited by 60
- 2024COIG-CQIA: Quality is All You Need for Chinese Instruction Fine-tuningcited by 45
- 2023ChiMed-GPT: A Chinese Medical Large Language Model with Full Training Regime and Better Alignment to Human Preferencescited by 43
- 2024Learning or Self-aligning? Rethinking Instruction Fine-tuningcited by 43
- 2024FinRobot: An Open-Source AI Agent Platform for Financial Applications using Large Language Modelscited by 40
- 2023Taiyi: A Bilingual Fine-Tuned Large Language Model for Diverse Biomedical Taskscited by 36
- 2024Qibo: A Large Language Model for Traditional Chinese Medicinecited by 13
- 2022TCM-SD: A Benchmark for Probing Syndrome Differentiation via Natural Language Processingcited by 6
Built on by
Citing papers per year: 2025: 5; 2026: 7.
12 papers.
- 2025OpenTCM: A GraphRAG-Empowered LLM-based System for Traditional Chinese Medicine Knowledge Retrieval and Diagnosiscited by 10
- 2025BenCao: An Instruction-Tuned Large Language Model for Traditional Chinese Medicinecited by 2
- 2025Do "New Snow Tablets" Contain Snow? Large Language Models Over-Rely on Names to Identify Ingredients of Chinese Drugscited by 1
- 2026LingLanMiDian: Systematic Evaluation of LLMs on TCM Knowledge and Clinical Reasoningcited by 1
- 2025RACE-Align: Retrieval-Augmented and Chain-of-Thought Enhanced Preference Alignment for Large Language Modelscited by 0
- 2025A benchmark dataset for evaluating Syndrome Differentiation and Treatment in large language modelscited by 0
- 2026DongYuan: An LLM-Based Framework for Integrative Chinese and Western Medicine Spleen-Stomach Disorders Diagnosiscited by 0
- 2026TCMIIES: A Browser-Based LLM-Powered Intelligent Information Extraction System for Academic Literaturecited by 0
- 2026MMIR-TCM: Memory-Integrated Multimodal Inference and Retrieval for TCM Clinical Decision Supportcited by 0
- 2026Large Language Models Versus Physicians in Traditional Chinese Medicine: A Real-World Clinical Case Evaluationcited by 0
- 2026LingLan: An Advancing Traditional Chinese Medicine Diagnosis LLM with Multimodal Datacited by 0
- 2026Output Discipline Sets the Floor: A Falsification-Guided, Model-Agnostic Agent Protocol for Auditable Hypothesis-Driven Decision Makingcited by 0
- 2026Output Discipline Sets the Floor: A Falsification-Guided, Model-Agnostic Agent Protocol for Auditable Hypothesis-Driven Decision Making13 Oct 2026
- 2026LingLan: An Advancing Traditional Chinese Medicine Diagnosis LLM with Multimodal Data22 Sep 2026
- 2026Large Language Models Versus Physicians in Traditional Chinese Medicine: A Real-World Clinical Case Evaluation15 Jul 2026
- 2026MMIR-TCM: Memory-Integrated Multimodal Inference and Retrieval for TCM Clinical Decision Support2 Jul 2026
- 2026TCMIIES: A Browser-Based LLM-Powered Intelligent Information Extraction System for Academic Literature8 May 2026
- 2026DongYuan: An LLM-Based Framework for Integrative Chinese and Western Medicine Spleen-Stomach Disorders Diagnosis30 Mar 2026
- 2026LingLanMiDian: Systematic Evaluation of LLMs on TCM Knowledge and Clinical Reasoning2 Feb 2026
- 2025A benchmark dataset for evaluating Syndrome Differentiation and Treatment in large language models2 Dec 2025
- 2025BenCao: An Instruction-Tuned Large Language Model for Traditional Chinese Medicine20 Oct 2025
- 2025RACE-Align: Retrieval-Augmented and Chain-of-Thought Enhanced Preference Alignment for Large Language Models3 Jun 2025
- 2025OpenTCM: A GraphRAG-Empowered LLM-based System for Traditional Chinese Medicine Knowledge Retrieval and Diagnosis28 Apr 2025
- 2025Do "New Snow Tablets" Contain Snow? Large Language Models Over-Rely on Names to Identify Ingredients of Chinese Drugs3 Apr 2025