mlsanityData to 7 Oct 2026

DISC-FinLLM: A Chinese Financial Large Language Model based on Multiple Experts Fine-tuning

arXiv 2310.15205 ↗First posted 23 Oct 2023cs.CLcited by 64

On the map: Retrieval-augmented generation → Legal and financial RAG

Abstract (arXiv)

We propose Multiple Experts Fine-tuning Framework to build a financial large language model (LLM), DISC-FinLLM. Our methodology improves general LLMs by endowing them with multi-turn question answering abilities, domain text processing capabilities, mathematical computation skills, and retrieval-enhanced generation capabilities. We build a financial instruction-tuning dataset named DISC-FIN-SFT, including instruction samples of four categories (consulting, NLP tasks, computing and retrieval-augmented generation). Evaluations conducted on multiple benchmarks demonstrate that our model performs better than baseline models in various financial scenarios. Further resources can be found at https://github.com/FudanDISC/DISC-FinLLM.

Key facts. Cited by 64 papers in the map (data through 7 Oct 2026). Placed in Legal and financial RAG, one of 15 directions in Retrieval-augmented generation. Builds on 23 of its 62 references that are in the map. First posted on arXiv 23 Oct 2023.

Builds on

23 of 62 references.

References · 23

  1. 2022Training language models to follow instructions with human feedbackcited by 15,712
  2. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  3. 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,072
  4. 2021Finetuned Language Models Are Zero-Shot Learnerscited by 3,747
  5. 2022Self-Instruct: Aligning Language Models with Self-Generated Instructionscited by 2,674
  6. 2022BLOOM: A 176B-Parameter Open-Access Multilingual Language Modelcited by 1,968
  7. 2023BloombergGPT: A Large Language Model for Financecited by 923
  8. 2019DialoGPT: Large-Scale Generative Pre-training for Conversational Response Generationcited by 842
  9. 2021Cross-Task Generalization via Natural Language Crowdsourcing Instructionscited by 696
  10. 2019FinBERT: Financial Sentiment Analysis with Pre-trained Language Modelscited by 378
  11. 2013Good Debt or Bad Debt: Detecting Semantic Orientations in Economic Textscited by 310
  12. 2023PIXIU: A Large Language Model, Instruction Data and Evaluation Benchmark for Financecited by 217
11 more
  1. 2023DISC-LawLLM: Fine-tuning Large Language Models for Intelligent Legal Servicescited by 117
  2. 2023XuanYuan 2.0: A Large Chinese Financial Chat Model with Hundreds of Billions Parameterscited by 92
  3. 2023DISC-MedLLM: Bridging General Large Language Models and Real-World Medical Consultationcited by 89
  4. 2023Exploring the Impact of Instruction Data Scaling on Large Language Models: An Empirical Study on Real-World Use Casescited by 85
  5. 2019Investigating Prior Knowledge for Challenging Chinese Machine Reading Comprehensioncited by 80
  6. 2023BBT-Fin: Comprehensive Construction of Chinese Financial Domain Pre-trained Language Model, Corpus and Benchmarkcited by 60
  7. 2021Multilingual and Cross-Lingual Intent Detection from Spoken Datacited by 35
  8. 2022DialogVED: A Pre-trained Latent Variable Encoder-Decoder Model for Dialog Response Generationcited by 35
  9. 2023Large Language Models (GPT) Struggle to Answer Multiple-Choice Questions about Codecited by 31
  10. 2022GPT-3-driven pedagogical agents for training children's curious question-asking skillscited by 29
  11. 2021Contextual Fine-to-Coarse Distillation for Coarse-grained Response Selection in Open-Domain Conversationscited by 9

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 2; 2024: 33; 2025: 20; 2026: 9.

64 papers.

Sort:

By area:

  1. 2024FinBen: A Holistic Financial Benchmark for Large Language Modelscited by 140
  2. 2024AI Hospital: Benchmarking Large Language Models in a Multi-agent Medical Interaction Simulatorcited by 99
  3. 2024A Survey of Large Language Models for Financial Applications: Progress, Prospects and Challengescited by 86
  4. 2025Fin-R1: A Large Language Model for Financial Reasoning through Reinforcement Learningcited by 82
  5. 2024FinTral: A Family of GPT-4 Level Multimodal Financial Large Language Modelscited by 32
  6. 2024MoRA: High-Rank Updating for Parameter-Efficient Fine-Tuningcited by 31
  7. 2024OmniEval: An Omnidirectional and Automatic RAG Evaluation Benchmark in Financial Domaincited by 28
  8. 2024Benchmarking Large Language Models on CFLUE -- A Chinese Financial Language Understanding Evaluation Datasetcited by 23
  9. 2024Synergistic Multi-Agent Framework with Trajectory Learning for Knowledge-Intensive Taskscited by 23
  10. 2025BizFinBench: A Business-Driven Real-World Financial Benchmark for Evaluating LLMscited by 22
  11. 2024MC-CoT: A Modular Collaborative CoT Framework for Zero-shot Medical-VQA with LLM and MLLM Integrationcited by 21
  12. 2025FinMTEB: Finance Massive Text Embedding Benchmarkcited by 18
38 more
  1. 2023PanGu-π: Enhancing Language Model Architectures via Nonlinearity Compensationcited by 17
  2. 2025Plutus: Benchmarking Large Language Models in Low-Resource Greek Financecited by 16
  3. 2024CFinBench: A Comprehensive Chinese Financial Benchmark for Large Language Modelscited by 12
  4. 2024Do We Need Domain-Specific Embedding Models? An Empirical Investigationcited by 12
  5. 2024SoMeLVLM: A Large Vision Language Model for Social Media Processingcited by 11
  6. 2024BianCang: A Traditional Chinese Medicine Large Language Modelcited by 11
  7. 2024Improving Domain Adaptation through Extended-Text Reading Comprehensioncited by 10
  8. 2025From Deep Learning to LLMs: A survey of AI in Quantitative Investmentcited by 9
  9. 2026RealFin: How Well Do LLMs Reason About Finance When Users Leave Things Unsaid?cited by 9
  10. 2024No Language is an Island: Unifying Chinese and English in Financial Large Language Models, Instruction Data, and Benchmarkscited by 7
  11. 2024An Expert is Worth One Token: Synergizing Multiple Expert LLMs as Generalist via Expert Token Routingcited by 7
  12. 2024EFSA: Towards Event-Level Financial Sentiment Analysiscited by 7
  13. 2024ModelLock: Locking Your Model With a Spellcited by 6
  14. 2025Exposing Product Bias in LLM Investment Recommendationcited by 6
  15. 2024D'olares or Dollars? Unraveling the Bilingual Prowess of Financial LLMs Between Spanish and Englishcited by 5
  16. 2024Harnessing GPT-4V(ision) for Insurance: A Preliminary Explorationcited by 5
  17. 2025QualBench: Benchmarking Chinese LLMs with Localized Professional Qualifications for Vertical Domain Evaluationcited by 5
  18. 2025FinTeam: A Multi-Agent Collaborative Intelligence System for Comprehensive Financial Scenarioscited by 5
  19. 2025Agentar-Fin-R1: Enhancing Financial Intelligence through Domain Expertise, Training Efficiency, and Advanced Reasoningcited by 5
  20. 2025Can an Individual Manipulate the Collective Decisions of Multi-Agents?cited by 5
  21. 2024Automatically Generating Numerous Context-Driven SFT Data for LLMs across Diverse Granularitycited by 4
  22. 2024Golden Touchstone: A Comprehensive Bilingual Benchmark for Evaluating Financial Large Language Modelscited by 4
  23. 2025Bridging Language Models and Financial Analysiscited by 4
  24. 2025CFBenchmark-MM: Chinese Financial Assistant Benchmark for Multimodal Large Language Modelcited by 4
  25. 2025Advancing Financial Engineering with Foundation Models: Progress, Applications, and Challengescited by 4
  26. 2025FinKario: Event-Enhanced Automated Construction of Financial Knowledge Graphcited by 4
  27. 2024Balancing Speciality and Versatility: A Coarse to Fine Framework for Mitigating Catastrophic Forgetting in Large Language Modelscited by 3
  28. 2024Financial Knowledge Large Language Modelcited by 3
  29. 2025Select to Know: An Internal-External Knowledge Self-Selection Framework for Domain-Specific Question Answeringcited by 3
  30. 2025MSCoRe: A Benchmark for Multi-Stage Collaborative Reasoning in LLM Agentscited by 3
  31. 2023Shai: A large language model for asset managementcited by 2
  32. 2024SNFinLLM: Systematic and Nuanced Financial Domain Adaptation of Chinese Large Language Modelscited by 2
  33. 2025FinLMM-R1: Enhancing Financial Reasoning in LMM through Scalable Data and Reward Designcited by 2
  34. 2024SilverSight: A Multi-Task Chinese Financial Large Language Model Based on Adaptive Semantic Space Learningcited by 1
  35. 2024NumLLM: Numeric-Sensitive Large Language Model for Chinese Financecited by 1
  36. 2024FinTruthQA: A Benchmark for AI-Driven Financial Disclosure Quality Assessment in Investor -- Firm Interactionscited by 1
  37. 2024AnyTaskTune: Advanced Domain-Specific Solutions through Task-Fine-Tuningcited by 1
  38. 2024Knowledge Pyramid Construction for Multi-Level Retrieval-Augmented Generationcited by 1

50 most cited of 64 All 64 (JSON)

Similar, not cited

Close in wording, no citation either way

  1. 2025LLMs Meet Finance: Fine-Tuning Foundation Models for the Open FinLLM Leaderboard
  2. 2024FinLLMs: A Framework for Financial Reasoning Dataset Generation with Large Language Models
  3. 2024Mixing It Up: The Cocktail Effect of Multi-Task Fine-Tuning on LLM Performance -- A Case Study in Finance
  4. 2024KodeXv0.1: A Family of State-of-the-Art Financial Large Language Models
  5. 2023FinEval: A Chinese Financial Domain Knowledge Evaluation Benchmark for Large Language Models
  6. 2026FinForge: Semi-Synthetic Financial Benchmark Generation
  7. 2024Fine-tuning Smaller Language Models for Question Answering over Financial Documents
  8. 2025FinEval-KR: A Financial Domain Evaluation Framework for Large Language Models' Knowledge and Reasoning