A Survey on Large Language Models for Critical Societal Domains: Finance, Healthcare, and Law
Not on the map. Why?
Abstract (arXiv)
In the fast-evolving domain of artificial intelligence, large language models (LLMs) such as GPT-3 and GPT-4 are revolutionizing the landscapes of finance, healthcare, and law: domains characterized by their reliance on professional expertise, challenging data acquisition, high-stakes, and stringent regulatory compliance. This survey offers a detailed exploration of the methodologies, applications, challenges, and forward-looking opportunities of LLMs within these high-stakes sectors. We highlight the instrumental role of LLMs in enhancing diagnostic and treatment methodologies in healthcare, innovating financial analytics, and refining legal interpretation and compliance strategies. Moreover, we critically examine the ethics for LLM applications in these fields, pointing out the existing ethical concerns and the need for transparent, fair, and robust AI systems that respect regulatory norms. By presenting a thorough review of current literature and practical applications, we showcase the transformative impact of LLMs, and outline the imperative for interdisciplinary cooperation, methodological advancements, and ethical vigilance. Through this lens, we aim to spark dialogue and inspire future research dedicated to maximizing the benefits of LLMs while mitigating their risks in these precision-dependent sectors. To facilitate future research on LLMs in these critical societal domains, we also initiate a reading list that tracks the latest advancements under this topic, which will be continually updated: urlhttps://github.com/czyssrs/LLMXpapers.
Key facts. Cited by 72 papers in the map (data through 7 Oct 2026). First posted on arXiv 2 May 2024.
Builds on
0 of 0 references.
No references here yet.
Built on by
Citing papers per year: 2024: 12; 2025: 38; 2026: 22.
72 papers.
Sort:
By area:
- 2025VerlTool: Towards Holistic Agentic Reinforcement Learning with Tool Usecited by 92
- 2024A Systematic Survey of Text Summarization: From Statistical Methods to Large Language Modelscited by 52
- 2024Natural Language Processing for the Legal Domain: A Survey of Tasks, Datasets, Models, and Challengescited by 42
- 2024DOCBENCH: A Benchmark for Evaluating LLM-based Document Reading Systemscited by 37
- 2024Unveiling the Impact of Coding Data Instruction Fine-Tuning on Large Language Models Reasoningcited by 31
- 2024Causal Inference with Large Language Model: A Surveycited by 31
- 2025Towards Trustworthy Retrieval Augmented Generation for Large Language Models: A Surveycited by 29
- 2025BizFinBench: A Business-Driven Real-World Financial Benchmark for Evaluating LLMscited by 22
- 2025Too Consistent to Detect: A Study of Self-Consistent Errors in LLMscited by 18
- 2026Efficient Evaluation of LLM Performance with Statistical Guaranteescited by 16
- 2025Standard Benchmarks Fail -- Auditing LLM Agents in Finance Must Prioritize Riskcited by 13
- 2026PLawBench: A Rubric-Based Benchmark for Evaluating LLMs in Real-World Legal Practicecited by 13
38 more
- 2024Uncertainty Quantification in Large Language Models Through Convex Hull Analysiscited by 12
- 2025Geometric Uncertainty for Detecting and Correcting Hallucinations in LLMscited by 12
- 2025AgriGPT: a Large Language Model Ecosystem for Agriculturecited by 11
- 2025LExT: Towards Evaluating Trustworthiness of Natural Language Explanationscited by 9
- 2025LLLMs: A Data-Driven Survey of Evolving Research on Limitations of Large Language Modelscited by 9
- 2024Q-Adapter: Customizing Pre-trained LLMs to New Preferences with Forgetting Mitigationcited by 7
- 2024A Survey of Large Language Models for European Languagescited by 6
- 2025Wi-Chat: Large Language Model Powered Wi-Fi Sensingcited by 6
- 2025Loki's Dance of Illusions: A Comprehensive Survey of Hallucination in Large Language Modelscited by 6
- 2025Advanced Financial Reasoning at Scale: A Comprehensive Evaluation of Large Language Models on CFA Level IIIcited by 6
- 2025Document Haystack: A Long Context Multimodal Image/Document Understanding Vision LLM Benchmarkcited by 6
- 2025Interpretable LLMs for Credit Risk: A Systematic Review and Taxonomycited by 5
- 2025Adaptive LoRA Experts Allocation and Selection for Federated Fine-Tuningcited by 5
- 2026LLM Agents in Law: Taxonomy, Applications, and Challengescited by 5
- 2026Large Language Models Exhibit Normative Conformitycited by 5
- 2025Compressing Language Models for Specialized Domainscited by 4
- 2025Finance Language Model Evaluation (FLaME)cited by 4
- 2025Advancing Financial Engineering with Foundation Models: Progress, Applications, and Challengescited by 4
- 2025Aligning Large Language Model Agents with Rational and Moral Preferences: A Supervised Fine-Tuning Approachcited by 4
- 2025Activation-Space Personality Steering: Hybrid Layer Selection for Stable Trait Control in LLMscited by 4
- 2024Behavioral Bias of Vision-Language Models: A Behavioral Finance Viewcited by 3
- 2025Large Language Models are Near-Optimal Decision-Makers with a Non-Human Learning Behaviorcited by 3
- 2025LexGenius: An Expert-Level Benchmark for Large Language Models in Legal General Intelligencecited by 3
- 2026LegalOne: A Family of Foundation Models for Reliable Legal Reasoningcited by 3
- 2024MemHunter: Automated and Verifiable Memorization Detection at Dataset-scale in LLMscited by 2
- 2025On the Reasoning Capacity of AI Models and How to Quantify Itcited by 2
- 2025Concept Layers: Enhancing Interpretability and Intervenability via LLM Conceptualizationcited by 2
- 2025Feeding LLM Annotations to BERT Classifiers at Your Own Riskcited by 2
- 2025The Ever-Evolving Science Examcited by 2
- 2025Direct Token Optimization: A Self-contained Approach to Large Language Model Unlearningcited by 2
- 2025Exploring Large Language Models for Financial Applications: Techniques, Performance, and Challenges with FinMAcited by 2
- 2026EDCO: Dynamic Curriculum Orchestration for Domain-specific Large Language Model Fine-tuningcited by 2
- 2024The use of GPT-4o and Other Large Language Models for the Improvement and Design of Self-Assessment Scales for Measurement of Interpersonal Communication Skillscited by 1
- 2025OphthBench: A Comprehensive Benchmark for Evaluating Large Language Models in Chinese Ophthalmologycited by 1
- 2025IAO Prompting: Making Knowledge Flow Explicit in LLMs through Structured Reasoning Templatescited by 1
- 2025OET: Optimization-based prompt injection Evaluation Toolkitcited by 1
- 2025Prompt-in-Content Attacks: Exploiting Uploaded Inputs to Hijack LLM Behaviorcited by 1
- 2025EdgeRunner 20B: Military Task Parity with GPT-5 while Running on the Edgecited by 1
50 most cited of 72 All 72 (JSON)
- 2026EvidenT: Building Trustworthy Enterprise Assistants through Evidence Groundedness and Traceability18 Sep 2026
- 2026Building Legal Reward Models for Grounding and Abstention13 Sep 2026
- 2026WildSEEK: Evaluating Language Models for Information-Seeking31 Aug 2026
- 2026Recovering General Capabilities via Uncertainty-Calibrated Multi-Teacher On-Policy Distillation27 Aug 2026
- 2026PANOPTICON: A PII-Based Assemblage of Naturalistic Output Tokens for Investigating Privacy Leakage Within LLM Context Window17 Jul 2026
- 2026RusFinChain: A Russian Benchmark for Verifiable Chain-of-Thought Reasoning in Finance with Fuzzy-Aligned Evaluation1 Jul 2026
- 2026NuclearQAv2: A Structured Benchmark for Evaluating Domain-Science Competence in Large Language Models25 Jun 2026
- 2026PolicyAlign: Direct Policy-Based Safety Alignment for Large Language Models24 Jun 2026
- 2026Latent Confidence Alignment for LLM Self-Assessment20 Jun 2026
- 2026LLARS: Enabling Domain Expert & Developer Collaboration for LLM Prompting, Generation and Evaluation11 May 2026
- 2026Automatically Evolving Prompt Guidelines for Task-Specific Optimization7 May 2026
- 2026An Interpretable and Scalable Framework for Evaluating Large Language Models7 May 2026
38 more
- 2026Multilinguality at the Edge: Developing Language Models for the Global South23 Apr 2026
- 2026Large Language Models Exhibit Normative Conformity21 Apr 2026
- 2026An Isotropic Approach to Efficient Uncertainty Quantification with Gradient Norms31 Mar 2026
- 2026Graphs RAG at Scale: Beyond Retrieval-Augmented Generation With Labeled Property Graphs and Resource Description Framework for Complex and Unknown Search Spaces21 Mar 2026
- 2026LegalOne: A Family of Foundation Models for Reliable Legal Reasoning31 Jan 2026
- 2026Efficient Evaluation of LLM Performance with Statistical Guarantees28 Jan 2026
- 2026PLawBench: A Rubric-Based Benchmark for Evaluating LLMs in Real-World Legal Practice23 Jan 2026
- 2026BizFinBench.v2: Towards Reliable LLMs in Finance via Real-User Data and Offline/Online Bilingual Evaluation10 Jan 2026
- 2026LLM Agents in Law: Taxonomy, Applications, and Challenges8 Jan 2026
- 2026EDCO: Dynamic Curriculum Orchestration for Domain-specific Large Language Model Fine-tuning7 Jan 2026
- 2025BitFlipScope: Scalable Fault Localization and Recovery for Bit-Flip Corruptions in LLMs18 Dec 2025
- 2025TIB AIssistant: a Platform for AI-Supported Research Across Research Life Cycles18 Dec 2025
- 2025LexGenius: An Expert-Level Benchmark for Large Language Models in Legal General Intelligence4 Dec 2025
- 2025EdgeRunner 20B: Military Task Parity with GPT-5 while Running on the Edge30 Oct 2025
- 2025Activation-Space Personality Steering: Hybrid Layer Selection for Stable Trait Control in LLMs29 Oct 2025
- 2025TRUSTVIS: A Multi-Dimensional Trustworthiness Evaluation Framework for Large Language Models15 Oct 2025
- 2025OptAgent: Optimizing Query Rewriting for E-commerce via Multi-Agent Simulation4 Oct 2025
- 2025Exploring Large Language Models for Financial Applications: Techniques, Performance, and Challenges with FinMA2 Oct 2025
- 2025Direct Token Optimization: A Self-contained Approach to Large Language Model Unlearning30 Sep 2025
- 2025Adaptive LoRA Experts Allocation and Selection for Federated Fine-Tuning18 Sep 2025
- 2025Geometric Uncertainty for Detecting and Correcting Hallucinations in LLMs17 Sep 2025
- 2025VerlTool: Towards Holistic Agentic Reinforcement Learning with Tool Use1 Sep 2025
- 2025Prompt-in-Content Attacks: Exploiting Uploaded Inputs to Hijack LLM Behavior25 Aug 2025
- 2025AgriGPT: a Large Language Model Ecosystem for Agriculture12 Aug 2025
- 2025Aligning Large Language Model Agents with Rational and Moral Preferences: A Supervised Fine-Tuning Approach28 Jul 2025
- 2025The Ever-Evolving Science Exam22 Jul 2025
- 2025Document Haystack: A Long Context Multimodal Image/Document Understanding Vision LLM Benchmark18 Jul 2025
- 2025Advancing Financial Engineering with Foundation Models: Progress, Applications, and Challenges7 Jul 2025
- 2025Advanced Financial Reasoning at Scale: A Comprehensive Evaluation of Large Language Models on CFA Level III29 Jun 2025
- 2025Large Language Models are Near-Optimal Decision-Makers with a Non-Human Learning Behavior19 Jun 2025
- 2025Finance Language Model Evaluation (FLaME)18 Jun 2025
- 2025Loki's Dance of Illusions: A Comprehensive Survey of Hallucination in Large Language Models6 Jun 2025
- 2025Interpretable LLMs for Credit Risk: A Systematic Review and Taxonomy4 Jun 2025
- 2025BizFinBench: A Business-Driven Real-World Financial Benchmark for Evaluating LLMs26 May 2025
- 2025LLLMs: A Data-Driven Survey of Evolving Research on Limitations of Large Language Models25 May 2025
- 2025Too Consistent to Detect: A Study of Self-Consistent Errors in LLMs23 May 2025
- 2025OET: Optimization-based prompt injection Evaluation Toolkit1 May 2025
- 2025Feeding LLM Annotations to BERT Classifiers at Your Own Risk21 Apr 2025
50 newest of 72 All 72 (JSON)
- 2025VerlTool: Towards Holistic Agentic Reinforcement Learning with Tool Usecited by 92
- 2024Unveiling the Impact of Coding Data Instruction Fine-Tuning on Large Language Models Reasoningcited by 31
- 2024Causal Inference with Large Language Model: A Surveycited by 31
- 2025Advanced Financial Reasoning at Scale: A Comprehensive Evaluation of Large Language Models on CFA Level IIIcited by 6
- 2026LegalOne: A Family of Foundation Models for Reliable Legal Reasoningcited by 3
- 2025On the Reasoning Capacity of AI Models and How to Quantify Itcited by 2
- 2025IAO Prompting: Making Knowledge Flow Explicit in LLMs through Structured Reasoning Templatescited by 1
- 2026RusFinChain: A Russian Benchmark for Verifiable Chain-of-Thought Reasoning in Finance with Fuzzy-Aligned Evaluationcited by 0
- 2026RusFinChain: A Russian Benchmark for Verifiable Chain-of-Thought Reasoning in Finance with Fuzzy-Aligned Evaluation1 Jul 2026
- 2026LegalOne: A Family of Foundation Models for Reliable Legal Reasoning31 Jan 2026
- 2025VerlTool: Towards Holistic Agentic Reinforcement Learning with Tool Use1 Sep 2025
- 2025Advanced Financial Reasoning at Scale: A Comprehensive Evaluation of Large Language Models on CFA Level III29 Jun 2025
- 2025IAO Prompting: Making Knowledge Flow Explicit in LLMs through Structured Reasoning Templates5 Feb 2025
- 2025On the Reasoning Capacity of AI Models and How to Quantify It23 Jan 2025
- 2024Causal Inference with Large Language Model: A Survey15 Sep 2024
- 2024Unveiling the Impact of Coding Data Instruction Fine-Tuning on Large Language Models Reasoning30 May 2024
- 2025Standard Benchmarks Fail -- Auditing LLM Agents in Finance Must Prioritize Riskcited by 13
- 2026LLM Agents in Law: Taxonomy, Applications, and Challengescited by 5
- 2026Large Language Models Exhibit Normative Conformitycited by 5
- 2025Aligning Large Language Model Agents with Rational and Moral Preferences: A Supervised Fine-Tuning Approachcited by 4
- 2025OptAgent: Optimizing Query Rewriting for E-commerce via Multi-Agent Simulationcited by 0
- 2026Large Language Models Exhibit Normative Conformity21 Apr 2026
- 2026LLM Agents in Law: Taxonomy, Applications, and Challenges8 Jan 2026
- 2025OptAgent: Optimizing Query Rewriting for E-commerce via Multi-Agent Simulation4 Oct 2025
- 2025Aligning Large Language Model Agents with Rational and Moral Preferences: A Supervised Fine-Tuning Approach28 Jul 2025
- 2025Standard Benchmarks Fail -- Auditing LLM Agents in Finance Must Prioritize Risk21 Feb 2025
- 2025Towards Trustworthy Retrieval Augmented Generation for Large Language Models: A Surveycited by 29
- 2025AgriGPT: a Large Language Model Ecosystem for Agriculturecited by 11
- 2026Graphs RAG at Scale: Beyond Retrieval-Augmented Generation With Labeled Property Graphs and Resource Description Framework for Complex and Unknown Search Spacescited by 0
- 2026Building Legal Reward Models for Grounding and Abstentioncited by 0
- 2026Building Legal Reward Models for Grounding and Abstention13 Sep 2026
- 2026Graphs RAG at Scale: Beyond Retrieval-Augmented Generation With Labeled Property Graphs and Resource Description Framework for Complex and Unknown Search Spaces21 Mar 2026
- 2025AgriGPT: a Large Language Model Ecosystem for Agriculture12 Aug 2025
- 2025Towards Trustworthy Retrieval Augmented Generation for Large Language Models: A Survey8 Feb 2025
- 2024A Systematic Survey of Text Summarization: From Statistical Methods to Large Language Modelscited by 52
- 2024Natural Language Processing for the Legal Domain: A Survey of Tasks, Datasets, Models, and Challengescited by 42
- 2024DOCBENCH: A Benchmark for Evaluating LLM-based Document Reading Systemscited by 37
- 2025BizFinBench: A Business-Driven Real-World Financial Benchmark for Evaluating LLMscited by 22
- 2025Too Consistent to Detect: A Study of Self-Consistent Errors in LLMscited by 18
- 2026Efficient Evaluation of LLM Performance with Statistical Guaranteescited by 16
- 2026PLawBench: A Rubric-Based Benchmark for Evaluating LLMs in Real-World Legal Practicecited by 13
- 2024Uncertainty Quantification in Large Language Models Through Convex Hull Analysiscited by 12
- 2025Geometric Uncertainty for Detecting and Correcting Hallucinations in LLMscited by 12
- 2025LExT: Towards Evaluating Trustworthiness of Natural Language Explanationscited by 9
- 2025LLLMs: A Data-Driven Survey of Evolving Research on Limitations of Large Language Modelscited by 9
- 2024A Survey of Large Language Models for European Languagescited by 6
12 most cited of 49 All 49 (JSON)
- 2026EvidenT: Building Trustworthy Enterprise Assistants through Evidence Groundedness and Traceability18 Sep 2026
- 2026WildSEEK: Evaluating Language Models for Information-Seeking31 Aug 2026
- 2026Recovering General Capabilities via Uncertainty-Calibrated Multi-Teacher On-Policy Distillation27 Aug 2026
- 2026PANOPTICON: A PII-Based Assemblage of Naturalistic Output Tokens for Investigating Privacy Leakage Within LLM Context Window17 Jul 2026
- 2026NuclearQAv2: A Structured Benchmark for Evaluating Domain-Science Competence in Large Language Models25 Jun 2026
- 2026Latent Confidence Alignment for LLM Self-Assessment20 Jun 2026
- 2026LLARS: Enabling Domain Expert & Developer Collaboration for LLM Prompting, Generation and Evaluation11 May 2026
- 2026Automatically Evolving Prompt Guidelines for Task-Specific Optimization7 May 2026
- 2026An Interpretable and Scalable Framework for Evaluating Large Language Models7 May 2026
- 2026Multilinguality at the Edge: Developing Language Models for the Global South23 Apr 2026
- 2026An Isotropic Approach to Efficient Uncertainty Quantification with Gradient Norms31 Mar 2026
- 2026Efficient Evaluation of LLM Performance with Statistical Guarantees28 Jan 2026
12 newest of 49 All 49 (JSON)