Towards Trustworthy AI: A Review of Ethical and Robust Large Language Models
Not on the map. Why?
Abstract (arXiv)
The rapid progress in Large Language Models (LLMs) could transform many fields, but their fast development creates significant challenges for oversight, ethical creation, and building user trust. This comprehensive review looks at key trust issues in LLMs, such as unintended harms, lack of transparency, vulnerability to attacks, alignment with human values, and environmental impact. Many obstacles can undermine user trust, including societal biases, opaque decision-making, potential for misuse, and the challenges of rapidly evolving technology. Addressing these trust gaps is critical as LLMs become more common in sensitive areas like finance, healthcare, education, and policy. To tackle these issues, we suggest combining ethical oversight, industry accountability, regulation, and public involvement. AI development norms should be reshaped, incentives aligned, and ethics integrated throughout the machine learning process, which requires close collaboration across technology, ethics, law, policy, and other fields. Our review contributes a robust framework to assess trust in LLMs and analyzes the complex trust dynamics in depth. We provide contextualized guidelines and standards for responsibly developing and deploying these powerful AI systems. This review identifies key limitations and challenges in creating trustworthy AI. By addressing these issues, we aim to build a transparent, accountable AI ecosystem that benefits society while minimizing risks. Our findings provide valuable guidance for researchers, policymakers, and industry leaders striving to establish trust in LLMs and ensure they are used responsibly across various applications for the good of society.
Key facts. Cited by 21 papers in the map (data through 7 Oct 2026). Builds on 101 of its 258 references that are in the map. First posted on arXiv 1 Jun 2024.
Builds on
101 of 258 references.
References · 101
- 2023GPT-4 Technical Reportcited by 18,132
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
- 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,916
- 2016"Why Should I Trust You?": Explaining the Predictions of Any Classifiercited by 5,040
- 2021On the Opportunities and Risks of Foundation Modelscited by 3,961
- 2022Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedbackcited by 3,634
- 2017Axiomatic Attribution for Deep Networkscited by 3,350
- 2022Constitutional AI: Harmlessness from AI Feedbackcited by 2,950
- 2023Universal and Transferable Adversarial Attacks on Aligned Language Modelscited by 2,914
- 2017Interpretability Beyond Feature Attribution: Quantitative Testing with Concept Activation Vectors (TCAV)cited by 1,309
- 2023A Survey on Evaluation of Large Language Modelscited by 1,227
- 2023Language Models Don't Always Say What They Think: Unfaithful Explanations in Chain-of-Thought Promptingcited by 1,081
38 more
- 2018Model Cards for Model Reportingcited by 1,068
- 2022Large Language Models Are Human-Level Prompt Engineerscited by 1,020
- 2021Ethical and social risks of harm from Language Modelscited by 957
- 2019Attention is not Explanationcited by 916
- 2023Open Problems and Fundamental Limitations of Reinforcement Learning from Human Feedbackcited by 743
- 2022Red Teaming Language Models to Reduce Harms: Methods, Scaling Behaviors, and Lessons Learnedcited by 702
- 2023A Watermark for Large Language Modelscited by 667
- 2023RLAIF vs. RLHF: Scaling Reinforcement Learning from Human Feedback with AI Feedbackcited by 615
- 2023DecodingTrust: A Comprehensive Assessment of Trustworthiness in GPT Modelscited by 505
- 2019What do you learn from context? Probing for sentence structure in contextualized word representationscited by 436
- 2017Efficient Processing of Deep Neural Networks: A Tutorial and Surveycited by 427
- 2020A Survey of Convolutional Neural Networks: Analysis, Applications, and Prospectscited by 396
- 2023Trustworthy LLMs: a Survey and Guideline for Evaluating Large Language Models' Alignmentcited by 394
- 2020Closing the AI Accountability Gap: Defining an End-to-End Framework for Internal Algorithmic Auditingcited by 380
- 2023A Survey on Large Language Model (LLM) Security and Privacy: The Good, the Bad, and the Uglycited by 380
- 2020Fairness in Machine Learning: A Surveycited by 369
- 2023Explainability for Large Language Models: A Surveycited by 331
- 2023Reasoning on Graphs: Faithful and Interpretable Large Language Model Reasoningcited by 326
- 2019Theoretical Limitations of Self-Attention in Neural Sequence Modelscited by 286
- 2024TrustLLM: Trustworthiness in Large Language Modelscited by 280
- 2018Improving fairness in machine learning systems: What do industry practitioners need?cited by 262
- 2023Evaluating Large Language Models: A Comprehensive Surveycited by 200
- 2024ArtPrompt: ASCII Art-based Jailbreak Attacks against Aligned LLMscited by 197
- 2023Survey of Vulnerabilities in Large Language Models Revealed by Adversarial Attackscited by 189
- 2023Gender bias and stereotypes in Large Language Modelscited by 185
- 2023LoRA Fine-tuning Efficiently Undoes Safety Training in Llama 2-Chat 70Bcited by 183
- 2024Security and Privacy Challenges of Large Language Models: A Surveycited by 179
- 2023GPTs are GPTs: An Early Look at the Labor Market Impact Potential of Large Language Modelscited by 174
- 2023Beyond Memorization: Violating Privacy Via Inference with Large Language Modelscited by 167
- 2023A Survey of Large Language Models for Healthcare: from Data, Technology, and Applications to Accountability and Ethicscited by 162
- 2020Adversarial Filters of Dataset Biasescited by 159
- 2024The pitfalls of next-token predictioncited by 156
- 2020Model-Based Deep Learningcited by 136
- 2023Auditing large language models: a three-layered approachcited by 135
- 2019Principles alone cannot guarantee ethical AIcited by 134
- 2019The Ethics of AI Ethics -- An Evaluation of Guidelinescited by 129
- 2023The Science of Detecting LLM-Generated Textscited by 126
- 2023AI Transparency in the Age of LLMs: A Human-Centered Research Roadmapcited by 119
50 most cited of 101 All 101 (JSON)
Built on by
Citing papers per year: 2024: 8; 2025: 6; 2026: 7.
21 papers.
Sort:
By area:
- 2024HelloBench: Evaluating Long Text Generation Capabilities of Large Language Modelscited by 42
- 2025Integrating LLMs with ITS: Recent Advances, Potentials, Challenges, and Future Directionscited by 23
- 2025Alignment and Safety in Large Language Models: Safety Mechanisms, Training Paradigms, and Emerging Challengescited by 14
- 2025LExT: Towards Evaluating Trustworthiness of Natural Language Explanationscited by 9
- 2024Improving Large Language Model (LLM) fidelity through context-aware grounding: A systematic approach to reliability and veracitycited by 8
- 2024Hallucination in Multimodal Foundation Models: A Survey on Causes, Corrections, and Evaluationscited by 8
- 2025Agentic Services Computingcited by 6
- 2024STRICTA: Structured Reasoning in Critical Text Assessment for Peer Review and Beyondcited by 5
- 2024Guarding the Gate: ConceptGuard Battles Concept-Level Backdoors in Concept Bottleneck Modelscited by 3
- 2025Localizing Persona Representations in LLMscited by 3
- 2025A Comprehensive Review on Harnessing Large Language Models to Overcome Recommender System Challengescited by 3
- 2026In Transformer We Trust? A Perspective on Transformer Architecture Failure Modescited by 1
9 more
- 2024From Prohibition to Adoption: How Hong Kong Universities Are Navigating ChatGPT in Academic Workflowscited by 0
- 2024Standardization Trends on Safety and Trustworthiness Technology for Advanced AIcited by 0
- 2024Collaborative Participatory Research with LLM Agents in South Asia: An Empirically-Grounded Methodological Initiative and Agenda from Field Evidence in Sri Lankacited by 0
- 2026When AI Writes, Whose Voice Remains? Quantifying Cultural Marker Erasure Across World English Varieties in Large Language Modelscited by 0
- 2026Adversarial Moral Stress Testing of Large Language Modelscited by 0
- 2026Vibe Medicine: Redefining Biomedical Research Through Human-AI Co-Workcited by 0
- 2026A Multi-Dimensional Audit of Politically Aligned Large Language Modelscited by 0
- 2026Physiological Noise Augmentation Improves Non-Invasive Brain-to-Speechcited by 0
- 2026LAAF: A Layered Accountability Architecture Framework for LLM Applicationscited by 0
- 2026LAAF: A Layered Accountability Architecture Framework for LLM Applications27 Aug 2026
- 2026Physiological Noise Augmentation Improves Non-Invasive Brain-to-Speech6 Jul 2026
- 2026A Multi-Dimensional Audit of Politically Aligned Large Language Models27 Apr 2026
- 2026Vibe Medicine: Redefining Biomedical Research Through Human-AI Co-Work26 Apr 2026
- 2026Adversarial Moral Stress Testing of Large Language Models1 Apr 2026
- 2026When AI Writes, Whose Voice Remains? Quantifying Cultural Marker Erasure Across World English Varieties in Large Language Models25 Feb 2026
- 2026In Transformer We Trust? A Perspective on Transformer Architecture Failure Modes15 Feb 2026
- 2025Agentic Services Computing29 Sep 2025
- 2025Alignment and Safety in Large Language Models: Safety Mechanisms, Training Paradigms, and Emerging Challenges25 Jul 2025
- 2025A Comprehensive Review on Harnessing Large Language Models to Overcome Recommender System Challenges17 Jul 2025
- 2025Localizing Persona Representations in LLMs30 May 2025
- 2025LExT: Towards Evaluating Trustworthiness of Natural Language Explanations8 Apr 2025
9 more
- 2025Integrating LLMs with ITS: Recent Advances, Potentials, Challenges, and Future Directions8 Jan 2025
- 2024Guarding the Gate: ConceptGuard Battles Concept-Level Backdoors in Concept Bottleneck Models25 Nov 2024
- 2024Collaborative Participatory Research with LLM Agents in South Asia: An Empirically-Grounded Methodological Initiative and Agenda from Field Evidence in Sri Lanka13 Nov 2024
- 2024Standardization Trends on Safety and Trustworthiness Technology for Advanced AI29 Oct 2024
- 2024Hallucination in Multimodal Foundation Models: A Survey on Causes, Corrections, and Evaluations20 Oct 2024
- 2024From Prohibition to Adoption: How Hong Kong Universities Are Navigating ChatGPT in Academic Workflows2 Oct 2024
- 2024HelloBench: Evaluating Long Text Generation Capabilities of Large Language Models24 Sep 2024
- 2024STRICTA: Structured Reasoning in Critical Text Assessment for Peer Review and Beyond9 Sep 2024
- 2024Improving Large Language Model (LLM) fidelity through context-aware grounding: A systematic approach to reliability and veracity7 Aug 2024
- 2024HelloBench: Evaluating Long Text Generation Capabilities of Large Language Modelscited by 42
- 2025Integrating LLMs with ITS: Recent Advances, Potentials, Challenges, and Future Directionscited by 23
- 2025LExT: Towards Evaluating Trustworthiness of Natural Language Explanationscited by 9
- 2024Improving Large Language Model (LLM) fidelity through context-aware grounding: A systematic approach to reliability and veracitycited by 8
- 2024Hallucination in Multimodal Foundation Models: A Survey on Causes, Corrections, and Evaluationscited by 8
- 2024Guarding the Gate: ConceptGuard Battles Concept-Level Backdoors in Concept Bottleneck Modelscited by 3
- 2025Localizing Persona Representations in LLMscited by 3
- 2025A Comprehensive Review on Harnessing Large Language Models to Overcome Recommender System Challengescited by 3
- 2026In Transformer We Trust? A Perspective on Transformer Architecture Failure Modescited by 1
- 2024From Prohibition to Adoption: How Hong Kong Universities Are Navigating ChatGPT in Academic Workflowscited by 0
- 2026When AI Writes, Whose Voice Remains? Quantifying Cultural Marker Erasure Across World English Varieties in Large Language Modelscited by 0
- 2026Adversarial Moral Stress Testing of Large Language Modelscited by 0
12 most cited of 15 All 15 (JSON)
- 2026LAAF: A Layered Accountability Architecture Framework for LLM Applications27 Aug 2026
- 2026Physiological Noise Augmentation Improves Non-Invasive Brain-to-Speech6 Jul 2026
- 2026Vibe Medicine: Redefining Biomedical Research Through Human-AI Co-Work26 Apr 2026
- 2026Adversarial Moral Stress Testing of Large Language Models1 Apr 2026
- 2026When AI Writes, Whose Voice Remains? Quantifying Cultural Marker Erasure Across World English Varieties in Large Language Models25 Feb 2026
- 2026In Transformer We Trust? A Perspective on Transformer Architecture Failure Modes15 Feb 2026
- 2025A Comprehensive Review on Harnessing Large Language Models to Overcome Recommender System Challenges17 Jul 2025
- 2025Localizing Persona Representations in LLMs30 May 2025
- 2025LExT: Towards Evaluating Trustworthiness of Natural Language Explanations8 Apr 2025
- 2025Integrating LLMs with ITS: Recent Advances, Potentials, Challenges, and Future Directions8 Jan 2025
- 2024Guarding the Gate: ConceptGuard Battles Concept-Level Backdoors in Concept Bottleneck Models25 Nov 2024
- 2024Hallucination in Multimodal Foundation Models: A Survey on Causes, Corrections, and Evaluations20 Oct 2024
12 newest of 15 All 15 (JSON)