mlsanityData to 7 Oct 2026

Towards Trustworthy AI: A Review of Ethical and Robust Large Language Models

arXiv 2407.13934 ↗First posted 1 Jun 2024cs.CY cs.AIcited by 21

Not on the map. Why?

Abstract (arXiv)

The rapid progress in Large Language Models (LLMs) could transform many fields, but their fast development creates significant challenges for oversight, ethical creation, and building user trust. This comprehensive review looks at key trust issues in LLMs, such as unintended harms, lack of transparency, vulnerability to attacks, alignment with human values, and environmental impact. Many obstacles can undermine user trust, including societal biases, opaque decision-making, potential for misuse, and the challenges of rapidly evolving technology. Addressing these trust gaps is critical as LLMs become more common in sensitive areas like finance, healthcare, education, and policy. To tackle these issues, we suggest combining ethical oversight, industry accountability, regulation, and public involvement. AI development norms should be reshaped, incentives aligned, and ethics integrated throughout the machine learning process, which requires close collaboration across technology, ethics, law, policy, and other fields. Our review contributes a robust framework to assess trust in LLMs and analyzes the complex trust dynamics in depth. We provide contextualized guidelines and standards for responsibly developing and deploying these powerful AI systems. This review identifies key limitations and challenges in creating trustworthy AI. By addressing these issues, we aim to build a transparent, accountable AI ecosystem that benefits society while minimizing risks. Our findings provide valuable guidance for researchers, policymakers, and industry leaders striving to establish trust in LLMs and ensure they are used responsibly across various applications for the good of society.

Key facts. Cited by 21 papers in the map (data through 7 Oct 2026). Builds on 101 of its 258 references that are in the map. First posted on arXiv 1 Jun 2024.

Builds on

101 of 258 references.

References · 101

  1. 2023GPT-4 Technical Reportcited by 18,132
  2. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
  3. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,916
  4. 2016"Why Should I Trust You?": Explaining the Predictions of Any Classifiercited by 5,040
  5. 2021On the Opportunities and Risks of Foundation Modelscited by 3,961
  6. 2022Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedbackcited by 3,634
  7. 2017Axiomatic Attribution for Deep Networkscited by 3,350
  8. 2022Constitutional AI: Harmlessness from AI Feedbackcited by 2,950
  9. 2023Universal and Transferable Adversarial Attacks on Aligned Language Modelscited by 2,914
  10. 2017Interpretability Beyond Feature Attribution: Quantitative Testing with Concept Activation Vectors (TCAV)cited by 1,309
  11. 2023A Survey on Evaluation of Large Language Modelscited by 1,227
  12. 2023Language Models Don't Always Say What They Think: Unfaithful Explanations in Chain-of-Thought Promptingcited by 1,081
38 more
  1. 2018Model Cards for Model Reportingcited by 1,068
  2. 2022Large Language Models Are Human-Level Prompt Engineerscited by 1,020
  3. 2021Ethical and social risks of harm from Language Modelscited by 957
  4. 2019Attention is not Explanationcited by 916
  5. 2023Open Problems and Fundamental Limitations of Reinforcement Learning from Human Feedbackcited by 743
  6. 2022Red Teaming Language Models to Reduce Harms: Methods, Scaling Behaviors, and Lessons Learnedcited by 702
  7. 2023A Watermark for Large Language Modelscited by 667
  8. 2023RLAIF vs. RLHF: Scaling Reinforcement Learning from Human Feedback with AI Feedbackcited by 615
  9. 2023DecodingTrust: A Comprehensive Assessment of Trustworthiness in GPT Modelscited by 505
  10. 2019What do you learn from context? Probing for sentence structure in contextualized word representationscited by 436
  11. 2017Efficient Processing of Deep Neural Networks: A Tutorial and Surveycited by 427
  12. 2020A Survey of Convolutional Neural Networks: Analysis, Applications, and Prospectscited by 396
  13. 2023Trustworthy LLMs: a Survey and Guideline for Evaluating Large Language Models' Alignmentcited by 394
  14. 2020Closing the AI Accountability Gap: Defining an End-to-End Framework for Internal Algorithmic Auditingcited by 380
  15. 2023A Survey on Large Language Model (LLM) Security and Privacy: The Good, the Bad, and the Uglycited by 380
  16. 2020Fairness in Machine Learning: A Surveycited by 369
  17. 2023Explainability for Large Language Models: A Surveycited by 331
  18. 2023Reasoning on Graphs: Faithful and Interpretable Large Language Model Reasoningcited by 326
  19. 2019Theoretical Limitations of Self-Attention in Neural Sequence Modelscited by 286
  20. 2024TrustLLM: Trustworthiness in Large Language Modelscited by 280
  21. 2018Improving fairness in machine learning systems: What do industry practitioners need?cited by 262
  22. 2023Evaluating Large Language Models: A Comprehensive Surveycited by 200
  23. 2024ArtPrompt: ASCII Art-based Jailbreak Attacks against Aligned LLMscited by 197
  24. 2023Survey of Vulnerabilities in Large Language Models Revealed by Adversarial Attackscited by 189
  25. 2023Gender bias and stereotypes in Large Language Modelscited by 185
  26. 2023LoRA Fine-tuning Efficiently Undoes Safety Training in Llama 2-Chat 70Bcited by 183
  27. 2024Security and Privacy Challenges of Large Language Models: A Surveycited by 179
  28. 2023GPTs are GPTs: An Early Look at the Labor Market Impact Potential of Large Language Modelscited by 174
  29. 2023Beyond Memorization: Violating Privacy Via Inference with Large Language Modelscited by 167
  30. 2023A Survey of Large Language Models for Healthcare: from Data, Technology, and Applications to Accountability and Ethicscited by 162
  31. 2020Adversarial Filters of Dataset Biasescited by 159
  32. 2024The pitfalls of next-token predictioncited by 156
  33. 2020Model-Based Deep Learningcited by 136
  34. 2023Auditing large language models: a three-layered approachcited by 135
  35. 2019Principles alone cannot guarantee ethical AIcited by 134
  36. 2019The Ethics of AI Ethics -- An Evaluation of Guidelinescited by 129
  37. 2023The Science of Detecting LLM-Generated Textscited by 126
  38. 2023AI Transparency in the Age of LLMs: A Human-Centered Research Roadmapcited by 119

50 most cited of 101 All 101 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 8; 2025: 6; 2026: 7.

21 papers.

Sort:

By area:

  1. 2024HelloBench: Evaluating Long Text Generation Capabilities of Large Language Modelscited by 42
  2. 2025Integrating LLMs with ITS: Recent Advances, Potentials, Challenges, and Future Directionscited by 23
  3. 2025Alignment and Safety in Large Language Models: Safety Mechanisms, Training Paradigms, and Emerging Challengescited by 14
  4. 2025LExT: Towards Evaluating Trustworthiness of Natural Language Explanationscited by 9
  5. 2024Improving Large Language Model (LLM) fidelity through context-aware grounding: A systematic approach to reliability and veracitycited by 8
  6. 2024Hallucination in Multimodal Foundation Models: A Survey on Causes, Corrections, and Evaluationscited by 8
  7. 2025Agentic Services Computingcited by 6
  8. 2024STRICTA: Structured Reasoning in Critical Text Assessment for Peer Review and Beyondcited by 5
  9. 2024Guarding the Gate: ConceptGuard Battles Concept-Level Backdoors in Concept Bottleneck Modelscited by 3
  10. 2025Localizing Persona Representations in LLMscited by 3
  11. 2025A Comprehensive Review on Harnessing Large Language Models to Overcome Recommender System Challengescited by 3
  12. 2026In Transformer We Trust? A Perspective on Transformer Architecture Failure Modescited by 1
9 more
  1. 2024From Prohibition to Adoption: How Hong Kong Universities Are Navigating ChatGPT in Academic Workflowscited by 0
  2. 2024Standardization Trends on Safety and Trustworthiness Technology for Advanced AIcited by 0
  3. 2024Collaborative Participatory Research with LLM Agents in South Asia: An Empirically-Grounded Methodological Initiative and Agenda from Field Evidence in Sri Lankacited by 0
  4. 2026When AI Writes, Whose Voice Remains? Quantifying Cultural Marker Erasure Across World English Varieties in Large Language Modelscited by 0
  5. 2026Adversarial Moral Stress Testing of Large Language Modelscited by 0
  6. 2026Vibe Medicine: Redefining Biomedical Research Through Human-AI Co-Workcited by 0
  7. 2026A Multi-Dimensional Audit of Politically Aligned Large Language Modelscited by 0
  8. 2026Physiological Noise Augmentation Improves Non-Invasive Brain-to-Speechcited by 0
  9. 2026LAAF: A Layered Accountability Architecture Framework for LLM Applicationscited by 0