mlsanityData to 14 Oct 2026

On the Trustworthiness of Generative Foundation Models: Guideline, Assessment, and Perspective

arXiv 2502.14296 ↗First posted 20 Feb 2025cs.CYcited by 41

Not on the map. Why?

Abstract (arXiv)

Generative Foundation Models (GenFMs) have emerged as transformative tools. However, their widespread adoption raises critical concerns regarding trustworthiness across dimensions. This paper presents a comprehensive framework to address these challenges through three key contributions. First, we systematically review global AI governance laws and policies from governments and regulatory bodies, as well as industry practices and standards. Based on this analysis, we propose a set of guiding principles for GenFMs, developed through extensive multidisciplinary collaboration that integrates technical, ethical, legal, and societal perspectives. Second, we introduce TrustGen, the first dynamic benchmarking platform designed to evaluate trustworthiness across multiple dimensions and model types, including text-to-image, large language, and vision-language models. TrustGen leverages modular components--metadata curation, test case generation, and contextual variation--to enable adaptive and iterative assessments, overcoming the limitations of static evaluation methods. Using TrustGen, we reveal significant progress in trustworthiness while identifying persistent challenges. Finally, we provide an in-depth discussion of the challenges and future directions for trustworthy GenFMs, which reveals the complex, evolving nature of trustworthiness, highlighting the nuanced trade-offs between utility and trustworthiness, and consideration for various downstream applications, identifying persistent challenges and providing a strategic roadmap for future research. This work establishes a holistic framework for advancing trustworthiness in GenAI, paving the way for safer and more responsible integration of GenFMs into critical applications. To facilitate advancement in the community, we release the toolkit for dynamic evaluation.

Key facts. Cited by 41 papers in the map (data through 14 Oct 2026). First posted on arXiv 20 Feb 2025.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 28; 2026: 13.

41 papers.

Sort:

By area:

  1. 2025A Comprehensive Survey in LLM(-Agent) Full Stack Safety: Data, Training and Deploymentcited by 116
  2. 2025One Token to Fool LLM-as-a-Judgecited by 60
  3. 2025Recent Advances in Large Langauge Model Benchmarks against Data Contamination: From Static to Dynamic Evaluationcited by 38
  4. 2025Building a Foundational Guardrail for General Agentic Systems via Synthetic Datacited by 29
  5. 2025ManipLVM-R1: Reinforcement Learning for Reasoning in Embodied Manipulation with Large Vision-Language Modelscited by 27
  6. 2025FaithCoT-Bench: Benchmarking Instance-Level Faithfulness of Chain-of-Thought Reasoningcited by 26
  7. 2025LangCoop: Collaborative Driving with Languagecited by 25
  8. 2025Audio Jailbreak: An Open Comprehensive Benchmark for Jailbreaking Large Audio-Language Modelscited by 21
  9. 2025Why LLM Safety Guardrails Collapse After Fine-tuning: A Similarity Analysis Between Alignment and Fine-tuning Datasetscited by 20
  10. 2025HumaniBench: A Human-Centric Framework for Large Multimodal Models Evaluationcited by 19
  11. 2025Dissecting Logical Reasoning in LLMs: A Fine-Grained Evaluation and Supervision Studycited by 17
  12. 2026ToolGate: Contract-Grounded and Verified Tool Execution for LLMscited by 15
29 more
  1. 2025SocialMaze: A Benchmark for Evaluating and Enhancing Social Reasoning in Large Language Models in Complex Social Environmentscited by 11
  2. 2025Privacy Reasoning in Ambiguous Contextscited by 11
  3. 2025Beyond Surface-Level Patterns: An Essence-Driven Defense Framework Against Jailbreak Attacks in LLMscited by 9
  4. 2026ProbeLLM: Automating Principled Diagnosis of LLM Failurescited by 9
  5. 2025Privacy-Aware Decoding: Mitigating Privacy Leakage of Large Language Models in Retrieval-Augmented Generationcited by 8
  6. 2025Beyond Accuracy: The Role of Calibration in Self-Improving Large Language Modelscited by 7
  7. 2025Generative AI for Autonomous Driving: Frontiers and Opportunitiescited by 7
  8. 2025Discovering Knowledge Deficiencies of Language Models on Massive Knowledge Basecited by 6
  9. 2025SUV: Scalable Large Language Model Copyright Compliance with Regularized Selective Unlearningcited by 5
  10. 2025Are We on the Right Way for Assessing Document Retrieval-Augmented Generation?cited by 5
  11. 2025Secure and Robust Watermarking for AI-generated Images: A Comprehensive Surveycited by 5
  12. 2025Cache Mechanism for Agent RAG Systemscited by 5
  13. 2026Emergent Risks in Generative Multi-Agent Systemscited by 5
  14. 2025Improving Large Language Models Function Calling and Interpretability via Guided-Structured Templatescited by 4
  15. 2026Detecting Unfaithful Chain-of-Thought via Circuit-Guided Internal-External Discrepancycited by 3
  16. 2025The Role of Open-Source LLMs in Shaping the Future of GeoAIcited by 2
  17. 2025SafeCoop: Unravelling Full Stack Safety in Agentic Collaborative Drivingcited by 2
  18. 2026Diagnosing and Repairing Unsafe Channels in Vision-Language Models via Causal Discovery and Dual-Modal Safety Subspace Projectioncited by 2
  19. 2025Leveraging Importance Sampling to Detach Alignment Modules from Large Language Modelscited by 1
  20. 2025When Personalization Tricks Detectors: The Feature-Inversion Trap in Machine-Generated Text Detectioncited by 1
  21. 2026Uncertainty-Aware Distribution-to-Distribution Flow Matching for Scientific Imagingcited by 1
  22. 2026Guardian-as-an-Advisor: Advancing Next-Generation Guardian Models for Trustworthy LLMscited by 1
  23. 2025Towards provable probabilistic safety for scalable embodied AI systemscited by 0
  24. 2026Fact-Checking with Large Language Models via Probabilistic Certainty and Consistencycited by 0
  25. 2026Alignment Risks from Capability-Seeking RL Trainingcited by 0
  26. 2026On Understanding, Identifying, and Mitigating Vulnerabilities in Agentic Large Language Modelscited by 0
  27. 2026A Proposal for an Agentic AI Architecture to Support Multi-Domain Decision-Making in the Brazilian Armed Forcescited by 0
  28. 2026SSP-Bench: A Hybrid Data Generation Framework for Safety, Security, and Privacy Evaluationcited by 0
  29. 2026VEX-Bench: Benchmarking Verification Complexity of LLM-Generated Misinformationcited by 0