mlsanityData to 14 Oct 2026

Causality Is Key to Understand and Balance Multiple Goals in Trustworthy ML and Foundation Models

arXiv 2502.21123 ↗First posted 28 Feb 2025cs.LG cs.AIcited by 2

Not on the map. Why?

Abstract (arXiv)

Ensuring trustworthiness in machine learning (ML) systems is crucial as they become increasingly embedded in high-stakes domains. This paper advocates for integrating causal methods into machine learning to navigate the trade-offs among key principles of trustworthy ML, including fairness, privacy, robustness, accuracy, and explainability. While these objectives should ideally be satisfied simultaneously, they are often addressed in isolation, leading to conflicts and suboptimal solutions. Drawing on existing applications of causality in ML that successfully align goals such as fairness and accuracy or privacy and robustness, this paper argues that a causal approach is essential for balancing multiple competing objectives in both trustworthy ML and foundation models. Beyond highlighting these trade-offs, we examine how causality can be practically integrated into ML and foundation models, offering solutions to enhance their reliability and interpretability. Finally, we discuss the challenges, limitations, and opportunities in adopting causal frameworks, paving the way for more accountable and ethically sound AI systems.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 95 of its 187 references that are in the map. First posted on arXiv 28 Feb 2025.

Builds on

95 of 187 references.

References · 95

  1. 2023GPT-4 Technical Reportcited by 18,396
  2. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  3. 2014Explaining and Harnessing Adversarial Examplescited by 7,364
  4. 2013Intriguing properties of neural networkscited by 5,155
  5. 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 4,057
  6. 2019Benchmarking Neural Network Robustness to Common Corruptions and Perturbationscited by 2,877
  7. 2023A Survey of Large Language Modelscited by 2,576
  8. 2019Do ImageNet Classifiers Generalize to ImageNet?cited by 1,515
  9. 2017Towards A Rigorous Science of Interpretable Machine Learningcited by 1,416
  10. 2019Can You Trust Your Model's Uncertainty? Evaluating Predictive Uncertainty Under Dataset Shiftcited by 1,287
  11. 2017Counterfactual Explanations without Opening the Black Box: Automated Decisions and the GDPRcited by 1,089
  12. 2019Deep Leakage from Gradientscited by 1,021
38 more
  1. 2022Toy Models of Superpositioncited by 971
  2. 2024WorldSimBench: Towards Video Generation Models as World Simulatorscited by 881
  3. 2017Counterfactual Fairnesscited by 804
  4. 2023Towards Automated Circuit Discovery for Mechanistic Interpretabilitycited by 724
  5. 2016The Mythos of Model Interpretabilitycited by 721
  6. 2014Certifying and removing disparate impactcited by 715
  7. 2020Inverting Gradients -- How easy is it to break privacy in federated learning?cited by 712
  8. 2016Fairness Beyond Disparate Treatment & Disparate Impact: Learning Classification without Disparate Mistreatmentcited by 369
  9. 2023Causal Reasoning and Large Language Models: Opening a New Frontier for Causalitycited by 353
  10. 2018Understanding disentangling in β-VAEcited by 335
  11. 2019Differential Privacy Has Disparate Impact on Model Accuracycited by 316
  12. 2013Direct and Indirect Effectscited by 280
  13. 2020Algorithmic Recourse: from Counterfactual Explanations to Interventionscited by 250
  14. 2019Causality for Machine Learningcited by 243
  15. 2020Measuring and Reducing Gendered Correlations in Pre-trained Modelscited by 224
  16. 2023Attribution Patching Outperforms Automated Circuit Discoverycited by 209
  17. 2023Causal Abstraction: A Theoretical Foundation for Mechanistic Interpretabilitycited by 205
  18. 2019Model-Agnostic Counterfactual Explanations for Consequential Decisionscited by 204
  19. 2020Representation Learning via Invariant Causal Mechanismscited by 199
  20. 2017Avoiding Discrimination through Causal Reasoningcited by 194
  21. 2018Path-Specific Counterfactual Fairnesscited by 181
  22. 2025Open Problems in Mechanistic Interpretabilitycited by 179
  23. 2017Fair Inference On Outcomescited by 144
  24. 2019Inherent Tradeoffs in Learning Fair Representationscited by 144
  25. 2023The Impact of Large Language Models on Scientific Discovery: a Preliminary Study using GPT-4cited by 112
  26. 2022Causal Machine Learning: A Survey and Open Problemscited by 110
  27. 2021Debiasing Pre-trained Contextualised Embeddingscited by 107
  28. 2023A Mechanistic Interpretation of Arithmetic Reasoning in Language Models using Causal Mediation Analysiscited by 89
  29. 2024Robust agents learn causal world modelscited by 81
  30. 2024On the Origins of Linear Representations in Large Language Modelscited by 79
  31. 2019PC-Fairness: A Unified Framework for Measuring Causality-based Fairnesscited by 67
  32. 2023Towards Vision-Language Mechanistic Interpretability: A Causal Tracing Tool for BLIPcited by 62
  33. 2020Identifying Spurious Correlations for Robust Text Classificationcited by 59
  34. 2019Fair Decision Making using Privacy-Protected Datacited by 58
  35. 2018Causal Reasoning for Algorithmic Fairnesscited by 51
  36. 2024A Mechanistic Analysis of a Transformer Trained on a Symbolic Multi-Step Reasoning Taskcited by 49
  37. 2015On the relation between accuracy and fairness in binary classificationcited by 48
  38. 2022Robustness Implies Privacy in Statistical Estimationcited by 47

50 most cited of 95 All 95 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 2.

2 papers.