Causality Is Key to Understand and Balance Multiple Goals in Trustworthy ML and Foundation Models
Not on the map. Why?
Abstract (arXiv)
Ensuring trustworthiness in machine learning (ML) systems is crucial as they become increasingly embedded in high-stakes domains. This paper advocates for integrating causal methods into machine learning to navigate the trade-offs among key principles of trustworthy ML, including fairness, privacy, robustness, accuracy, and explainability. While these objectives should ideally be satisfied simultaneously, they are often addressed in isolation, leading to conflicts and suboptimal solutions. Drawing on existing applications of causality in ML that successfully align goals such as fairness and accuracy or privacy and robustness, this paper argues that a causal approach is essential for balancing multiple competing objectives in both trustworthy ML and foundation models. Beyond highlighting these trade-offs, we examine how causality can be practically integrated into ML and foundation models, offering solutions to enhance their reliability and interpretability. Finally, we discuss the challenges, limitations, and opportunities in adopting causal frameworks, paving the way for more accountable and ethically sound AI systems.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 95 of its 187 references that are in the map. First posted on arXiv 28 Feb 2025.
Builds on
95 of 187 references.
References · 95
- 2023GPT-4 Technical Reportcited by 18,396
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
- 2014Explaining and Harnessing Adversarial Examplescited by 7,364
- 2013Intriguing properties of neural networkscited by 5,155
- 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 4,057
- 2019Benchmarking Neural Network Robustness to Common Corruptions and Perturbationscited by 2,877
- 2023A Survey of Large Language Modelscited by 2,576
- 2019Do ImageNet Classifiers Generalize to ImageNet?cited by 1,515
- 2017Towards A Rigorous Science of Interpretable Machine Learningcited by 1,416
- 2019Can You Trust Your Model's Uncertainty? Evaluating Predictive Uncertainty Under Dataset Shiftcited by 1,287
- 2017Counterfactual Explanations without Opening the Black Box: Automated Decisions and the GDPRcited by 1,089
- 2019Deep Leakage from Gradientscited by 1,021
38 more
- 2022Toy Models of Superpositioncited by 971
- 2024WorldSimBench: Towards Video Generation Models as World Simulatorscited by 881
- 2017Counterfactual Fairnesscited by 804
- 2023Towards Automated Circuit Discovery for Mechanistic Interpretabilitycited by 724
- 2016The Mythos of Model Interpretabilitycited by 721
- 2014Certifying and removing disparate impactcited by 715
- 2020Inverting Gradients -- How easy is it to break privacy in federated learning?cited by 712
- 2016Fairness Beyond Disparate Treatment & Disparate Impact: Learning Classification without Disparate Mistreatmentcited by 369
- 2023Causal Reasoning and Large Language Models: Opening a New Frontier for Causalitycited by 353
- 2018Understanding disentangling in β-VAEcited by 335
- 2019Differential Privacy Has Disparate Impact on Model Accuracycited by 316
- 2013Direct and Indirect Effectscited by 280
- 2020Algorithmic Recourse: from Counterfactual Explanations to Interventionscited by 250
- 2019Causality for Machine Learningcited by 243
- 2020Measuring and Reducing Gendered Correlations in Pre-trained Modelscited by 224
- 2023Attribution Patching Outperforms Automated Circuit Discoverycited by 209
- 2023Causal Abstraction: A Theoretical Foundation for Mechanistic Interpretabilitycited by 205
- 2019Model-Agnostic Counterfactual Explanations for Consequential Decisionscited by 204
- 2020Representation Learning via Invariant Causal Mechanismscited by 199
- 2017Avoiding Discrimination through Causal Reasoningcited by 194
- 2018Path-Specific Counterfactual Fairnesscited by 181
- 2025Open Problems in Mechanistic Interpretabilitycited by 179
- 2017Fair Inference On Outcomescited by 144
- 2019Inherent Tradeoffs in Learning Fair Representationscited by 144
- 2023The Impact of Large Language Models on Scientific Discovery: a Preliminary Study using GPT-4cited by 112
- 2022Causal Machine Learning: A Survey and Open Problemscited by 110
- 2021Debiasing Pre-trained Contextualised Embeddingscited by 107
- 2023A Mechanistic Interpretation of Arithmetic Reasoning in Language Models using Causal Mediation Analysiscited by 89
- 2024Robust agents learn causal world modelscited by 81
- 2024On the Origins of Linear Representations in Large Language Modelscited by 79
- 2019PC-Fairness: A Unified Framework for Measuring Causality-based Fairnesscited by 67
- 2023Towards Vision-Language Mechanistic Interpretability: A Causal Tracing Tool for BLIPcited by 62
- 2020Identifying Spurious Correlations for Robust Text Classificationcited by 59
- 2019Fair Decision Making using Privacy-Protected Datacited by 58
- 2018Causal Reasoning for Algorithmic Fairnesscited by 51
- 2024A Mechanistic Analysis of a Transformer Trained on a Symbolic Multi-Step Reasoning Taskcited by 49
- 2015On the relation between accuracy and fairness in binary classificationcited by 48
- 2022Robustness Implies Privacy in Statistical Estimationcited by 47
50 most cited of 95 All 95 (JSON)
Built on by
Citing papers per year: 2026: 2.
2 papers.