Trustworthy AI Suffers from Invariance Conflicts and Causality is The Solution
Not on the map. Why?
Abstract (arXiv)
As artificial intelligence (AI), including machine learning (ML) models and foundation models (FMs), are increasingly deployed in high-stakes domains, ensuring their trustworthiness has become a central challenge. However, the core trustworthy AI objectives, such as fairness, robustness, privacy, and explainability, are hard to achieve simultaneously, especially while preserving utility. This position paper argues that causality is necessary to understand and balance trade-offs in performance and multiple objectives of trustworthy AI. We ground our arguments in re-interpreting trustworthy AI trade-offs as incompatible invariance requirements under different changes to the data-generating process. We then illustrate this argument through case-study analyses from the literature and a stylized synthetic-data simulation, showing that causality provides a unifying framework for understanding how trade-offs in trustworthy AI arise and how they can be softened or resolved through selective invariance. This perspective applies to both classical ML models and large-scale FMs. Finally, we outline open challenges and opportunities for using causality to build both trustworthy and high-performing AI.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 51 of its 90 references that are in the map. First posted on arXiv 4 May 2026.
Builds on
51 of 90 references.
References · 51
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
- 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 3,972
- 2017Counterfactual Explanations without Opening the Black Box: Automated Decisions and the GDPRcited by 1,086
- 2020Concept Bottleneck Modelscited by 1,022
- 2018Challenging Common Assumptions in the Unsupervised Learning of Disentangled Representationscited by 929
- 2022Toy Models of Superpositioncited by 928
- 2018Robustness May Be at Odds with Accuracycited by 873
- 2023Towards Automated Circuit Discovery for Mechanistic Interpretabilitycited by 700
- 2023Causal Reasoning and Large Language Models: Opening a New Frontier for Causalitycited by 348
- 2020The Risks of Invariant Risk Minimizationcited by 262
- 2020Algorithmic Recourse: from Counterfactual Explanations to Interventionscited by 250
- 2020Measuring and Reducing Gendered Correlations in Pre-trained Modelscited by 222
38 more
- 2023Attribution Patching Outperforms Automated Circuit Discoverycited by 196
- 2023Causal Abstraction: A Theoretical Foundation for Mechanistic Interpretabilitycited by 194
- 2017Avoiding Discrimination through Causal Reasoningcited by 191
- 2018Path-Specific Counterfactual Fairnesscited by 179
- 2019Inherent Tradeoffs in Learning Fair Representationscited by 144
- 2023The Impact of Large Language Models on Scientific Discovery: a Preliminary Study using GPT-4cited by 112
- 2021Debiasing Pre-trained Contextualised Embeddingscited by 107
- 2022Causal Machine Learning: A Survey and Open Problemscited by 107
- 2024Robust agents learn causal world modelscited by 81
- 2024On the Origins of Linear Representations in Large Language Modelscited by 76
- 2020Identifying Spurious Correlations for Robust Text Classificationcited by 59
- 2019Fair Decision Making using Privacy-Protected Datacited by 58
- 2018Causal Reasoning for Algorithmic Fairnesscited by 51
- 2024A Mechanistic Analysis of a Transformer Trained on a Symbolic Multi-Step Reasoning Taskcited by 49
- 2015On the relation between accuracy and fairness in binary classificationcited by 47
- 2015A fast PC algorithm for high dimensional causal discovery with multi-core PCscited by 45
- 2020Counterfactual Fairness with Disentangled Causal Effect Variational Autoencodercited by 45
- 2024Interpreting Attention Layer Outputs with Sparse Autoencoderscited by 43
- 2023Auxiliary Losses for Learning Generalizable Concept-based Modelscited by 35
- 2021EXplainable Neural-Symbolic Learning (X-NeSyL) methodology to fuse deep learning representations with expert knowledge graphs: the MonuMAI cultural heritage use casecited by 30
- 2023Towards Trustworthy and Aligned Machine Learning: A Data-centric Survey with Causality Perspectivescited by 30
- 2022DISCO: Distilling Counterfactuals with Large Language Modelscited by 29
- 2024Learning Interpretable Concepts: Unifying Causal Representation Learning and Foundation Modelscited by 29
- 2024ALCM: Autonomous LLM-Augmented Causal Discovery Frameworkcited by 29
- 2017Causal Generative Neural Networkscited by 24
- 2023A Causal View of Entity Bias in (Large) Language Modelscited by 21
- 2022Counterfactual Fairness with Partially Known Causal Graphcited by 20
- 2019Alleviating Privacy Attacks via Causal Learningcited by 19
- 2023A Review of the Role of Causality in Developing Trustworthy AI Systemscited by 14
- 2023Revisiting the Performance-Explainability Trade-Off in Explainable Artificial Intelligence (XAI)cited by 10
- 2024C2P: Featuring Large Language Models with Causal Reasoningcited by 8
- 2024LLM4GRN: Discovering Causal Gene Regulatory Networks with LLMs -- Evaluation through Synthetic Data Generationcited by 7
- 2023CFL: Causally Fair Language Models Through Token-level Attribute Controlled Generationcited by 6
- 2024Evaluating Interventional Reasoning Capabilities of Large Language Modelscited by 6
- 2024Context-Aware Reasoning On Parametric Knowledge for Inferring Causal Variablescited by 6
- 2022Towards a Data Privacy-Predictive Performance Trade-offcited by 5
- 2023Causal Discovery Under Local Privacycited by 3
- 2025From Guess2Graph: When and How Can Unreliable Experts Safely Boost Causal Discovery in Finite Samples?cited by 3
50 most cited of 51 All 51 (JSON)
Built on by
Citing papers per year: 2026: 1.
1 paper.