mlsanityData to 7 Oct 2026

Trustworthy AI Suffers from Invariance Conflicts and Causality is The Solution

arXiv 2605.02640 ↗First posted 4 May 2026cs.AIcited by 1

Not on the map. Why?

Abstract (arXiv)

As artificial intelligence (AI), including machine learning (ML) models and foundation models (FMs), are increasingly deployed in high-stakes domains, ensuring their trustworthiness has become a central challenge. However, the core trustworthy AI objectives, such as fairness, robustness, privacy, and explainability, are hard to achieve simultaneously, especially while preserving utility. This position paper argues that causality is necessary to understand and balance trade-offs in performance and multiple objectives of trustworthy AI. We ground our arguments in re-interpreting trustworthy AI trade-offs as incompatible invariance requirements under different changes to the data-generating process. We then illustrate this argument through case-study analyses from the literature and a stylized synthetic-data simulation, showing that causality provides a unifying framework for understanding how trade-offs in trustworthy AI arise and how they can be softened or resolved through selective invariance. This perspective applies to both classical ML models and large-scale FMs. Finally, we outline open challenges and opportunities for using causality to build both trustworthy and high-performing AI.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 51 of its 90 references that are in the map. First posted on arXiv 4 May 2026.

Builds on

51 of 90 references.

References · 51

  1. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  2. 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 3,972
  3. 2017Counterfactual Explanations without Opening the Black Box: Automated Decisions and the GDPRcited by 1,086
  4. 2020Concept Bottleneck Modelscited by 1,022
  5. 2018Challenging Common Assumptions in the Unsupervised Learning of Disentangled Representationscited by 929
  6. 2022Toy Models of Superpositioncited by 928
  7. 2018Robustness May Be at Odds with Accuracycited by 873
  8. 2023Towards Automated Circuit Discovery for Mechanistic Interpretabilitycited by 700
  9. 2023Causal Reasoning and Large Language Models: Opening a New Frontier for Causalitycited by 348
  10. 2020The Risks of Invariant Risk Minimizationcited by 262
  11. 2020Algorithmic Recourse: from Counterfactual Explanations to Interventionscited by 250
  12. 2020Measuring and Reducing Gendered Correlations in Pre-trained Modelscited by 222
38 more
  1. 2023Attribution Patching Outperforms Automated Circuit Discoverycited by 196
  2. 2023Causal Abstraction: A Theoretical Foundation for Mechanistic Interpretabilitycited by 194
  3. 2017Avoiding Discrimination through Causal Reasoningcited by 191
  4. 2018Path-Specific Counterfactual Fairnesscited by 179
  5. 2019Inherent Tradeoffs in Learning Fair Representationscited by 144
  6. 2023The Impact of Large Language Models on Scientific Discovery: a Preliminary Study using GPT-4cited by 112
  7. 2021Debiasing Pre-trained Contextualised Embeddingscited by 107
  8. 2022Causal Machine Learning: A Survey and Open Problemscited by 107
  9. 2024Robust agents learn causal world modelscited by 81
  10. 2024On the Origins of Linear Representations in Large Language Modelscited by 76
  11. 2020Identifying Spurious Correlations for Robust Text Classificationcited by 59
  12. 2019Fair Decision Making using Privacy-Protected Datacited by 58
  13. 2018Causal Reasoning for Algorithmic Fairnesscited by 51
  14. 2024A Mechanistic Analysis of a Transformer Trained on a Symbolic Multi-Step Reasoning Taskcited by 49
  15. 2015On the relation between accuracy and fairness in binary classificationcited by 47
  16. 2015A fast PC algorithm for high dimensional causal discovery with multi-core PCscited by 45
  17. 2020Counterfactual Fairness with Disentangled Causal Effect Variational Autoencodercited by 45
  18. 2024Interpreting Attention Layer Outputs with Sparse Autoencoderscited by 43
  19. 2023Auxiliary Losses for Learning Generalizable Concept-based Modelscited by 35
  20. 2021EXplainable Neural-Symbolic Learning (X-NeSyL) methodology to fuse deep learning representations with expert knowledge graphs: the MonuMAI cultural heritage use casecited by 30
  21. 2023Towards Trustworthy and Aligned Machine Learning: A Data-centric Survey with Causality Perspectivescited by 30
  22. 2022DISCO: Distilling Counterfactuals with Large Language Modelscited by 29
  23. 2024Learning Interpretable Concepts: Unifying Causal Representation Learning and Foundation Modelscited by 29
  24. 2024ALCM: Autonomous LLM-Augmented Causal Discovery Frameworkcited by 29
  25. 2017Causal Generative Neural Networkscited by 24
  26. 2023A Causal View of Entity Bias in (Large) Language Modelscited by 21
  27. 2022Counterfactual Fairness with Partially Known Causal Graphcited by 20
  28. 2019Alleviating Privacy Attacks via Causal Learningcited by 19
  29. 2023A Review of the Role of Causality in Developing Trustworthy AI Systemscited by 14
  30. 2023Revisiting the Performance-Explainability Trade-Off in Explainable Artificial Intelligence (XAI)cited by 10
  31. 2024C2P: Featuring Large Language Models with Causal Reasoningcited by 8
  32. 2024LLM4GRN: Discovering Causal Gene Regulatory Networks with LLMs -- Evaluation through Synthetic Data Generationcited by 7
  33. 2023CFL: Causally Fair Language Models Through Token-level Attribute Controlled Generationcited by 6
  34. 2024Evaluating Interventional Reasoning Capabilities of Large Language Modelscited by 6
  35. 2024Context-Aware Reasoning On Parametric Knowledge for Inferring Causal Variablescited by 6
  36. 2022Towards a Data Privacy-Predictive Performance Trade-offcited by 5
  37. 2023Causal Discovery Under Local Privacycited by 3
  38. 2025From Guess2Graph: When and How Can Unreliable Experts Safely Boost Causal Discovery in Finite Samples?cited by 3

50 most cited of 51 All 51 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.