Causal models in string diagrams
On the map: LLM reasoning → Causal reasoning in LLMs
Abstract (arXiv)
The framework of causal models provides a principled approach to causal reasoning, applied today across many scientific domains. Here we present this framework in the language of string diagrams, interpreted formally using category theory. A class of string diagrams, called network diagrams, are in 1-to-1 correspondence with directed acyclic graphs. A causal model is given by such a diagram with its components interpreted as stochastic maps, functions, or general channels in a symmetric monoidal category with a 'copy-discard' structure (cd-category), turning a model into a single mathematical object that can be reasoned with intuitively and yet rigorously. Building on prior works by Fong and Jacobs, Kissinger and Zanasi, as well as Fritz and Klingler, we present diagrammatic definitions of causal models and functional causal models in a cd-category, generalising causal Bayesian networks and structural causal models, respectively. We formalise general interventions on a model, including but beyond do-interventions, and present the natural notion of an open causal model with inputs. We also give an approach to conditioning based on a normalisation box, allowing for causal inference calculations to be done fully diagrammatically. We define counterfactuals in this setup, and treat the problems of the identifiability of causal effects and counterfactuals fully diagrammatically. The benefits of such a presentation of causal models lie in foundational questions in causal reasoning and in their clarificatory role and pedagogical value. This work aims to be accessible to different communities, from causal model practitioners to researchers in applied category theory, and discusses many examples from the literature for illustration. Overall, we argue and demonstrate that causal reasoning according to the causal model framework is most naturally and intuitively done as diagrammatic reasoning.
Key facts. Cited by 14 papers in the map (data through 14 Oct 2026). Placed in Causal reasoning in LLMs, one of 17 directions in LLM reasoning. Builds on 32 of its 115 references that are in the map. First posted on arXiv 15 Apr 2023.
Builds on
32 of 115 references.
References · 32
- 2018Challenging Common Assumptions in the Unsupervised Learning of Disentangled Representationscited by 941
- 2019Causality for Machine Learningcited by 243
- 2020Weakly-Supervised Disentanglement Without Compromisescited by 239
- 2020Representation Learning via Invariant Causal Mechanismscited by 199
- 2019A Meta-Transfer Objective for Learning to Disentangle Causal Mechanismscited by 158
- 2022Weakly supervised causal representation learningcited by 140
- 2022CITRIS: Causal Identifiability from Temporal Intervened Sequencescited by 133
- 2021Desiderata for Representation Learning: A Causal Perspectivecited by 76
- 2020Weakly Supervised Disentangled Generative Causal Representation Learningcited by 68
- 2013Causal Networks: Semantics and Expressivenesscited by 67
- 2018Theoretical Impediments to Machine Learning With Seven Sparks from the Causal Revolutioncited by 66
- 2014Visual Causal Feature Learningcited by 59
20 more
- 2019Causal Reasoning from Meta-reinforcement Learningcited by 53
- 2022From Statistical to Causal Learningcited by 40
- 2021Nested Counterfactual Identification from Arbitrary Surrogate Experimentscited by 38
- 2021Category Theory in Machine Learningcited by 36
- 2021Compositional Abstraction Error and a Category of Causal Modelscited by 33
- 2017Markov Properties for Graphical Models with Cycles and Latent Variablescited by 32
- 2015Multi-Level Cause-Effect Systemscited by 30
- 2022D'ARTAGNAN: Counterfactual Video Generationcited by 28
- 2016Unsupervised Discovery of El Nino Using Causal Feature Learning on Microlevel Climate Datacited by 20
- 2019Causal Calculus in the Presence of Cycles, Latent Confounders and Selection Biascited by 17
- 2020Amortized learning of neural causal representationscited by 14
- 2022The d-separation criterion in Categorical Probabilitycited by 12
- 2017Independently Controllable Featurescited by 11
- 2020Structure by Architecture: Structured Representations without Regularizationcited by 10
- 2022Towards a Grounded Theory of Causation for Embodied AIcited by 9
- 2022Phenomenological Causalitycited by 7
- 2022Free gs-monoidal categories and free Markov categoriescited by 6
- 2021Learning from What's Right and Learning from What's Wrongcited by 5
- 2022A Mathematical Framework for Transformations of Physical Processescited by 2
- 2021Causality in Higher Order Process Theoriescited by 1
Built on by
Citing papers per year: 2023: 1; 2024: 6; 2025: 3; 2026: 4.
14 papers.
Sort:
By area:
- 2024Towards Compositional Interpretability for XAIcited by 12
- 2024A Pattern Language for Machine Learning Taskscited by 4
- 2023Active Inference in String Diagrams: A Categorical Account of Predictive Processing and Free Energycited by 3
- 2024On the Anatomy of Attentioncited by 3
- 2025An Algebraic Approach to Moralisation and Triangulation of Probabilistic Graphical Modelscited by 1
- 2026Notes on Forr'e's Notion of Conditional Independence and Causal Calculus for Continuous Variablescited by 1
- 2026From Mechanistic to Compositional Interpretabilitycited by 1
- 2024Everything that can be learned about a causal structure with latent variables by observational and interventional probing schemescited by 0
- 2024A Quantum-Inspired Analysis of Human Disambiguation Processescited by 0
- 2024A Diagrammatic Approach to Improve Computational Efficiency in Group Equivariant Neural Networkscited by 0
- 2025Causal Models for Growing Networkscited by 0
- 2025Bayesian Networks, Markov Networks, Moralisation, Triangulation: a Categorical Perspectivecited by 0
- 2026Towards unsupervised representation learning for quantum data: quantum models with inference and generation31 Aug 2026
- 2026Graphical Design of Interpretable Architectures19 Aug 2026
- 2026From Mechanistic to Compositional Interpretability9 May 2026
- 2026Notes on Forr'e's Notion of Conditional Independence and Causal Calculus for Continuous Variables25 Mar 2026
- 2025Bayesian Networks, Markov Networks, Moralisation, Triangulation: a Categorical Perspective10 Dec 2025
- 2025Causal Models for Growing Networks1 Apr 2025
- 2025An Algebraic Approach to Moralisation and Triangulation of Probabilistic Graphical Models14 Mar 2025
- 2024A Diagrammatic Approach to Improve Computational Efficiency in Group Equivariant Neural Networks14 Dec 2024
- 2024A Quantum-Inspired Analysis of Human Disambiguation Processes14 Aug 2024
- 2024A Pattern Language for Machine Learning Tasks2 Jul 2024
- 2024On the Anatomy of Attention2 Jul 2024
- 2024Everything that can be learned about a causal structure with latent variables by observational and interventional probing schemes1 Jul 2024
- 2026From Mechanistic to Compositional Interpretabilitycited by 1
- 2026From Mechanistic to Compositional Interpretability9 May 2026
- 2024Towards Compositional Interpretability for XAIcited by 12
- 2024A Pattern Language for Machine Learning Taskscited by 4
- 2023Active Inference in String Diagrams: A Categorical Account of Predictive Processing and Free Energycited by 3
- 2024On the Anatomy of Attentioncited by 3
- 2025An Algebraic Approach to Moralisation and Triangulation of Probabilistic Graphical Modelscited by 1
- 2026Notes on Forr'e's Notion of Conditional Independence and Causal Calculus for Continuous Variablescited by 1
- 2024Everything that can be learned about a causal structure with latent variables by observational and interventional probing schemescited by 0
- 2024A Quantum-Inspired Analysis of Human Disambiguation Processescited by 0
- 2024A Diagrammatic Approach to Improve Computational Efficiency in Group Equivariant Neural Networkscited by 0
- 2025Causal Models for Growing Networkscited by 0
- 2025Bayesian Networks, Markov Networks, Moralisation, Triangulation: a Categorical Perspectivecited by 0
- 2026Graphical Design of Interpretable Architecturescited by 0
12 most cited of 13 All 13 (JSON)
- 2026Towards unsupervised representation learning for quantum data: quantum models with inference and generation31 Aug 2026
- 2026Graphical Design of Interpretable Architectures19 Aug 2026
- 2026Notes on Forr'e's Notion of Conditional Independence and Causal Calculus for Continuous Variables25 Mar 2026
- 2025Bayesian Networks, Markov Networks, Moralisation, Triangulation: a Categorical Perspective10 Dec 2025
- 2025Causal Models for Growing Networks1 Apr 2025
- 2025An Algebraic Approach to Moralisation and Triangulation of Probabilistic Graphical Models14 Mar 2025
- 2024A Diagrammatic Approach to Improve Computational Efficiency in Group Equivariant Neural Networks14 Dec 2024
- 2024A Quantum-Inspired Analysis of Human Disambiguation Processes14 Aug 2024
- 2024A Pattern Language for Machine Learning Tasks2 Jul 2024
- 2024On the Anatomy of Attention2 Jul 2024
- 2024Everything that can be learned about a causal structure with latent variables by observational and interventional probing schemes1 Jul 2024
- 2024Towards Compositional Interpretability for XAI25 Jun 2024
12 newest of 13 All 13 (JSON)
Similar, not cited
Close in wording, no citation either way
- 2022Markov categories, causal theories, and the do-calculus
- 2025Causal Abstractions, Categorically Unified
- 2024CLEAR: Can Language Models Really Understand Causal Graphs?
- 2025HOLOGRAPH: Active Causal Discovery via Sheaf-Theoretic Alignment of Large Language Model Priors
- 2025Temporal Causal Reasoning with (Non-Recursive) Structural Equation Models
- 2024CausalGraph2LLM: Evaluating LLMs for Causal Queries
- 2026Causal Reasoning with Bipartite Graphical Causal Models
- 2022Relational Causal Models with Cycles:Representation and Reasoning