The Design and Composition of Structural Causal Decision Processes
Not on the map. Why?
Abstract (arXiv)
We present two new classes of causal models of decision-making agents. Our approach is motivated by the needs of modeling the economics of computing systems. These systems are composed of subsystems and can exhibit endogenous limits on cognitive resources and value discounting. Structural Causal Decision Models (SCDMs) expand on Structural Causal Influence Models. Like SCIMs, they explicitly represent the causal relationships between model variables and the payoffs of agent decisions. Additionally, agent decisions can be constrained by their causal antecedents, and SCDMs can have open root variables for which no probability distribution or structural equation is given. We show that SCDMs have a well-defined and computationally useful property of composability. Building on SCDMs, we then define a Structural Causal Decision Process (SCDP) as a recurring SCDM with a discount variable. SCDPs benefit from the useful composition properties of SCDMs. Moreover, SCDPs are strictly more expressive than POMDPs because they do not assume rational belief formation. Indeed, an SCDP can endogenously model the memory-formation process, and is thus useful for modeling resource rational agents in dynamic settings. SCDPs are also capable of modeling variable discounting, a tool used widely in social scientific modeling. We pose that SCDPs are a useful framework for policy simulation for the digital economy, mechanism design for information systems, and digital twin modeling of cyberinfrastructure.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 12 of its 57 references that are in the map. First posted on arXiv 4 May 2026.
Builds on
12 of 57 references.
References · 12
- 2019Reward Tampering Problems and Solutions in Reinforcement Learning: A Causal Influence Diagram Perspectivecited by 108
- 2024Robust agents learn causal world modelscited by 81
- 2021Agent Incentives: A Causal Perspectivecited by 51
- 2019Causal Modeling for Fairness in Dynamical Systemscited by 47
- 2022Compositional Learning of Dynamical System Models Using Port-Hamiltonian Neural Networkscited by 18
- 2013A Probabilistic Calculus of Actionscited by 14
- 2020Causal Multi-Level Fairnesscited by 14
- 2023Neurosymbolic Grounding for Compositional World Modelscited by 14
- 2021Equilibrium Refinements for Multi-Agent Influence Diagrams: Theory and Practicecited by 9
- 2025Resource Rational Contractualism Should Guide AI Alignmentcited by 8
- 2022A Complete Criterion for Value of Information in Soluble Influence Diagramscited by 5
- 2025Modeling Unseen Environments with Language-guided Composable Causal Components in Reinforcement Learningcited by 4
Built on by
Not cited yet.