mlsanityData to 14 Oct 2026

An Identifiable Cost-Aware Causal Decision-Making Framework Using Counterfactual Reasoning

arXiv 2505.08343 ↗First posted 13 May 2025cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Decision making under abnormal conditions is a critical process that involves evaluating the current state and determining the optimal action to restore the system to a normal state at an acceptable cost. However, in such scenarios, existing decision-making frameworks highly rely on reinforcement learning or root cause analysis, resulting in them frequently neglecting the cost of the actions or failing to incorporate causal mechanisms adequately. By relaxing the existing causal decision framework to solve the necessary cause, we propose a minimum-cost causal decision (MiCCD) framework via counterfactual reasoning to address the above challenges. Emphasis is placed on making counterfactual reasoning processes identifiable in the presence of a large amount of mixed anomaly data, as well as finding the optimal intervention state in a continuous decision space. Specifically, it formulates a surrogate model based on causal graphs, using abnormal pattern clustering labels as supervisory signals. This enables the approximation of the structural causal model among the variables and lays a foundation for identifiable counterfactual reasoning. With the causal structure approximated, we then established an optimization model based on counterfactual estimation. The Sequential Least Squares Programming (SLSQP) algorithm is further employed to optimize intervention strategies while taking costs into account. Experimental evaluations on both synthetic and real-world datasets reveal that MiCCD outperforms conventional methods across multiple metrics, including F1-score, cost efficiency, and ranking quality(nDCG@k values), thus validating its efficacy and broad applicability.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 18 of its 45 references that are in the map. First posted on arXiv 13 May 2025.

Builds on

18 of 45 references.

References · 18

  1. 2017Proximal Policy Optimization Algorithmscited by 15,215
  2. 2018Soft Actor-Critic: Off-Policy Maximum Entropy Deep Reinforcement Learning with a Stochastic Actorcited by 4,885
  3. 2015Trust Region Policy Optimizationcited by 2,580
  4. 2020Conservative Q-Learning for Offline Reinforcement Learningcited by 1,809
  5. 2021Offline Reinforcement Learning with Implicit Q-Learningcited by 1,293
  6. 2018Challenging Common Assumptions in the Unsupervised Learning of Disentangled Representationscited by 941
  7. 2019Behavior Regularized Offline Reinforcement Learningcited by 662
  8. 2019Variational Autoencoders and Nonlinear ICA: A Unifying Frameworkcited by 503
  9. 2020Evaluation: from precision, recall and F-measure to ROC, informedness, markedness and correlationcited by 425
  10. 2019Causal structure based root cause analysis of outlierscited by 65
  11. 2018Visualizing the Feature Importance for Black Box Modelscited by 55
  12. 2023Root Cause Identification for Collective Anomalies in Time Series given an Acyclic Summary Causal Graph with Loopscited by 30
6 more
  1. 2024LEMMA-RCA: A Large Multi-modal Multi-domain Dataset for Root Cause Analysiscited by 9
  2. 2022Anomaly Attribution with Likelihood Compensationcited by 7
  3. 2022Sample-Specific Root Causal Inference with Latent Variablescited by 6
  4. 2022Automated machine learning: AI-driven decision making in business analyticscited by 5
  5. 2016pg-Causality: Identifying Spatiotemporal Causal Pathways for Air Pollutants with Urban Big Datacited by 3
  6. 2023Root Cause Explanation of Outliers under Noisy Mechanismscited by 3

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2022Causal Explanations for Sequential Decision Making Under Uncertainty
  2. 2025Executable Counterfactuals: Improving LLMs' Causal Reasoning Through Code
  3. 2024Counterfactual Effect Decomposition in Multi-Agent Sequential Decision Making
  4. 2025A Graphical Approach to State Variable Selection in Off-policy Learning
  5. 2025Beyond the Known: Decision Making with Counterfactual Reasoning Decision Transformer
  6. 2026An Introduction to Causal Reinforcement Learning
  7. 2025Unifying Causal Reinforcement Learning: Survey, Taxonomy, Algorithms and Applications
  8. 2024Semi-supervised Anomaly Detection via Adaptive Reinforcement Learning-Enabled Method with Causal Inference for Sensor Signals