mlsanityData to 14 Oct 2026

Inferring Causal Graph Temporal Logic Formulas to Expedite Reinforcement Learning in Temporally Extended Tasks

arXiv 2601.02666 ↗First posted 6 Jan 2026cs.AI cs.LOcited by 0

On the map: Deep reinforcement learning methods → Deep RL algorithms and representations

Abstract (arXiv)

Decision-making tasks often unfold on graphs with spatial-temporal dynamics. Black-box reinforcement learning often overlooks how local changes spread through network structure, limiting sample efficiency and interpretability. We present GTL-CIRL, a closed-loop framework that simultaneously learns policies and mines Causal Graph Temporal Logic (Causal GTL) specifications. The method shapes rewards with robustness, collects counterexamples when effects fail, and uses Gaussian Process (GP) driven Bayesian optimization to refine parameterized cause templates. The GP models capture spatial and temporal correlations in the system dynamics, enabling efficient exploration of complex parameter spaces. Case studies in gene and power networks show faster learning and clearer, verifiable behavior compared to standard RL baselines.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Deep RL algorithms and representations, one of 15 directions in Deep reinforcement learning methods. Builds on 2 of its 6 references that are in the map. First posted on arXiv 6 Jan 2026.

Builds on

2 of 6 references.

Closest ancestors · 1

Same direction, newest first

  1. 2025Expediting Reinforcement Learning by Incorporating Knowledge About Temporal Causality in the Environment17 Oct

Other references · 1

  1. 2020Policy Synthesis for Factored MDPs with Graph Temporal Logic Specificationscited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2022Generalizing Goal-Conditioned Reinforcement Learning with Variational Causal Reasoning
  2. 2025Causal Process Models: Reframing Dynamic Causal Graph Discovery as a Reinforcement Learning Problem
  3. 2026Temporal-Causal Inference for Reinforcement Learning via Automata Learning
  4. 2026CausalGDP: Causality-Guided Diffusion Policies for Reinforcement Learning
  5. 2025Causality Meets Locality: Provably Generalizable and Scalable Policy Learning for Networked Systems
  6. 2025Unifying Causal Reinforcement Learning: Survey, Taxonomy, Algorithms and Applications
  7. 2024Learning by Doing: An Online Causal Reinforcement Learning Framework with Causal-Aware Policy
  8. 2024Harnessing Causality in Reinforcement Learning With Bagged Decision Times