mlsanityData to 14 Oct 2026

Dynamic Treatment on Networks

arXiv 2605.06564 ↗First posted 7 May 2026stat.ML cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

In networks, effective dynamic treatment allocation requires deciding both whom to treat and also when, so as to amplify policy impact through spillovers. An early intervention at a well-connected node can trigger cascades that change which nodes are worth targeting in the next period. Existing treatment strategies under network interference are largely static while dynamic treatment frameworks typically ignore network structure altogether. We integrate these perspectives and propose Q-Ising, a three-stage pipeline that (i) estimates network adoption dynamics via a Bayesian dynamic Ising model from a single observed panel, (ii) augments treatment adoption histories with continuous posterior latent states, and (iii) learns a dynamic policy via offline reinforcement learning. The Bayesian mechanism enables uncertainty quantification over dynamic decisions, yielding posterior ensemble policies with interpretable spillover estimates. We provide a finite-sample regret upper bound that decomposes into standard offline-RL uncertainty, network abstraction error, and first stage error in Ising state estimation. We apply our method to data from Indian village microfinance networks and synthetic stochastic block models under simulated heterogeneous susceptible-infected-susceptible (SIS) dynamics and demonstrate that adaptive targeting outperforms static centrality benchmarks.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 14 of its 46 references that are in the map. First posted on arXiv 7 May 2026.

Builds on

14 of 46 references.

References · 14

  1. 2020Offline Reinforcement Learning: Tutorial, Review, and Perspectives on Open Problemscited by 1,920
  2. 2020Conservative Q-Learning for Offline Reinforcement Learningcited by 1,809
  3. 2020Is Pessimism Provably Efficient for Offline RL?cited by 364
  4. 2021d3rlpy: An Offline Deep Reinforcement Learning Librarycited by 84
  5. 2020Collapsing Bandits and Their Application to Public Health Interventionscited by 47
  6. 2020Controlling Graph Dynamics with Reinforcement Learning and Graph Neural Networkscited by 30
  7. 2015Influence Maximization with Banditscited by 12
  8. 2019Policy Targeting under Network Interferencecited by 12
  9. 2020Fair Policy Targetingcited by 12
  10. 2022Networked Restless Multi-Armed Bandits for Mobile Interventionscited by 7
  11. 2022Networked Restless Bandits with Positive Externalitiescited by 5
  12. 2024Influence Maximization via Graph Neural Banditscited by 4
2 more
  1. 2025Scalable Policy Maximization Under Network Interferencecited by 3
  2. 2025Optimal Targeting in Dynamic Systemscited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025POLAR: A Pessimistic Model-based Policy Learning Algorithm for Dynamic Treatment Regimes
  2. 2026Network World Models as Environments for Algorithm Design on Complex Systems
  3. 2023A Data-Driven State Aggregation Approach for Dynamic Discrete Choice Models
  4. 2024Context in Public Health for Underserved Communities: A Bayesian Approach to Online Restless Bandits
  5. 2023Robust Fitted-Q-Evaluation and Iteration under Sequentially Exogenous Unobserved Confounders
  6. 2025A Graphical Approach to State Variable Selection in Off-policy Learning
  7. 2022GraMeR: Graph Meta Reinforcement Learning for Multi-Objective Influence Maximization
  8. 2024Adaptive Network Intervention for Complex Systems: A Hierarchical Graph Reinforcement Learning Approach