Dyadic Reinforcement Learning
Not on the map. Why?
Abstract (arXiv)
Mobile health aims to enhance health outcomes by delivering interventions to individuals as they go about their daily life. The involvement of care partners and social support networks often proves crucial in helping individuals managing burdensome medical conditions. This presents opportunities in mobile health to design interventions that target the dyadic relationship -- the relationship between a target person and their care partner -- with the aim of enhancing social support. In this paper, we develop dyadic RL, an online reinforcement learning algorithm designed to personalize intervention delivery based on contextual factors and past responses of a target person and their care partner. Here, multiple sets of interventions impact the dyad across multiple time intervals. The developed dyadic RL is Bayesian and hierarchical. We formally introduce the problem setup, develop dyadic RL and establish a regret bound. We demonstrate dyadic RL's empirical performance through simulation studies on both toy scenarios and on a realistic test bed constructed from data collected in a mobile health study.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 30 of its 74 references that are in the map. First posted on arXiv 15 Aug 2023.
Builds on
30 of 74 references.
References · 30
- 2017Minimax Regret Bounds for Reinforcement Learningcited by 503
- 2018Data-Efficient Hierarchical Reinforcement Learningcited by 455
- 2017A Tutorial on Thompson Samplingcited by 433
- 2017FeUdal Networks for Hierarchical Reinforcement Learningcited by 337
- 2016Hierarchical Deep Reinforcement Learning: Integrating Temporal Abstraction and Intrinsic Motivationcited by 286
- 2015Contextual Markov Decision Processescited by 220
- 2017Unifying PAC and Regret: Uniform PAC Bounds for Episodic Reinforcement Learningcited by 176
- 2017Stochastic Neural Networks for Hierarchical Reinforcement Learningcited by 124
- 2014Generalization and Exploration via Randomized Value Functionscited by 112
- 2017A Laplacian Framework for Option Discovery in Reinforcement Learningcited by 110
- 2019Frequentist Regret Bounds for Randomized Least-Squares Value Iterationcited by 101
- 2017Learning Invariant Feature Spaces to Transfer Skills with Reinforcement Learningcited by 85
18 more
- 2019Personalized HeartSteps: A Reinforcement Learning Algorithm for Optimizing Physical Activitycited by 70
- 2019Worst-Case Regret Bounds for Exploration via Randomized Value Functionscited by 57
- 2022Contextualize Me -- The Case for Context in Reinforcement Learningcited by 46
- 2018Hierarchical Reinforcement Learning for Zero-shot Generalization with Subtask Dependenciescited by 43
- 2019Hierarchical Reinforcement Learning with Advantage-Based Auxiliary Rewardscited by 40
- 2016A Reinforcement Learning System to Encourage Physical Activity in Diabetes Patientscited by 38
- 2022Designing Reinforcement Learning Algorithms for Digital Interventions: Pre-implementation Guidelinescited by 22
- 2021CARL: A Benchmark for Contextual and Adaptive Reinforcement Learningcited by 21
- 2019Influence maximization in unknown social networks: Learning Policies for Effective Graph Samplingcited by 20
- 2020Improved Worst-Case Regret Bounds for Randomized Least-Squares Value Iterationcited by 19
- 2022Reward Design For An Online Reinforcement Learning Algorithm Supporting Oral Self-Carecited by 18
- 2021Contingency-Aware Influence Maximization: A Reinforcement Learning Approachcited by 13
- 2016Using Social Networks to Aid Homeless Shelters: Dynamic Influence Maximization under Uncertainty - An Extended Versioncited by 9
- 2021CLAIM: Curriculum Learning Policy for Influence Maximization in Unknown Social Networkscited by 7
- 2021Globally Optimal Hierarchical Reinforcement Learning for Linearly-Solvable Markov Decision Processescited by 6
- 2023Did we personalize? Assessing personalization by an online reinforcement learning algorithm using resamplingcited by 6
- 2020Rapidly Personalizing Mobile Health Treatment Policies with Limited Datacited by 4
- 2019Influence Maximization for Social Good: Use of Social Networks in Low Resource Communitiescited by 1
Built on by
Citing papers per year: 2025: 1.
1 paper.