A Framework for Effective AI Recommendations in Cyber-Physical-Human Systems
Not on the map. Why?
Abstract (arXiv)
Many cyber-physical-human systems (CPHS) involve a human decision-maker who may receive recommendations from an artificial intelligence (AI) platform while holding the ultimate responsibility of making decisions. In such CPHS applications, the human decision-maker may depart from an optimal recommended decision and instead implement a different one for various reasons. In this letter, we develop a rigorous framework to overcome this challenge. In our framework, we consider that humans may deviate from AI recommendations as they perceive and interpret the system's state in a different way than the AI platform. We establish the structural properties of optimal recommendation strategies and develop an approximate human model (AHM) used by the AI. We provide theoretical bounds on the optimality gap that arises from an AHM and illustrate the efficacy of our results in a numerical example.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 12 of its 25 references that are in the map. First posted on arXiv 8 Mar 2024.
Builds on
12 of 25 references.
References · 12
- 2019On the Utility of Learning about Humans for Human-AI Coordinationcited by 345
- 2020Approximate information state for approximate planning and reinforcement learning in partially observed systemscited by 67
- 2022The Best Decisions Are Not the Best Advice: Making Adherence-Aware Recommendationscited by 16
- 2023Learning to Make Adherence-Aware Advicecited by 13
- 2021On Team Decision Problems with Nonclassical Information Structurescited by 10
- 2021Separation of Learning and Control for Cyber-Physical Systemscited by 8
- 2023Connected and Automated Vehicles in Mixed-Traffic: Learning Human Driver Behavior for Effective On-Ramp Mergingcited by 7
- 2020Social Media and Misleading Information in a Democracy: A Mechanism Design Approachcited by 5
- 2023A Q-learning Approach for Adherence-Aware Recommendationscited by 4
- 2023Worst-Case Control and Learning Using Partial Observations Over an Infinite Time-Horizoncited by 3
- 2022Human Behavioral Models Using Utility Theory and Prospect Theorycited by 1
- 2023Routing in Mixed Transportation Systems for Mobility Equitycited by 1
Built on by
Citing papers per year: 2025: 3; 2026: 1.
4 papers.
- 2025AI Recommendation Systems for Lane-Changing Using Adherence-Aware Reinforcement Learningcited by 3
- 2025Off-Policy Evaluation for Sequential Persuasion Process with Unobserved Confoundingcited by 1
- 2025Model-Based Reinforcement Learning Under Confoundingcited by 1
- 2026Cross-fitted Proximal Learning for Model-Based Reinforcement Learningcited by 0
- 2026Cross-fitted Proximal Learning for Model-Based Reinforcement Learning6 Apr 2026
- 2025Model-Based Reinforcement Learning Under Confounding8 Dec 2025
- 2025AI Recommendation Systems for Lane-Changing Using Adherence-Aware Reinforcement Learning28 Apr 2025
- 2025Off-Policy Evaluation for Sequential Persuasion Process with Unobserved Confounding1 Apr 2025