Large Language Model Agents for Improving Engagement with Behavior Change Interventions: Application to Digital Mindfulness
On the map: LLM agents and tool use → Medical and scientific domain agents
Abstract (arXiv)
Although engagement in self-directed wellness exercises typically declines over time, integrating social support such as coaching can sustain it. However, traditional forms of support are often inaccessible due to the high costs and complex coordination. Large Language Models (LLMs) show promise in providing human-like dialogues that could emulate social support. Yet, in-depth, in situ investigations of LLMs to support behavior change remain underexplored. We conducted two randomized experiments to assess the impact of LLM agents on user engagement with mindfulness exercises. First, a single-session study, involved 502 crowdworkers; second, a three-week study, included 54 participants. We explored two types of LLM agents: one providing information and another facilitating self-reflection. Both agents enhanced users' intentions to practice mindfulness. However, only the information-providing LLM, featuring a friendly persona, significantly improved engagement with the exercises. Our findings suggest that specific LLM agents may bridge the social support gap in digital health interventions.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Placed in Medical and scientific domain agents, one of 16 directions in LLM agents and tool use. Builds on 29 of its 247 references that are in the map. First posted on arXiv 3 Jul 2024.
Builds on
29 of 247 references.
Closest ancestors · 2
Same direction, newest first
- 2023An Integrative Survey on Mental Health Conversational Agents to Bridge Computer Science and Medical Perspectives25 Oct
- 2023Understanding the Benefits and Challenges of Using Large Language Model-based Conversational Agents for Mental Well-being Support28 Jul
Other references · 27
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2023GPT-4 Technical Reportcited by 18,132
- 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,500
- 2022Large Language Models Encode Clinical Knowledgecited by 1,807
- 2023Towards Understanding Sycophancy in Language Modelscited by 988
- 2023MemoryBank: Enhancing Large Language Models with Long-Term Memorycited by 539
- 2024The Ethics of Advanced AI Assistantscited by 103
- 2023Bootstrap Your Own Skills: Learning to Solve New Tasks with Large Language Model Guidancecited by 85
- 2020Aligning Superhuman AI with Human Behavior: Chess as a Model Systemcited by 78
- 2023Cognitive Reframing of Negative Thoughts through Human-Language Model Interactioncited by 77
- 2023Unveiling Security, Privacy, and Ethical Concerns of ChatGPTcited by 53
- 2023Facilitating Self-Guided Mental Health Interventions Through Human-Language Model Interaction: A Case Study of Cognitive Restructuringcited by 53
15 more
- 2023MindfulDiary: Harnessing Large Language Model to Support Psychiatric Patients' Journalingcited by 50
- 2022How to Prompt? Opportunities and Challenges of Zero- and Few-Shot Learning for Human-AI Interaction in Creative Applications of Generative Modelscited by 43
- 2023Benefits and Harms of Large Language Models in Digital Mental Healthcited by 39
- 2023Comparing Traditional and LLM-based Search for Consumer Choice: A Randomized Experimentcited by 35
- 2024Supporting Self-Reflection at Scale with Large Language Models: Insights from Randomized Field Experiments in Classroomscited by 20
- 2023MindShift: Leveraging Large Language Models for Mental-States-Based Problematic Smartphone Use Interventioncited by 16
- 2024Multi-Level Feedback Generation with Large Language Models for Empowering Novice Peer Counselorscited by 16
- 2024Understanding the Impact of Long-Term Memory on Self-Disclosure with Large Language Model-Driven Chatbots for Public Health Interventioncited by 15
- 2024Evaluating the Experience of LGBTQ+ People Using Large Language Model Based Chatbots for Mental Health Supportcited by 14
- 2022Exploring The Design of Prompts For Applying GPT-3 based Chatbots: A Mental Wellbeing Case Study on Mechanical Turkcited by 13
- 2018Sounding Board: A User-Centric and Content-Driven Social Chatbotcited by 11
- 2022Mimetic Models: Ethical Implications of AI that Acts Like Youcited by 11
- 2024Coaching Copilot: Blended Form of an LLM-Powered Chatbot and a Human Coach to Effectively Support Self-Reflection for Leadership Growthcited by 7
- 2023Using Adaptive Bandit Experiments to Increase and Investigate Engagement in Mental Healthcited by 6
- 2022How can Email Interventions Increase Students' Completion of Online Homework? A Case Study Using A/B Comparisonscited by 2
Built on by
Citing papers per year: 2024: 1; 2025: 1; 2026: 1.
3 papers.
- 2024Persuasion with Large Language Models: A Survey of Empirical Evidence, Study Methodologies, and Ethical Implicationscited by 30
- 2025When AI Gives Advice: Evaluating AI and Human Responses to Online Advice-Seeking for Well-Beingcited by 3
- 2026MindfulAgents: Personalizing Mindfulness Meditation via an Expert-Aligned Multi-Agent Systemcited by 0
- 2026MindfulAgents: Personalizing Mindfulness Meditation via an Expert-Aligned Multi-Agent System6 Mar 2026
- 2025When AI Gives Advice: Evaluating AI and Human Responses to Online Advice-Seeking for Well-Being24 Oct 2025
- 2024Persuasion with Large Language Models: A Survey of Empirical Evidence, Study Methodologies, and Ethical Implications11 Nov 2024
Similar, not cited
Close in wording, no citation either way
- 2025Can we use LLMs to bootstrap reinforcement learning? -- A case study in digital health behavior change
- 2025Large Language Model-Powered Conversational Agent Delivering Problem-Solving Therapy (PST) for Family Caregivers: Enhancing Empathy and Therapeutic Alliance Using In-Context Learning
- 2024The influence of persona and conversational task on social interactions with a LLM-controlled embodied conversational agent
- 2026Aligning with Lived Experience: Heterogeneous Benefits of Fine Tuning in Mental Health Support Generation
- 2026Can Virtual Agents Care? Designing an Empathetic and Personalized LLM-Driven Conversational Agent
- 2025Investigating AI in Peer Support via Multi-Module System-Driven Embodied Conversational Agents
- 2024"I Like Sunnie More Than I Expected!": Exploring User Expectation and Perception of an Anthropomorphic LLM-based Conversational Agent for Well-Being Support
- 2026BALMS: Benchmarking Agentic LLMs for Longitudinal Mental Health Sensing