# Words to Describe What I'm Feeling: Exploring the Potential of AI Agents for High Subjectivity Decisions in Advance Care Planning

arXiv: https://arxiv.org/abs/2512.11276 · HTML: https://mlsanity.com/paper/2512.11276/

## Key facts

- No citing papers in the map yet (data through 14 Oct 2026).
- Builds on 16 of its 93 references that are in the map.
- First posted on arXiv 12 Dec 2025.

## Builds on (most cited first, 16 of 16)

- [WhisperX: Time-Accurate Speech Transcription of Long-Form Audio](https://mlsanity.com/paper/2303.00747/) (2023)
- [MindfulDiary: Harnessing Large Language Model to Support Psychiatric Patients' Journaling](https://mlsanity.com/paper/2310.05231/) (2023)
- [Towards Human-AI Deliberation: Design and Evaluation of LLM-Empowered Deliberative AI for AI-Assisted Decision-Making](https://mlsanity.com/paper/2403.16812/) (2024)
- [Human-AI Collaboration: The Effect of AI Delegation on Human Task Performance and Task Satisfaction](https://mlsanity.com/paper/2303.09224/) (2023)
- [The Typing Cure: Experiences with Large Language Model Chatbots for Mental Health Support](https://mlsanity.com/paper/2401.14362/) (2024)
- [MindScape Study: Integrating LLM and Behavioral Sensing for Personalized AI-Driven Journaling Experiences](https://mlsanity.com/paper/2409.09570/) (2024)
- [Generative Ghosts: Anticipating Benefits and Risks of AI Afterlives](https://mlsanity.com/paper/2402.01662/) (2024)
- [In AI We Trust? Factors That Influence Trustworthiness of AI-infused Decision-Making Processes](https://mlsanity.com/paper/1912.02675/) (2019)
- [A Matter of Perspective(s): Contrasting Human and LLM Argumentation in Subjective Decision-Making on Subtle Sexism](https://mlsanity.com/paper/2502.14052/) (2025)
- [Letters from Future Self: Augmenting the Letter-Exchange Exercise with LLM-based Agents to Enhance Young Adults' Career Exploration](https://mlsanity.com/paper/2502.18881/) (2025)
- [Do Expressions Change Decisions? Exploring the Impact of AI's Explanation Tone on Decision-Making](https://mlsanity.com/paper/2502.19730/) (2025)
- [Coaching Copilot: Blended Form of an LLM-Powered Chatbot and a Human Coach to Effectively Support Self-Reflection for Leadership Growth](https://mlsanity.com/paper/2405.15250/) (2024)
- [Human Delegation Behavior in Human-AI Collaboration: The Effect of Contextual Information](https://mlsanity.com/paper/2401.04729/) (2024)
- [ExploreSelf: Fostering User-driven Exploration and Reflection on Personal Challenges with Adaptive Guidance by Large Language Models](https://mlsanity.com/paper/2409.09662/) (2024)
- [Towards Understanding Emotions for Engaged Mental Health Conversations](https://mlsanity.com/paper/2406.11135/) (2024)
- [PreCare: Designing AI Assistants for Advance Care Planning (ACP) to Enhance Personal Value Exploration, Patient Knowledge, and Decisional Confidence](https://mlsanity.com/paper/2505.09115/) (2025)

## Abstract (arXiv)

Loss of decisional capacity, coupled with the increasing absence of reliable human proxies, raises urgent questions about how individuals' values can be represented in Advance Care Planning (ACP). To probe this fraught design space of high-risk, high-subjectivity decision support, we built an experience prototype (acpagent) and asked 15 participants in 4 workshops to train it to be their personal ACP proxy. We analysed their coping strategies and feature requests and mapped the results onto axes of agent autonomy and human control. Our findings show a surprising 86.7% agreement with acpagent, arguing for a potential new role of AI in ACP where agents act as personal advocates for individuals, building mutual intelligibility over time. We propose that the key areas of future risk that must be addressed are the moderation of users' expectations and designing accountability and oversight over agent deployment and cutoffs.