Transforming Wearable Data into Personal Health Insights using Large Language Model Agents
On the map: LLM reasoning → Clinical and biomedical applications
also in 1 more
Abstract (arXiv)
Deriving personalized insights from popular wearable trackers requires complex numerical reasoning that challenges standard LLMs, necessitating tool-based approaches like code generation. Large language model (LLM) agents present a promising yet largely untapped solution for this analysis at scale. We introduce the Personal Health Insights Agent (PHIA), a system leveraging multistep reasoning with code generation and information retrieval to analyze and interpret behavioral health data. To test its capabilities, we create and share two benchmark datasets with over 4000 health insights questions. A 650-hour human expert evaluation shows that PHIA significantly outperforms a strong code generation baseline, achieving 84% accuracy on objective, numerical questions and, for open-ended ones, earning 83% favorable ratings while being twice as likely to achieve the highest quality rating. This work can advance behavioral health by empowering individuals to understand their data, enabling a new era of accessible, personalized, and data-driven wellness for the wider population.
Key facts. Cited by 19 papers in the map (data through 7 Oct 2026). Placed in Clinical and biomedical applications, one of 17 directions in LLM reasoning. Builds on 32 of its 71 references that are in the map. First posted on arXiv 10 Jun 2024.
Builds on
32 of 71 references.
Closest ancestors · 3
Same direction, newest first
- 2024EHRAgent: Code Empowers Large Language Models for Few-shot Complex Tabular Reasoning on Electronic Health Records13 Jan
- 2023From Classification to Clinical Insights: Towards Analyzing and Reasoning About Mobile and Behavioral Health Data With Large Language Models21 Nov
- 2023LLM-CXR: Instruction-Finetuned LLM for CXR Image Understanding and Generation19 May
Other references · 29
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
- 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,193
- 2022Large Language Models Encode Clinical Knowledgecited by 1,807
- 2023The Rise and Potential of Large Language Model Based Agents: A Surveycited by 1,422
- 2023Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generationcited by 1,332
- 2023Cognitive Architectures for Language Agentscited by 422
- 2023Describe, Explain, Plan and Select: Interactive Planning with Large Language Models Enables Open-World Multi-Task Agentscited by 396
- 2023StructGPT: A General Framework for Large Language Model to Reason over Structured Datacited by 339
- 2023ToolQA: A Dataset for LLM Question Answering with External Toolscited by 273
- 2024Data Interpreter: An LLM Agent For Data Sciencecited by 222
- 2023Large Language Models are Versatile Decomposers: Decompose Evidence and Questions for Table-based Reasoningcited by 177
17 more
- 2024DS-Agent: Automated Data Science by Empowering Large Language Models with Case-Based Reasoningcited by 119
- 2023Towards Accurate Differential Diagnosis with Large Language Modelscited by 115
- 2022Natural Language to Code Generation in Interactive Data Science Notebookscited by 86
- 2023EduChat: A Large-Scale Language Model-based Chatbot System for Intelligent Educationcited by 80
- 2023Cognitive Reframing of Negative Thoughts through Human-Language Model Interactioncited by 77
- 2022Human-AI Collaboration Enables More Empathic Conversations in Text-based Peer-to-Peer Mental Health Supportcited by 68
- 2023Large Language Models to Identify Social Determinants of Health in Electronic Health Recordscited by 55
- 2023Facilitating Self-Guided Mental Health Interventions Through Human-Language Model Interaction: A Case Study of Cognitive Restructuringcited by 53
- 2024Large Language Model for Table Processing: A Surveycited by 52
- 2023The Capability of Large Language Models to Measure Psychiatric Functioningcited by 25
- 2024SheetAgent: Towards A Generalist Agent for Spreadsheet Reasoning and Manipulation via Large Language Modelscited by 16
- 2023Math Agents: Computational Infrastructure, Mathematical Embedding, and Genomicscited by 15
- 2022Sequential Models in the Synthetic Data Vaultcited by 12
- 2024IMBUE: Improving Interpersonal Effectiveness through Simulation and Just-in-time Feedback with Human-Language Model Interactioncited by 12
- 2024Mathify: Evaluating Large Language Models on Mathematical Problem Solving Taskscited by 12
- 2023Advancements in Federated Learning: Models, Methods, and Privacycited by 7
- 2020Activity River: Visualizing Planned and Logged Personal Activities for Reflectioncited by 2
Built on by
Citing papers per year: 2024: 4; 2025: 1; 2026: 14.
19 papers.
Sort:
By area:
- 2024What Are the Odds? Language Models Are Capable of Probabilistic Reasoningcited by 25
- 2025A Scalable Framework for Evaluating Health Language Modelscited by 11
- 2024LLaSA: A Sensor-Aware LLM for Natural Language Reasoning of Human Activity from IMU Datacited by 10
- 2026ComBodied Agents: a New Paradigm of Human-Centric Agentic AIcited by 4
- 2024Graph-Augmented LLMs for Personalized Health Insights: A Case Study in Sleep Analysiscited by 3
- 2026Wearable Foundation Models Should Go Beyond Static Encoderscited by 3
- 2026A Framework for Longitudinal Health AI Agentscited by 3
- 2024SleepCoT: A Lightweight Personalized Sleep Health Model via Chain-of-Thought Distillationcited by 1
- 2026Agentic AI in Healthcare & Medicine: A Seven-Dimensional Taxonomy for Empirical Evaluation of LLM-based Agentscited by 1
- 2026Query-Conditioned Graph Retrieval for Contextualized LLM Reasoning in Personalized Wearable Datacited by 1
- 2026A Self-Evolving Agent for Longitudinal Personal Health Managementcited by 1
- 2026The Cost of Language: Centroid Erasure Exposes and Exploits Modal Competition in Multimodal Language Modelscited by 0
7 more
- 2026Think Fast, Talk Smart: Partitioning Deterministic and Neural Computation for Structured Health Text Generationcited by 0
- 2026Personal Care Utility: Health as Everyday Infrastructurecited by 0
- 2026Enhancing Fitness Intelligence through Domain-Specific LLM Post-Trainingcited by 0
- 2026WearableQA: A Benchmark for Health Reasoning over Real-World Wearable Datacited by 0
- 2026LongAgent: History-Guided Agentic Search for Longitudinal Outcome Predictioncited by 0
- 2026Large language models in medical time series analysiscited by 0
- 2026Toward Personalized Sleep Guidance from Wearable Data Using Language Modelscited by 0
- 2026Toward Personalized Sleep Guidance from Wearable Data Using Language Models18 Sep 2026
- 2026LongAgent: History-Guided Agentic Search for Longitudinal Outcome Prediction14 Sep 2026
- 2026Large language models in medical time series analysis7 Sep 2026
- 2026WearableQA: A Benchmark for Health Reasoning over Real-World Wearable Data4 Sep 2026
- 2026ComBodied Agents: a New Paradigm of Human-Centric Agentic AI11 Aug 2026
- 2026A Self-Evolving Agent for Longitudinal Personal Health Management15 Jul 2026
- 2026Enhancing Fitness Intelligence through Domain-Specific LLM Post-Training2 Jul 2026
- 2026Personal Care Utility: Health as Everyday Infrastructure12 Jun 2026
- 2026Think Fast, Talk Smart: Partitioning Deterministic and Neural Computation for Structured Health Text Generation28 May 2026
- 2026The Cost of Language: Centroid Erasure Exposes and Exploits Modal Competition in Multimodal Language Models15 Apr 2026
- 2026A Framework for Longitudinal Health AI Agents13 Apr 2026
- 2026Query-Conditioned Graph Retrieval for Contextualized LLM Reasoning in Personalized Wearable Data10 Apr 2026
7 more
- 2026Wearable Foundation Models Should Go Beyond Static Encoders20 Mar 2026
- 2026Agentic AI in Healthcare & Medicine: A Seven-Dimensional Taxonomy for Empirical Evaluation of LLM-based Agents4 Feb 2026
- 2025A Scalable Framework for Evaluating Health Language Models30 Mar 2025
- 2024SleepCoT: A Lightweight Personalized Sleep Health Model via Chain-of-Thought Distillation22 Oct 2024
- 2024Graph-Augmented LLMs for Personalized Health Insights: A Case Study in Sleep Analysis24 Jun 2024
- 2024LLaSA: A Sensor-Aware LLM for Natural Language Reasoning of Human Activity from IMU Data20 Jun 2024
- 2024What Are the Odds? Language Models Are Capable of Probabilistic Reasoning18 Jun 2024
- 2024What Are the Odds? Language Models Are Capable of Probabilistic Reasoningcited by 25
- 2024LLaSA: A Sensor-Aware LLM for Natural Language Reasoning of Human Activity from IMU Datacited by 10
- 2024SleepCoT: A Lightweight Personalized Sleep Health Model via Chain-of-Thought Distillationcited by 1
- 2026Query-Conditioned Graph Retrieval for Contextualized LLM Reasoning in Personalized Wearable Datacited by 1
- 2026Think Fast, Talk Smart: Partitioning Deterministic and Neural Computation for Structured Health Text Generationcited by 0
- 2026WearableQA: A Benchmark for Health Reasoning over Real-World Wearable Datacited by 0
- 2026WearableQA: A Benchmark for Health Reasoning over Real-World Wearable Data4 Sep 2026
- 2026Think Fast, Talk Smart: Partitioning Deterministic and Neural Computation for Structured Health Text Generation28 May 2026
- 2026Query-Conditioned Graph Retrieval for Contextualized LLM Reasoning in Personalized Wearable Data10 Apr 2026
- 2024SleepCoT: A Lightweight Personalized Sleep Health Model via Chain-of-Thought Distillation22 Oct 2024
- 2024LLaSA: A Sensor-Aware LLM for Natural Language Reasoning of Human Activity from IMU Data20 Jun 2024
- 2024What Are the Odds? Language Models Are Capable of Probabilistic Reasoning18 Jun 2024
- 2025A Scalable Framework for Evaluating Health Language Modelscited by 11
- 2024Graph-Augmented LLMs for Personalized Health Insights: A Case Study in Sleep Analysiscited by 3
- 2026Wearable Foundation Models Should Go Beyond Static Encoderscited by 3
- 2026A Framework for Longitudinal Health AI Agentscited by 3
- 2026A Self-Evolving Agent for Longitudinal Personal Health Managementcited by 1
- 2026Personal Care Utility: Health as Everyday Infrastructurecited by 0
- 2026Enhancing Fitness Intelligence through Domain-Specific LLM Post-Trainingcited by 0
- 2026Large language models in medical time series analysiscited by 0
- 2026Toward Personalized Sleep Guidance from Wearable Data Using Language Modelscited by 0
- 2026Toward Personalized Sleep Guidance from Wearable Data Using Language Models18 Sep 2026
- 2026Large language models in medical time series analysis7 Sep 2026
- 2026A Self-Evolving Agent for Longitudinal Personal Health Management15 Jul 2026
- 2026Enhancing Fitness Intelligence through Domain-Specific LLM Post-Training2 Jul 2026
- 2026Personal Care Utility: Health as Everyday Infrastructure12 Jun 2026
- 2026A Framework for Longitudinal Health AI Agents13 Apr 2026
- 2026Wearable Foundation Models Should Go Beyond Static Encoders20 Mar 2026
- 2025A Scalable Framework for Evaluating Health Language Models30 Mar 2025
- 2024Graph-Augmented LLMs for Personalized Health Insights: A Case Study in Sleep Analysis24 Jun 2024
Similar, not cited
Close in wording, no citation either way
- 2025The Anatomy of a Personal Health Agent
- 2026A Task-Oriented Multi-Agent Framework for Complex Wearable Health Analysis
- 2026WEQA: Wearable hEalth Question Answering with Query-Adaptive Agentic Reasoning
- 2026LifeAgentBench: Benchmarking LLMs for Long-Horizon, Cross-Dimensional Lifestyle Health Reasoning
- 2026mind_call: A Dataset for Mental Health Function Calling with Large Language Models
- 2025SePA: A Search-enhanced Predictive Agent for Personalized Health Coaching
- 2026Designing Mobile and Wearable Sensor-Fused Conversational Agents for Health and Wellbeing ↗
- 2026A Multi-Agent LLM Framework for Personalized Health Checkup Interpretation and Guidance