mlsanityData to 7 Oct 2026

Transforming Wearable Data into Personal Health Insights using Large Language Model Agents

arXiv 2406.06464 ↗First posted 10 Jun 2024cs.AI cs.CLcited by 19

On the map: LLM reasoning → Clinical and biomedical applications

also in 1 more
Abstract (arXiv)

Deriving personalized insights from popular wearable trackers requires complex numerical reasoning that challenges standard LLMs, necessitating tool-based approaches like code generation. Large language model (LLM) agents present a promising yet largely untapped solution for this analysis at scale. We introduce the Personal Health Insights Agent (PHIA), a system leveraging multistep reasoning with code generation and information retrieval to analyze and interpret behavioral health data. To test its capabilities, we create and share two benchmark datasets with over 4000 health insights questions. A 650-hour human expert evaluation shows that PHIA significantly outperforms a strong code generation baseline, achieving 84% accuracy on objective, numerical questions and, for open-ended ones, earning 83% favorable ratings while being twice as likely to achieve the highest quality rating. This work can advance behavioral health by empowering individuals to understand their data, enabling a new era of accessible, personalized, and data-driven wellness for the wider population.

Key facts. Cited by 19 papers in the map (data through 7 Oct 2026). Placed in Clinical and biomedical applications, one of 17 directions in LLM reasoning. Builds on 32 of its 71 references that are in the map. First posted on arXiv 10 Jun 2024.

Builds on

32 of 71 references.

Closest ancestors · 3

Same direction, newest first

  1. 2024EHRAgent: Code Empowers Large Language Models for Few-shot Complex Tabular Reasoning on Electronic Health Records13 Jan
  2. 2023From Classification to Clinical Insights: Towards Analyzing and Reasoning About Mobile and Behavioral Health Data With Large Language Models21 Nov
  3. 2023LLM-CXR: Instruction-Finetuned LLM for CXR Image Understanding and Generation19 May

Other references · 29

  1. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
  2. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
  3. 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,193
  4. 2022Large Language Models Encode Clinical Knowledgecited by 1,807
  5. 2023The Rise and Potential of Large Language Model Based Agents: A Surveycited by 1,422
  6. 2023Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generationcited by 1,332
  7. 2023Cognitive Architectures for Language Agentscited by 422
  8. 2023Describe, Explain, Plan and Select: Interactive Planning with Large Language Models Enables Open-World Multi-Task Agentscited by 396
  9. 2023StructGPT: A General Framework for Large Language Model to Reason over Structured Datacited by 339
  10. 2023ToolQA: A Dataset for LLM Question Answering with External Toolscited by 273
  11. 2024Data Interpreter: An LLM Agent For Data Sciencecited by 222
  12. 2023Large Language Models are Versatile Decomposers: Decompose Evidence and Questions for Table-based Reasoningcited by 177
17 more
  1. 2024DS-Agent: Automated Data Science by Empowering Large Language Models with Case-Based Reasoningcited by 119
  2. 2023Towards Accurate Differential Diagnosis with Large Language Modelscited by 115
  3. 2022Natural Language to Code Generation in Interactive Data Science Notebookscited by 86
  4. 2023EduChat: A Large-Scale Language Model-based Chatbot System for Intelligent Educationcited by 80
  5. 2023Cognitive Reframing of Negative Thoughts through Human-Language Model Interactioncited by 77
  6. 2022Human-AI Collaboration Enables More Empathic Conversations in Text-based Peer-to-Peer Mental Health Supportcited by 68
  7. 2023Large Language Models to Identify Social Determinants of Health in Electronic Health Recordscited by 55
  8. 2023Facilitating Self-Guided Mental Health Interventions Through Human-Language Model Interaction: A Case Study of Cognitive Restructuringcited by 53
  9. 2024Large Language Model for Table Processing: A Surveycited by 52
  10. 2023The Capability of Large Language Models to Measure Psychiatric Functioningcited by 25
  11. 2024SheetAgent: Towards A Generalist Agent for Spreadsheet Reasoning and Manipulation via Large Language Modelscited by 16
  12. 2023Math Agents: Computational Infrastructure, Mathematical Embedding, and Genomicscited by 15
  13. 2022Sequential Models in the Synthetic Data Vaultcited by 12
  14. 2024IMBUE: Improving Interpersonal Effectiveness through Simulation and Just-in-time Feedback with Human-Language Model Interactioncited by 12
  15. 2024Mathify: Evaluating Large Language Models on Mathematical Problem Solving Taskscited by 12
  16. 2023Advancements in Federated Learning: Models, Methods, and Privacycited by 7
  17. 2020Activity River: Visualizing Planned and Logged Personal Activities for Reflectioncited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 4; 2025: 1; 2026: 14.

19 papers.

Sort:

By area:

  1. 2024What Are the Odds? Language Models Are Capable of Probabilistic Reasoningcited by 25
  2. 2025A Scalable Framework for Evaluating Health Language Modelscited by 11
  3. 2024LLaSA: A Sensor-Aware LLM for Natural Language Reasoning of Human Activity from IMU Datacited by 10
  4. 2026ComBodied Agents: a New Paradigm of Human-Centric Agentic AIcited by 4
  5. 2024Graph-Augmented LLMs for Personalized Health Insights: A Case Study in Sleep Analysiscited by 3
  6. 2026Wearable Foundation Models Should Go Beyond Static Encoderscited by 3
  7. 2026A Framework for Longitudinal Health AI Agentscited by 3
  8. 2024SleepCoT: A Lightweight Personalized Sleep Health Model via Chain-of-Thought Distillationcited by 1
  9. 2026Agentic AI in Healthcare & Medicine: A Seven-Dimensional Taxonomy for Empirical Evaluation of LLM-based Agentscited by 1
  10. 2026Query-Conditioned Graph Retrieval for Contextualized LLM Reasoning in Personalized Wearable Datacited by 1
  11. 2026A Self-Evolving Agent for Longitudinal Personal Health Managementcited by 1
  12. 2026The Cost of Language: Centroid Erasure Exposes and Exploits Modal Competition in Multimodal Language Modelscited by 0
7 more
  1. 2026Think Fast, Talk Smart: Partitioning Deterministic and Neural Computation for Structured Health Text Generationcited by 0
  2. 2026Personal Care Utility: Health as Everyday Infrastructurecited by 0
  3. 2026Enhancing Fitness Intelligence through Domain-Specific LLM Post-Trainingcited by 0
  4. 2026WearableQA: A Benchmark for Health Reasoning over Real-World Wearable Datacited by 0
  5. 2026LongAgent: History-Guided Agentic Search for Longitudinal Outcome Predictioncited by 0
  6. 2026Large language models in medical time series analysiscited by 0
  7. 2026Toward Personalized Sleep Guidance from Wearable Data Using Language Modelscited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2025The Anatomy of a Personal Health Agent
  2. 2026A Task-Oriented Multi-Agent Framework for Complex Wearable Health Analysis
  3. 2026WEQA: Wearable hEalth Question Answering with Query-Adaptive Agentic Reasoning
  4. 2026LifeAgentBench: Benchmarking LLMs for Long-Horizon, Cross-Dimensional Lifestyle Health Reasoning
  5. 2026mind_call: A Dataset for Mental Health Function Calling with Large Language Models
  6. 2025SePA: A Search-enhanced Predictive Agent for Personalized Health Coaching
  7. 2026Designing Mobile and Wearable Sensor-Fused Conversational Agents for Health and Wellbeing ↗
  8. 2026A Multi-Agent LLM Framework for Personalized Health Checkup Interpretation and Guidance