Causal Stories from Sensor Traces: Auditing Epistemic Overreach in LLM-Generated Personal Sensing Explanations
Not on the map. Why?
Abstract (arXiv)
LLMs are increasingly used to explain personal sensing data, translating traces of activity and mood into natural-language accounts of why an anomalous day may have occurred. However, such explanations can sound coherent and personally meaningful even when the underlying evidence is sparse or missing. We introduce epistemic overreach (EO) as a measure for cases where a generated explanation implies more than the available sensing evidence can justify. To audit how often and in what forms EO occurs, we obtained anomalous-day scenarios from three longitudinal sensing datasets of college students: StudentLife, GLOBEM, and CollegeExperience. Across activity, sleep, and affect anomalies, we generated 14,922 explanations using three LLM families -- Llama, Qwen, and GPT -- under two prompting conditions: one minimally constrained prompt and another prompt explicitly instructing models to bound claims to the data. For each scenario, we varied the amount of behavioral evidence available to the model to examine whether more evidence reduces EO. We evaluated each explanation using a structured rubric, decomposing EO into the dimensions of unsupported causal attribution, unacknowledged data gaps, overconfident language, temporal inconsistency, and diagnostic inference. We find that LLMs routinely attribute anomalous days to causes without sufficient support from the data, and that this pattern replicates across datasets, anomaly types, and model families. Further, providing richer context does not reliably reduce EO; bounded prompting helps but does not eliminate it. These findings suggest that evidential grounding should be a first-order evaluation criterion for LLM-generated personal sensing explanations, alongside fluency and plausibility. We argue that personal sensing explanations require evidential discipline: systems must distinguish what is observed, what is inferred, and what remains unknown.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 21 of its 78 references that are in the map. First posted on arXiv 9 May 2026.
Builds on
21 of 78 references.
References · 21
- 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
- 2021TruthfulQA: Measuring How Models Mimic Human Falsehoodscited by 2,975
- 2023G-Eval: NLG Evaluation using GPT-4 with Better Human Alignmentcited by 2,276
- 2022Language Models (Mostly) Know What They Knowcited by 1,856
- 2023A Survey on Hallucination in Large Language Models: Principles, Taxonomy, Challenges, and Open Questionscited by 1,601
- 2023FActScore: Fine-grained Atomic Evaluation of Factual Precision in Long Form Text Generationcited by 1,282
- 2017Explanation in Artificial Intelligence: Insights from the Social Sciencescited by 1,206
- 2023Language Models Don't Always Say What They Think: Unfaithful Explanations in Chain-of-Thought Promptingcited by 1,122
- 2020On Faithfulness and Factuality in Abstractive Summarizationcited by 900
- 2023DecodingTrust: A Comprehensive Assessment of Trustworthiness in GPT Modelscited by 518
- 2021QAFactEval: Improved QA-Based Factual Consistency Evaluation for Summarizationcited by 236
- 2021A Dataset for Answering Time-Sensitive Questionscited by 154
9 more
- 2023TimeBench: A Comprehensive Evaluation of Temporal Reasoning Abilities in Large Language Modelscited by 39
- 2018Personalized Machine Learning for Robot Perception of Affect and Engagement in Autism Therapycited by 29
- 2024MindScape Study: Integrating LLM and Behavioral Sensing for Personalized AI-Driven Journaling Experiencescited by 24
- 2024PhysioLLM: Supporting Personalized Health Insights with Wearables and Large Language Modelscited by 16
- 2025SensorChat: Answering Qualitative and Quantitative Questions during Long-Term Multimodal Sensor Interactionscited by 11
- 2026RubRIX: Rubric-Driven Risk Mitigation in Caregiver-AI Interactionscited by 10
- 2024MindGuard: Towards Accessible and Sitgma-free Mental Health First Aid via Edge LLMcited by 7
- 2026PAIR-SAFE: A Paired-Agent Approach for Runtime Auditing and Refining AI-Mediated Mental Health Supportcited by 7
- 2024Imputation Matters: A Deeper Look into an Overlooked Step in Longitudinal Health and Behavior Sensing Researchcited by 1
Built on by
Citing papers per year: 2026: 2.
2 papers.