mlsanityData to 7 Oct 2026

PersonaDrift: A Benchmark for Temporal Anomaly Detection in Language-Based Dementia Monitoring

arXiv 2511.16445 ↗First posted 20 Nov 2025cs.AI cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

People living with dementia (PLwD) often show gradual shifts in how they communicate, becoming less expressive, more repetitive, or drifting off-topic in subtle ways. While caregivers may notice these changes informally, most computational tools are not designed to track such behavioral drift over time. This paper introduces PersonaDrift, a synthetic benchmark designed to evaluate machine learning and statistical methods for detecting progressive changes in daily communication, focusing on user responses to a digital reminder system. PersonaDrift simulates 60-day interaction logs for synthetic users modeled after real PLwD, based on interviews with caregivers. These caregiver-informed personas vary in tone, modality, and communication habits, enabling realistic diversity in behavior. The benchmark focuses on two forms of longitudinal change that caregivers highlighted as particularly salient: flattened sentiment (reduced emotional tone and verbosity) and off-topic replies (semantic drift). These changes are injected progressively at different rates to emulate naturalistic cognitive trajectories, and the framework is designed to be extensible to additional behaviors in future use cases. To explore this novel application space, we evaluate several anomaly detection approaches, unsupervised statistical methods (CUSUM, EWMA, One-Class SVM), sequence models using contextual embeddings (GRU + BERT), and supervised classifiers in both generalized and personalized settings. Preliminary results show that flattened sentiment can often be detected with simple statistical models in users with low baseline variability, while detecting semantic drift requires temporal modeling and personalized baselines. Across both tasks, personalized classifiers consistently outperform generalized ones, highlighting the importance of individual behavioral context.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 17 of its 40 references that are in the map. First posted on arXiv 20 Nov 2025.

Builds on

17 of 40 references.

References · 17

  1. 2018DialogueRNN: An Attentive RNN for Emotion Detection in Conversationscited by 216
  2. 2023User Behavior Simulation with Large Language Model based Agentscited by 136
  3. 2024Simulating Classroom Education with LLM-Empowered Agentscited by 125
  4. 2024Roleplay-doh: Enabling Domain-Experts to Create LLM-simulated Patients via Eliciting and Adhering to Principlescited by 72
  5. 2024Large Language Models for Forecasting and Anomaly Detection: A Systematic Literature Reviewcited by 50
  6. 2022Less is More: Learning to Refine Dialogue History for Personalized Dialogue Generationcited by 47
  7. 2020Artificial Intelligence, speech and language processing approaches to monitoring Alzheimer's Disease: a systematic reviewcited by 29
  8. 2025How Far are LLMs from Being Our Digital Twins? A Benchmark for Persona-Based Behavior Chain Simulationcited by 21
  9. 2022Temporal Modeling Matters: A Novel Temporal Emotional Modeling Approach for Speech Emotion Recognitioncited by 19
  10. 2022Adaptive Memory Networks with Self-supervised Learning for Unsupervised Anomaly Detectioncited by 18
  11. 2024LLM Roleplay: Simulating Human-Chatbot Interactioncited by 15
  12. 2020Memory Augmented Generative Adversarial Networks for Anomaly Detectioncited by 12
5 more
  1. 2023EmoUS: Simulating User Emotions in Task-Oriented Dialoguescited by 9
  2. 2016Coherent Dialogue with Attention-based Language Modelscited by 7
  3. 2019A Self-Attentive Emotion Recognition Networkcited by 5
  4. 2024A Systematic Review of NLP for Dementia -- Tasks, Datasets and Opportunitiescited by 4
  5. 2025Adaptive Anomaly Detection in the Presence of Concept Drift: Extended Reportcited by 1

Built on by

Not cited yet.