mlsanityData to 7 Oct 2026

Passive Dementia Screening via Facial Temporal Micro-Dynamics Analysis of In-the-Wild Talking-Head Video

arXiv 2511.13802 ↗First posted 17 Nov 2025cs.CV cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

We target passive dementia screening from short camera-facing talking head video, developing a facial temporal micro dynamics analysis for language free detection of early neuro cognitive change. This enables unscripted, in the wild video analysis at scale to capture natural facial behaviors, transferrable across devices, topics, and cultures without active intervention by clinicians or researchers during recording. Most existing resources prioritize speech or scripted interviews, limiting use outside clinics and coupling predictions to language and transcription. In contrast, we identify and analyze whether temporal facial kinematics, including blink dynamics, small mouth jaw motions, gaze variability, and subtle head adjustments, are sufficient for dementia screening without speech or text. By stabilizing facial signals, we convert these micro movements into interpretable facial microdynamic time series, smooth them, and summarize short windows into compact clip level statistics for screening. Each window is encoded by its activity mix (the relative share of motion across streams), thus the predictor analyzes the distribution of motion across streams rather than its magnitude, making per channel effects transparent. We also introduce YT DemTalk, a new dataset curated from publicly available, in the wild camera facing videos. It contains 300 clips (150 with self reported dementia, 150 controls) to test our model and offer a first benchmarking of the corpus. On YT DemTalk, ablations identify gaze lability and mouth/jaw dynamics as the most informative cues, and light weighted shallow classifiers could attain a dementia prediction performance of (AUROC) 0.953, 0.961 Average Precision (AP), 0.851 F1-score, and 0.857 accuracy.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 33 of its 62 references that are in the map. First posted on arXiv 17 Nov 2025.

Builds on

33 of 62 references.

References · 33

  1. 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,482
  2. 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
  3. 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,893
  4. 2017On Calibration of Modern Neural Networkscited by 4,860
  5. 2017Quo Vadis, Action Recognition? A New Model and the Kinetics Datasetcited by 3,259
  6. 2022A Time Series is Worth 64 Words: Long-term Forecasting with Transformerscited by 1,981
  7. 2018SlowFast Networks for Video Recognitioncited by 1,862
  8. 2021ViViT: A Video Vision Transformercited by 1,610
  9. 2017Adversarial Discriminative Domain Adaptationcited by 1,309
  10. 2022VideoMAE: Masked Autoencoders are Data-Efficient Learners for Self-Supervised Video Pre-Trainingcited by 1,305
  11. 2016Deep CORAL: Correlation Alignment for Deep Domain Adaptationcited by 1,194
  12. 2017A Closer Look at Spatiotemporal Convolutions for Action Recognitioncited by 1,139
21 more
  1. 2019FaceForensics++: Learning to Detect Manipulated Facial Imagescited by 1,095
  2. 2022TimesNet: Temporal 2D-Variation Modeling for General Time Series Analysiscited by 1,030
  3. 2018TSM: Temporal Shift Module for Efficient Video Understandingcited by 852
  4. 2020Face2Face: Real-time Face Capture and Reenactment of RGB Videoscited by 631
  5. 2020Learning an Animatable Detailed 3D Face Model from In-The-Wild Imagescited by 475
  6. 2015Return of Frustratingly Easy Domain Adaptationcited by 389
  7. 2021Revisiting the Calibration of Modern Neural Networkscited by 387
  8. 2019InceptionTime: Finding AlexNet for Time Series Classificationcited by 386
  9. 2018LRS3-TED: a large-scale dataset for visual speech recognitioncited by 301
  10. 2022EMOCA: Emotion Driven Monocular Face Capture and Animationcited by 254
  11. 2023TSMixer: An All-MLP Architecture for Time Series Forecastingcited by 232
  12. 2016Lip Reading Sentences in the Wildcited by 226
  13. 2019AVA-ActiveSpeaker: An Audio-Visual Dataset for Active Speaker Detectioncited by 81
  14. 2021Detecting cognitive decline using speech only: The ADReSSo Challengecited by 81
  15. 2017Large Pose 3D Face Reconstruction from a Single Image via Direct Volumetric CNN Regressioncited by 66
  16. 2024MemFlow: Optical Flow Estimation and Prediction with Memorycited by 55
  17. 2019Predicting the Future: A Jointly Learnt Model for Action Anticipationcited by 41
  18. 2018Detecting Alzheimer's Disease Using Gated Convolutional Neural Network from Audio Datacited by 5
  19. 2023Permutation-based Hypothesis Testing for Neural Networkscited by 3
  20. 2025Fused Partial Gromov-Wasserstein for Structured Objectscited by 3
  21. 2024Feasibility of Detecting Cognitive Impairment and Psychological Well-being among Older Adults Using Facial, Acoustic, Linguistic, and Cardiovascular Patterns Derived from Remote Conversationscited by 2

Built on by

Not cited yet.