Heart2Mind: Human-Centered Contestable Psychiatric Disorder Diagnosis System using Wearable ECG Monitors
Not on the map. Why?
Abstract (arXiv)
Psychiatric disorders affect millions globally, yet their diagnosis faces significant challenges in clinical practice due to subjective assessments and accessibility concerns, leading to potential delays in treatment. To help address this issue, we present Heart2Mind, a human-centered contestable psychiatric disorder diagnosis system using wearable electrocardiogram (ECG) monitors. Our approach leverages cardiac biomarkers, particularly heart rate variability (HRV) and R-R intervals (RRI) time series, as objective indicators of autonomic dysfunction in psychiatric conditions. The system comprises three key components: (1) a Cardiac Monitoring Interface (CMI) for real-time data acquisition from Polar H9/H10 devices; (2) a Multi-Scale Temporal-Frequency Transformer (MSTFT) that processes RRI time series through integrated time-frequency domain analysis; (3) a Contestable Diagnosis Interface (CDI) combining Self-Adversarial Explanations (SAEs) with contestable Large Language Models (LLMs). Our MSTFT achieves 91.7% accuracy on the HRV-ACC dataset using leave-one-out cross-validation, outperforming state-of-the-art methods. SAEs successfully detect inconsistencies in model predictions by comparing attention-based and gradient-based explanations, while LLMs enable clinicians to validate correct predictions and contest erroneous ones. This work demonstrates the feasibility of combining wearable technology with Explainable Artificial Intelligence (XAI) and contestable LLMs to create a transparent, contestable system for psychiatric diagnosis that maintains clinical oversight while leveraging advanced AI capabilities. Our implementation is publicly available at: https://github.com/Analytics-Everywhere-Lab/heart2mind.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 27 of its 107 references that are in the map. First posted on arXiv 16 May 2025.
Builds on
27 of 107 references.
References · 27
- 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,733
- 2017A Unified Approach to Interpreting Model Predictionscited by 6,555
- 2016XGBoost: A Scalable Tree Boosting Systemcited by 5,166
- 2016"Why Should I Trust You?": Explaining the Predictions of Any Classifiercited by 5,070
- 2013Deep Inside Convolutional Networks: Visualising Image Classification Models and Saliency Mapscited by 2,371
- 2013Visualizing and Understanding Convolutional Networkscited by 2,290
- 2022Large Language Models Encode Clinical Knowledgecited by 1,830
- 2017Explanation in Artificial Intelligence: Insights from the Social Sciencescited by 1,206
- 2017Grad-CAM++: Improved Visual Explanations for Deep Convolutional Networkscited by 939
- 2019Attention is not Explanationcited by 929
- 2018RISE: Randomized Input Sampling for Explanation of Black-box Modelscited by 838
- 2021CrossViT: Cross-Attention Multi-Scale Vision Transformer for Image Classificationcited by 806
15 more
- 2019Explaining Machine Learning Classifiers through Diverse Counterfactual Explanationscited by 614
- 2025Phi-4-Mini Technical Report: Compact yet Powerful Multimodal Language Models via Mixture-of-LoRAscited by 521
- 2019Model-Agnostic Counterfactual Explanations for Consequential Decisionscited by 204
- 2016Layer-wise Relevance Propagation for Neural Networks with Local Renormalization Layerscited by 199
- 2020Black-box Explanation of Object Detectors via Saliency Mapscited by 76
- 2022Rethinking Attention-Model Explainability through Faithfulness Violation Testcited by 43
- 2024CrossFuse: A Novel Cross Attention Mechanism based Infrared and Visible Image Fusion Approachcited by 38
- 2021Towards Relatable Explainable AI with the Perceptual Processcited by 27
- 2021Levels of explainable artificial intelligence for human-aligned conversational explanationscited by 21
- 2023Towards Better Explanations for Object Detectioncited by 14
- 2024LangXAI: Integrating Large Vision Models for Generating Textual Explanations to Enhance Explainability in Visual Perception Taskscited by 13
- 2023Towards Trust of Explainable AI in Thyroid Nodule Diagnosiscited by 10
- 2024XEdgeAI: A Human-centered Industrial Inspection Framework with Data-centric Explainable Edge AI Approachcited by 8
- 2024Efficient and Concise Explanations for Object Detection with Gaussian-Class Activation Mapping Explainercited by 6
- 2025CBVLM: Training-free Explainable Concept-based Large Vision Language Models for Medical Image Classificationcited by 4
Built on by
Citing papers per year: 2025: 4.
4 papers.
- 2025Motion2Meaning: A Clinician-Centered Framework for Contestable LLM in Parkinson's Disease Gait Interpretationcited by 6
- 2025Multimedia Verification Through Multi-Agent Deep Research Multimodal Large Language Modelscited by 4
- 2025SimInterview: Transforming Business Education through Large Language Model-Based Simulated Multilingual Interview Training Systemcited by 2
- 2025Privacy-Preserving Multi-Stage Fall Detection Framework with Semi-supervised Federated Learning and Robotic Vision Confirmationcited by 0
- 2025Motion2Meaning: A Clinician-Centered Framework for Contestable LLM in Parkinson's Disease Gait Interpretation21 Oct 2025
- 2025SimInterview: Transforming Business Education through Large Language Model-Based Simulated Multilingual Interview Training System16 Aug 2025
- 2025Privacy-Preserving Multi-Stage Fall Detection Framework with Semi-supervised Federated Learning and Robotic Vision Confirmation14 Jul 2025
- 2025Multimedia Verification Through Multi-Agent Deep Research Multimodal Large Language Models6 Jul 2025
Similar, not cited
Close in wording, no citation either way
- 2026C-GRASP: Clinically-Grounded Reasoning for Affective Signal Processing
- 2026ECG-R1: Protocol-Guided and Modality-Agnostic MLLM for Reliable ECG Interpretation
- 2026ECG Foundation Models and Medical LLMs for Agentic Cardiovascular Intelligence at the Edge: A Review and Outlook
- 2025AI on the Pulse: Real-Time Health Anomaly Detection with Wearable and Ambient Intelligence
- 2026VitalAgent: A Tool-Augmented Agent for Reactive and Proactive Physiological Monitoring over Wearable Health Data
- 2026WearableQA: A Benchmark for Health Reasoning over Real-World Wearable Data
- 2025ECG-EmotionNet: Nested Mixture of Expert (NMoE) Adaptation of ECG-Foundation Model for Driver Emotion Recognition
- 2026ECG-Scroll: A Long-Horizon, Streaming Benchmark and Agent Environment for Interpretation of Ambulatory Electrocardiograms