Using Large Language Models to Compare Explainable Models for Smart Home Human Activity Recognition
Not on the map. Why?
Abstract (arXiv)
Recognizing daily activities with unobtrusive sensors in smart environments enables various healthcare applications. Monitoring how subjects perform activities at home and their changes over time can reveal early symptoms of health issues, such as cognitive decline. Most approaches in this field use deep learning models, which are often seen as black boxes mapping sensor data to activities. However, non-expert users like clinicians need to trust and understand these models' outputs. Thus, eXplainable AI (XAI) methods for Human Activity Recognition have emerged to provide intuitive natural language explanations from these models. Different XAI methods generate different explanations, and their effectiveness is typically evaluated through user surveys, that are often challenging in terms of costs and fairness. This paper proposes an automatic evaluation method using Large Language Models (LLMs) to identify, in a pool of candidates, the best XAI approach for non-expert users. Our preliminary results suggest that LLM evaluation aligns with user surveys.
Key facts. Cited by 9 papers in the map (data through 13 Oct 2026). Builds on 22 of its 57 references that are in the map. First posted on arXiv 24 Jul 2024.
Builds on
22 of 57 references.
References · 22
- 2020Language Models are Few-Shot Learnerscited by 32,320
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,376
- 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,713
- 2016"Why Should I Trust You?": Explaining the Predictions of Any Classifiercited by 5,055
- 2017Deep Learning for Sensor-based Activity Recognition: A Surveycited by 133
- 2020Deep Learning for Sensor-based Human Activity Recognition: Overview, Challenges and Opportunitiescited by 125
- 2022Assessing the State of Self-Supervised Human Activity Recognition using Wearablescited by 63
- 2021Incorporating Domain Knowledge into Deep Neural Networkscited by 56
- 2021Neuro-Symbolic Artificial Intelligence: Current Trendscited by 54
- 2024HARGPT: Are LLMs Zero-Shot Human Activity Recognizers?cited by 52
- 2019Cross-Subject Transfer Learning in Human Activity Recognition Systems using Generative Adversarial Networkscited by 35
- 2024NumeroLogic: Number Encoding for Enhanced LLMs' Numerical Reasoningcited by 31
10 more
- 2020Text Recognition in the Wild: A Surveycited by 29
- 2023TENT: Connect Language Models with IoT Sensors for Zero-Shot Activity Recognitioncited by 25
- 2019Knowledge Infused Learning (K-IL): Towards Deep Incorporation of Knowledge in Deep Learningcited by 19
- 2023Generating Virtual On-body Accelerometer Data from Virtual Textual Descriptions for Human Activity Recognitioncited by 18
- 2021Explainable Activity Recognition for Smart Home Systemscited by 14
- 2024Transfer Learning in Human Activity Recognition: A Surveycited by 14
- 2023GG-LLM: Geometrically Grounding Large Language Models for Zero-shot Human Activity Forecasting in Human-Aware Task Planningcited by 13
- 2023Unsupervised Human Activity Recognition through Two-stage Prompting with ChatGPTcited by 11
- 2019Context-driven Active and Incremental Activity Recognitioncited by 6
- 2023Toward Pioneering Sensors and Features Using Large Language Models in Human Activity Recognitioncited by 3
Built on by
Citing papers per year: 2024: 3; 2025: 4; 2026: 2.
9 papers.
- 2024UniMTS: Unified Pre-training for Motion Time Seriescited by 22
- 2024Past, Present, and Future of Sensor-Based Human Activity Recognition Using Wearables: A Surveying Tutorial on a Still Challenging Taskcited by 14
- 2024Large Language Model-Guided Semantic Alignment for Human Activity Recognitioncited by 5
- 2025Leveraging Large Language Models for Explainable Activity Recognition in Smart Homes: A Critical Evaluationcited by 5
- 2025A Survey of Foundation Models for IoT: Taxonomy and Criteria-Based Analysiscited by 5
- 2025AgentSense: Virtual Sensor Data Generation Using LLM Agents in Simulated Home Environmentscited by 4
- 2025Semantically Encoding Activity Labels for Context-Aware Human Activity Recognitioncited by 0
- 2026Rules or Weights? Comparing User Understanding of Explainable AI Techniques with the Cognitive XAI-Adaptive Modelcited by 0
- 2026Logi-PAR: Logic-Infused Patient Activity Recognition via Differentiable Rulecited by 0
- 2026Logi-PAR: Logic-Infused Patient Activity Recognition via Differentiable Rule5 Mar 2026
- 2026Rules or Weights? Comparing User Understanding of Explainable AI Techniques with the Cognitive XAI-Adaptive Model23 Feb 2026
- 2025A Survey of Foundation Models for IoT: Taxonomy and Criteria-Based Analysis13 Jun 2025
- 2025AgentSense: Virtual Sensor Data Generation Using LLM Agents in Simulated Home Environments13 Jun 2025
- 2025Semantically Encoding Activity Labels for Context-Aware Human Activity Recognition10 Apr 2025
- 2025Leveraging Large Language Models for Explainable Activity Recognition in Smart Homes: A Critical Evaluation20 Mar 2025
- 2024Past, Present, and Future of Sensor-Based Human Activity Recognition Using Wearables: A Surveying Tutorial on a Still Challenging Task11 Nov 2024
- 2024UniMTS: Unified Pre-training for Motion Time Series18 Oct 2024
- 2024Large Language Model-Guided Semantic Alignment for Human Activity Recognition12 Sep 2024