SensingAgents: A Multi-Agent Collaborative Framework for Robust IMU Activity Recognition
On the map: LLM agents and tool use → Multimodal and embodied agents
Abstract (arXiv)
Human Activity Recognition (HAR) using Inertial Measurement Unit (IMU) sensors is a cornerstone of mobile health, smart environments, and human-computer interaction. However, current deep learning-based HAR models often struggle with heavy reliance on labeled data, position-specific ambiguity, and a lack of transparent reasoning. Inspired by the advanced agents framework, which emulates a collaborative agent using Large Language Models (LLMs), we propose SensingAgents, a novel multi-agent system for robust IMU activity recognition. SensingAgents organizes LLM-powered agents into specialized roles: a group of Analyst Agents for position-specific sensor analysis (arm, wrist, belt, pocket), a pair of Advocate Agents that resolves sensor conflicts through dynamic and static dialectical debates, and a Decision Agent that ensures reliability under sensor drift or failure. Evaluation on the Shoaib dataset demonstrates that SensingAgents significantly outperforms state-of-the-art single-agent and multi-agent LLM models, achieving an accuracy of 79.5% in a zero setting--29% higher than existing agent models and 9.4% higher than deep learning baselines--particularly in complex scenarios where multi-sensor data is conflicting or noisy. Our work highlights the potential of multi-agent collaborative reasoning for advancing the robustness and interpretability of ubiquitous sensing systems.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Multimodal and embodied agents, one of 16 directions in LLM agents and tool use. Builds on 8 of its 29 references that are in the map. First posted on arXiv 6 May 2026.
Builds on
8 of 29 references.
Closest ancestors · 1
Same direction, newest first
Other references · 7
- 2025Large Language Models Hallucination: A Comprehensive Surveycited by 45
- 2024IoT-LLM: a framework for enhancing Large Language Model reasoning from real-world sensor datacited by 18
- 2024Large Language Models for Wearable Sensor-Based Human Activity Recognition, Health Monitoring, and Behavioral Modeling: A Survey of Early Trends, Datasets, and Challengescited by 12
- 2024LLaSA: A Sensor-Aware LLM for Natural Language Reasoning of Human Activity from IMU Datacited by 10
- 2025Using LLMs for Late Multimodal Sensor Fusion for Activity Recognitioncited by 5
- 2024Active Learning for WBAN-based Health Monitoringcited by 2
- 2025mmExpert: Integrating Large Language Models for Comprehensive mmWave Data Synthesis and Understandingcited by 2
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026SenseAgent: An LLM Agent for Adaptive Cross-Domain IMU Sensing
- 2025On-device Large Multi-modal Agent for Human Activity Recognition
- 2025Towards Generalizable Human Activity Recognition: A Survey
- 2025AgentSense: Virtual Sensor Data Generation Using LLM Agents in Simulated Home Environments
- 2026FedMHAR: Federated Multimodal Human Activity Recognition using Multi-Agent Reinforcement Learning
- 2025ZARA: Training-Free Motion Time-Series Reasoning via Evidence-Grounded LLM Agents
- 2026You Don't Need To Train: Agentic Heuristic Learning Studio for Executable Human Activity Recognition
- 2025AegisAgent: An Autonomous Defense Agent Against Prompt Injection Attacks in LLM-HARs