SensorQA: A Question Answering Benchmark for Daily-Life Monitoring
Not on the map. Why?
Abstract (arXiv)
With the rapid growth in sensor data, effectively interpreting and interfacing with these data in a human-understandable way has become crucial. While existing research primarily focuses on learning classification models, fewer studies have explored how end users can actively extract useful insights from sensor data, often hindered by the lack of a proper dataset. To address this gap, we introduce SensorQA, the first human-created question-answering (QA) dataset for long-term time-series sensor data for daily life monitoring. SensorQA is created by human workers and includes 5.6K diverse and practical queries that reflect genuine human interests, paired with accurate answers derived from sensor data. We further establish benchmarks for state-of-the-art AI models on this dataset and evaluate their performance on typical edge devices. Our results reveal a gap between current models and optimal QA performance and efficiency, highlighting the need for new contributions. The dataset and code are available at: https://github.com/benjamin-reichman/SensorQA.
Key facts. Cited by 8 papers in the map (data through 14 Oct 2026). Builds on 32 of its 59 references that are in the map. First posted on arXiv 9 Jan 2025.
Builds on
32 of 59 references.
References · 32
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2023GPT-4 Technical Reportcited by 18,396
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
- 2023Improved Baselines with Visual Instruction Tuningcited by 4,418
- 2018HotpotQA: A Dataset for Diverse, Explainable Multi-hop Question Answeringcited by 3,754
- 2017TriviaQA: A Large Scale Distantly Supervised Challenge Dataset for Reading Comprehensioncited by 2,955
- 2016Making the V in VQA Matter: Elevating the Role of Image Understanding in Visual Question Answeringcited by 2,516
- 2019BoolQ: Exploring the Surprising Difficulty of Natural Yes/No Questionscited by 2,183
- 2022Learn to Explain: Multimodal Reasoning via Thought Chains for Science Question Answeringcited by 1,919
- 2021Ego4D: Around the World in 3,000 Hours of Egocentric Videocited by 1,556
20 more
- 2018Know What You Don't Know: Unanswerable Questions for SQuADcited by 1,554
- 2023LLaMA-Adapter: Efficient Fine-tuning of Language Models with Zero-init Attentioncited by 781
- 2021FinQA: A Dataset of Numerical Reasoning over Financial Datacited by 562
- 2020PathVQA: 30000+ Questions for Medical Visual Question Answeringcited by 475
- 2023NuScenes-QA: A Multi-modal Visual Question Answering Benchmark for Autonomous Driving Scenariocited by 262
- 2023A Comprehensive Capability Analysis of GPT-3 and GPT-3.5 Series Modelscited by 246
- 2020RSVQA: Visual Question Answering for Remote Sensing Datacited by 203
- 2023OneLLM: One Framework to Align All Modalities with Languagecited by 187
- 2019A Question-Entailment Approach to Question Answeringcited by 134
- 2019JEC-QA: A Legal-Domain Question Answering Datasetcited by 116
- 2023AnyMAL: An Efficient and Scalable Any-Modality Augmented Language Modelcited by 93
- 2023Benchmarking Large Language Models on CMExam -- A Comprehensive Chinese Medical Exam Datasetcited by 91
- 2023MM-Fi: Multi-Modal Non-Intrusive 4D Human Dataset for Versatile Wireless Sensingcited by 79
- 2023EarthVQA: Towards Queryable Earth via Relational Reasoning-Based Remote Sensing Visual Question Answeringcited by 52
- 2016Recognizing Detailed Human Context In-the-Wild from Smartphones and Smartwatchescited by 42
- 2023TENT: Connect Language Models with IoT Sensors for Zero-Shot Activity Recognitioncited by 25
- 2023From Classification to Clinical Insights: Towards Analyzing and Reasoning About Mobile and Behavioral Health Data With Large Language Modelscited by 11
- 2024MESEN: Exploit Multimodal Data to Design Unimodal Human Activity Recognition with Few Labelscited by 11
- 2024Large Model for Small Data: Foundation Model for Cross-Modal RF Human Activity Recognitioncited by 6
- 2024KET-QA: A Dataset for Knowledge Enhanced Table Question Answeringcited by 5
Built on by
Citing papers per year: 2025: 5; 2026: 3.
8 papers.
- 2025SensorChat: Answering Qualitative and Quantitative Questions during Long-Term Multimodal Sensor Interactionscited by 11
- 2025Exploring the Capabilities of LLMs for IMU-based Fine-grained Human Activity Understandingcited by 5
- 2025RHealthTwin: Towards Responsible and Multimodal Digital Twins for Personalized Well-beingcited by 1
- 2025From Time Series Analysis to Question Answering: A Survey in the LLM Eracited by 0
- 2025Synera: Synergistic LLM Serving across Device and Cloud at Scalecited by 0
- 2026VitalAgent: A Tool-Augmented Agent for Reactive and Proactive Physiological Monitoring over Wearable Health Datacited by 0
- 2026HealthLoopQA: A Context-Aware Question Answering Benchmark for Interpreting Wearable Monitoring Data in Diabetes Carecited by 0
- 2026Zero-Shot Time-Series Question Answering via Decoupled Perception and Reasoningcited by 0
- 2026Zero-Shot Time-Series Question Answering via Decoupled Perception and Reasoning4 Oct 2026
- 2026HealthLoopQA: A Context-Aware Question Answering Benchmark for Interpreting Wearable Monitoring Data in Diabetes Care7 Sep 2026
- 2026VitalAgent: A Tool-Augmented Agent for Reactive and Proactive Physiological Monitoring over Wearable Health Data28 May 2026
- 2025Synera: Synergistic LLM Serving across Device and Cloud at Scale17 Oct 2025
- 2025From Time Series Analysis to Question Answering: A Survey in the LLM Era13 Jun 2025
- 2025RHealthTwin: Towards Responsible and Multimodal Digital Twins for Personalized Well-being10 Jun 2025
- 2025Exploring the Capabilities of LLMs for IMU-based Fine-grained Human Activity Understanding2 Apr 2025
- 2025SensorChat: Answering Qualitative and Quantitative Questions during Long-Term Multimodal Sensor Interactions5 Feb 2025