ECG-QA: A Comprehensive Question Answering Dataset Combined With Electrocardiogram
Not on the map. Why?
Abstract (arXiv)
Question answering (QA) in the field of healthcare has received much attention due to significant advancements in natural language processing. However, existing healthcare QA datasets primarily focus on medical images, clinical notes, or structured electronic health record tables. This leaves the vast potential of combining electrocardiogram (ECG) data with these systems largely untapped. To address this gap, we present ECG-QA, the first QA dataset specifically designed for ECG analysis. The dataset comprises a total of 70 question templates that cover a wide range of clinically relevant ECG topics, each validated by an ECG expert to ensure their clinical utility. As a result, our dataset includes diverse ECG interpretation questions, including those that require a comparative analysis of two different ECGs. In addition, we have conducted numerous experiments to provide valuable insights for future research directions. We believe that ECG-QA will serve as a valuable resource for the development of intelligent QA systems capable of assisting clinicians in ECG interpretations. Dataset URL: https://github.com/Jwoo5/ecg-qa
Key facts. Cited by 54 papers in the map (data through 14 Oct 2026). Builds on 18 of its 39 references that are in the map. First posted on arXiv 21 Jun 2023.
Builds on
18 of 39 references.
References · 18
- 2017Attention Is All You Needcited by 60,361
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2017Squeeze-and-Excitation Networkscited by 4,789
- 2016Wide Residual Networkscited by 3,070
- 2015VQA: Visual Question Answeringcited by 2,506
- 2021SLAKE: A Semantically-Labeled Knowledge-Enhanced Dataset for Medical Visual Question Answeringcited by 449
- 2015Visual7W: Grounded Question Answering in Imagescited by 318
- 2021MultiModalQA: Complex Question Answering over Text, Tables and Imagescited by 179
- 2020CLOCS: Contrastive Learning of Cardiac Signals Across Space, Time, and Patientscited by 171
- 2018emrQA: A Large Corpus for Question Answering on Electronic Medical Recordscited by 135
- 2023ChatCAD: Interactive Computer-Aided Diagnosis on Medical Image using Large Language Modelscited by 116
- 2022Multi-Modal Masked Autoencoders for Medical Vision-and-Language Pre-Trainingcited by 104
6 more
- 2021Multi-modal Understanding and Generation for Medical Images and Text via Vision-Language Pre-Trainingcited by 96
- 2019Text-to-SQL Generation for Question Answering on Electronic Medical Recordscited by 77
- 2023EHRSQL: A Practical Text-to-SQL Benchmark for Electronic Health Recordscited by 45
- 2022Lead-agnostic Self-supervised Learning for Local and Global Representations of Electrocardiogramcited by 38
- 20213KG: Contrastive Learning of 12-Lead Electrocardiograms using Physiologically-Inspired Augmentationscited by 36
- 2018R-VQA: Learning Visual Relation Facts with Semantic Attention for Visual Question Answeringcited by 23
Built on by
Citing papers per year: 2024: 12; 2025: 14; 2026: 28.
54 papers.
Sort:
By area:
- 2024Large Language Models for Time Series: A Surveycited by 114
- 2024ChatTS: Aligning Time Series with LLMs via Synthetic Data for Enhanced Understanding and Reasoningcited by 103
- 2024Language Models Still Struggle to Zero-shot Reason about Time Seriescited by 88
- 2024TimeSeriesExam: A time series understanding examcited by 49
- 2024Position: What Can Large Language Models Tell Us about Time Series Analysiscited by 47
- 2024Teach Multimodal LLMs to Comprehend Electrocardiographic Imagescited by 28
- 2025Advancing Conversational Diagnostic AI with Multimodal Reasoningcited by 20
- 2024Large Language Model Benchmarks in Medical Taskscited by 17
- 2024FMBench: Benchmarking Fairness in Multimodal Large Language Models on Medical Taskscited by 11
- 2025anyECG-chat: A Generalist ECG-MLLM for Flexible ECG Input and Multi-Task Understandingcited by 10
- 2024FEDMEKI: A Benchmark for Scaling Medical Foundation Models via Federated Knowledge Injectioncited by 8
- 2025DocHop-QA: Towards Multi-Hop Reasoning over Multimodal Document Collectionscited by 8
38 more
- 2024Electrocardiogram Report Generation and Question Answering via Retrieval-Augmented Self-Supervised Modelingcited by 7
- 2025DanmakuTPPBench: A Multi-modal Benchmark for Temporal Point Process Modeling and Understandingcited by 7
- 2025ECG-Expert-QA: A Benchmark for Evaluating Medical Large Language Models in Heart Disease Diagnosiscited by 6
- 2026ARFBench: Benchmarking Time Series Question Answering Ability for Software Incident Responsecited by 6
- 2024FEDKIM: Adaptive Federated Knowledge Injection into Medical Foundation Modelscited by 5
- 2024Electrocardiogram-Language Model for Few-Shot Question Answering with Meta Learningcited by 5
- 2025Eliciting Chain-of-Thought Reasoning for Time Series Analysis using Reinforcement Learningcited by 5
- 2025QuAnTS: Question Answering on Time Seriescited by 5
- 2025TsLLM: Augmenting LLMs for General Time Series Understanding and Predictioncited by 4
- 2026ECG-Reasoning-Benchmark: A Benchmark for Evaluating Clinical Reasoning Capabilities in ECG Interpretationcited by 4
- 2025HeartcareGPT: A Unified Multimodal ECG Suite for Dual Signal-Image Modeling and Understandingcited by 3
- 2026PulseLM: A Foundation Dataset and Benchmark for PPG-Text Learningcited by 3
- 2025Sensing Cardiac Health Across Scenarios and Devices: A Multi-Modal Foundation Model Pretrained on Heterogeneous Data from 1.7 Million Individualscited by 2
- 2025Retrieval-Augmented Generation for Electrocardiogram-Language Modelscited by 2
- 2026Aionoscope: Debugging Latent-State Accessibility in Time-Series Representationscited by 2
- 2025ECG-aBcDe: Overcoming Model Dependence, Encoding ECG into a Universal Language for Any LLMcited by 1
- 2026TS-Skill: A Benchmark for Evaluating Analytical Skills in Time-Series Question Answeringcited by 1
- 2025From Time Series Analysis to Question Answering: A Survey in the LLM Eracited by 0
- 2025Can VLM Pseudo-Labels Train a Time-Series QA Model That Outperforms the VLM?cited by 0
- 2026CAMEL: An ECG Language Model for Forecasting Cardiac Eventscited by 0
- 2026RA-QA: A Benchmarking System for Respiratory Audio Question Answering Under Real-World Heterogeneitycited by 0
- 2026KairosVL: Orchestrating Time Series and Semantics for Unified Reasoningcited by 0
- 2026Benchmarking LLM Summaries of Multimodal Clinical Time Series for Remote Monitoringcited by 0
- 2026RAMoEA-QA: Hierarchical Specialization for Robust Respiratory Audio Question Answeringcited by 0
- 2026Learning ECG Image Representations via Dual Physiological-Aware Alignmentscited by 0
- 2026VitalAgent: A Tool-Augmented Agent for Reactive and Proactive Physiological Monitoring over Wearable Health Datacited by 0
- 2026EVL-ECG: Efficient ECG Interpretation With Multi-Aspect Heterogeneous Knowledge Distillationcited by 0
- 2026Failures Reveal What Metrics Miss: An Evidence-Driven Agent for Recursive Refinement of ECG Classifierscited by 0
- 2026TimeRLM: Recursive Language Models Enable Precise Anomaly Localization in Long-Context Time-Seriescited by 0
- 2026Diagnosing as Cardiologists Do: ECG Agents with Doctor-Grounded Priors for Clinical Reasoning Across Diseases and Populationscited by 0
- 2026ECGQuest: Benchmarking and Fine-Tuning Language Models for Electrocardiographycited by 0
- 2026MMTClinic: Multimodal, Multilingual Time Series Question Answering and Reasoning Benchmark for Clinical Domaincited by 0
- 2026WearableQA: A Benchmark for Health Reasoning over Real-World Wearable Datacited by 0
- 2026HealthLoopQA: A Context-Aware Question Answering Benchmark for Interpreting Wearable Monitoring Data in Diabetes Carecited by 0
- 2026Large language models in medical time series analysiscited by 0
- 2026LabFactory: Building and Evaluating Executable AI Labscited by 0
- 2026AnesTRACE: Benchmarking Intraoperative Anesthesia from Multimodal Perception to Multi-step Decision-Makingcited by 0
- 2026ECG-Scroll: A Long-Horizon, Streaming Benchmark and Agent Environment for Interpretation of Ambulatory Electrocardiogramscited by 0
50 most cited of 54 All 54 (JSON)
- 2026TimeNet: An Extensible Unified Data Infrastructure for Next-Generation Temporal Foundation Models3 Oct 2026
- 2026Lotus: Learning to Understand Time-series by Learning to Forecast1 Oct 2026
- 2026Detect, Explain, Interpret: An End-to-End Benchmark for Time Series Anomaly Detection, Explainability and Interpretability1 Oct 2026
- 2026TRACE: Expert-Aligned ECG Representation Learning with Rigorous Benchmarking and Real-World Validation in Acute Cardiac Care28 Sep 2026
- 2026ECG-Scroll: A Long-Horizon, Streaming Benchmark and Agent Environment for Interpretation of Ambulatory Electrocardiograms27 Sep 2026
- 2026AnesTRACE: Benchmarking Intraoperative Anesthesia from Multimodal Perception to Multi-step Decision-Making26 Sep 2026
- 2026LabFactory: Building and Evaluating Executable AI Labs23 Sep 2026
- 2026Large language models in medical time series analysis7 Sep 2026
- 2026HealthLoopQA: A Context-Aware Question Answering Benchmark for Interpreting Wearable Monitoring Data in Diabetes Care7 Sep 2026
- 2026WearableQA: A Benchmark for Health Reasoning over Real-World Wearable Data4 Sep 2026
- 2026MMTClinic: Multimodal, Multilingual Time Series Question Answering and Reasoning Benchmark for Clinical Domain4 Sep 2026
- 2026ECGQuest: Benchmarking and Fine-Tuning Language Models for Electrocardiography31 Aug 2026
38 more
- 2026Diagnosing as Cardiologists Do: ECG Agents with Doctor-Grounded Priors for Clinical Reasoning Across Diseases and Populations10 Aug 2026
- 2026TimeRLM: Recursive Language Models Enable Precise Anomaly Localization in Long-Context Time-Series4 Aug 2026
- 2026Failures Reveal What Metrics Miss: An Evidence-Driven Agent for Recursive Refinement of ECG Classifiers27 Jul 2026
- 2026Aionoscope: Debugging Latent-State Accessibility in Time-Series Representations1 Jul 2026
- 2026EVL-ECG: Efficient ECG Interpretation With Multi-Aspect Heterogeneous Knowledge Distillation28 May 2026
- 2026VitalAgent: A Tool-Augmented Agent for Reactive and Proactive Physiological Monitoring over Wearable Health Data28 May 2026
- 2026TS-Skill: A Benchmark for Evaluating Analytical Skills in Time-Series Question Answering23 May 2026
- 2026ARFBench: Benchmarking Time Series Question Answering Ability for Software Incident Response23 Apr 2026
- 2026Learning ECG Image Representations via Dual Physiological-Aware Alignments2 Apr 2026
- 2026ECG-Reasoning-Benchmark: A Benchmark for Evaluating Clinical Reasoning Capabilities in ECG Interpretation15 Mar 2026
- 2026RAMoEA-QA: Hierarchical Specialization for Robust Respiratory Audio Question Answering6 Mar 2026
- 2026Benchmarking LLM Summaries of Multimodal Clinical Time Series for Remote Monitoring2 Mar 2026
- 2026KairosVL: Orchestrating Time Series and Semantics for Unified Reasoning24 Feb 2026
- 2026CAMEL: An ECG Language Model for Forecasting Cardiac Events17 Feb 2026
- 2026PulseLM: A Foundation Dataset and Benchmark for PPG-Text Learning10 Feb 2026
- 2026RA-QA: A Benchmarking System for Respiratory Audio Question Answering Under Real-World Heterogeneity4 Feb 2026
- 2025QuAnTS: Question Answering on Time Series7 Nov 2025
- 2025Eliciting Chain-of-Thought Reasoning for Time Series Analysis using Reinforcement Learning1 Oct 2025
- 2025TsLLM: Augmenting LLMs for General Time Series Understanding and Prediction1 Oct 2025
- 2025Retrieval-Augmented Generation for Electrocardiogram-Language Models30 Sep 2025
- 2025Can VLM Pseudo-Labels Train a Time-Series QA Model That Outperforms the VLM?30 Sep 2025
- 2025ECG-aBcDe: Overcoming Model Dependence, Encoding ECG into a Universal Language for Any LLM16 Sep 2025
- 2025DocHop-QA: Towards Multi-Hop Reasoning over Multimodal Document Collections20 Aug 2025
- 2025Sensing Cardiac Health Across Scenarios and Devices: A Multi-Modal Foundation Model Pretrained on Heterogeneous Data from 1.7 Million Individuals23 Jun 2025
- 2025From Time Series Analysis to Question Answering: A Survey in the LLM Era13 Jun 2025
- 2025HeartcareGPT: A Unified Multimodal ECG Suite for Dual Signal-Image Modeling and Understanding6 Jun 2025
- 2025anyECG-chat: A Generalist ECG-MLLM for Flexible ECG Input and Multi-Task Understanding1 Jun 2025
- 2025DanmakuTPPBench: A Multi-modal Benchmark for Temporal Point Process Modeling and Understanding23 May 2025
- 2025Advancing Conversational Diagnostic AI with Multimodal Reasoning6 May 2025
- 2025ECG-Expert-QA: A Benchmark for Evaluating Medical Large Language Models in Heart Disease Diagnosis16 Feb 2025
- 2024ChatTS: Aligning Time Series with LLMs via Synthetic Data for Enhanced Understanding and Reasoning4 Dec 2024
- 2024Large Language Model Benchmarks in Medical Tasks28 Oct 2024
- 2024Teach Multimodal LLMs to Comprehend Electrocardiographic Images21 Oct 2024
- 2024TimeSeriesExam: A time series understanding exam18 Oct 2024
- 2024Electrocardiogram-Language Model for Few-Shot Question Answering with Meta Learning18 Oct 2024
- 2024FMBench: Benchmarking Fairness in Multimodal Large Language Models on Medical Tasks1 Oct 2024
- 2024Electrocardiogram Report Generation and Question Answering via Retrieval-Augmented Self-Supervised Modeling13 Sep 2024
- 2024FEDKIM: Adaptive Federated Knowledge Injection into Medical Foundation Models17 Aug 2024
50 newest of 54 All 54 (JSON)
- 2024ChatTS: Aligning Time Series with LLMs via Synthetic Data for Enhanced Understanding and Reasoningcited by 103
- 2024Language Models Still Struggle to Zero-shot Reason about Time Seriescited by 88
- 2025Advancing Conversational Diagnostic AI with Multimodal Reasoningcited by 20
- 2025DocHop-QA: Towards Multi-Hop Reasoning over Multimodal Document Collectionscited by 8
- 2025Eliciting Chain-of-Thought Reasoning for Time Series Analysis using Reinforcement Learningcited by 5
- 2026ECG-Reasoning-Benchmark: A Benchmark for Evaluating Clinical Reasoning Capabilities in ECG Interpretationcited by 4
- 2026MMTClinic: Multimodal, Multilingual Time Series Question Answering and Reasoning Benchmark for Clinical Domaincited by 0
- 2026WearableQA: A Benchmark for Health Reasoning over Real-World Wearable Datacited by 0
- 2026HealthLoopQA: A Context-Aware Question Answering Benchmark for Interpreting Wearable Monitoring Data in Diabetes Carecited by 0
- 2026HealthLoopQA: A Context-Aware Question Answering Benchmark for Interpreting Wearable Monitoring Data in Diabetes Care7 Sep 2026
- 2026WearableQA: A Benchmark for Health Reasoning over Real-World Wearable Data4 Sep 2026
- 2026MMTClinic: Multimodal, Multilingual Time Series Question Answering and Reasoning Benchmark for Clinical Domain4 Sep 2026
- 2026ECG-Reasoning-Benchmark: A Benchmark for Evaluating Clinical Reasoning Capabilities in ECG Interpretation15 Mar 2026
- 2025Eliciting Chain-of-Thought Reasoning for Time Series Analysis using Reinforcement Learning1 Oct 2025
- 2025DocHop-QA: Towards Multi-Hop Reasoning over Multimodal Document Collections20 Aug 2025
- 2025Advancing Conversational Diagnostic AI with Multimodal Reasoning6 May 2025
- 2024ChatTS: Aligning Time Series with LLMs via Synthetic Data for Enhanced Understanding and Reasoning4 Dec 2024
- 2024Language Models Still Struggle to Zero-shot Reason about Time Series17 Apr 2024
- 2024Large Language Models for Time Series: A Surveycited by 114
- 2024TimeSeriesExam: A time series understanding examcited by 49
- 2024Position: What Can Large Language Models Tell Us about Time Series Analysiscited by 47
- 2024Teach Multimodal LLMs to Comprehend Electrocardiographic Imagescited by 28
- 2024Large Language Model Benchmarks in Medical Taskscited by 17
- 2025anyECG-chat: A Generalist ECG-MLLM for Flexible ECG Input and Multi-Task Understandingcited by 10
- 2024FEDMEKI: A Benchmark for Scaling Medical Foundation Models via Federated Knowledge Injectioncited by 8
- 2025ECG-Expert-QA: A Benchmark for Evaluating Medical Large Language Models in Heart Disease Diagnosiscited by 6
- 2026ARFBench: Benchmarking Time Series Question Answering Ability for Software Incident Responsecited by 6
- 2024FEDKIM: Adaptive Federated Knowledge Injection into Medical Foundation Modelscited by 5
- 2024Electrocardiogram-Language Model for Few-Shot Question Answering with Meta Learningcited by 5
- 2025QuAnTS: Question Answering on Time Seriescited by 5
12 most cited of 40 All 40 (JSON)
- 2026TimeNet: An Extensible Unified Data Infrastructure for Next-Generation Temporal Foundation Models3 Oct 2026
- 2026Lotus: Learning to Understand Time-series by Learning to Forecast1 Oct 2026
- 2026Detect, Explain, Interpret: An End-to-End Benchmark for Time Series Anomaly Detection, Explainability and Interpretability1 Oct 2026
- 2026TRACE: Expert-Aligned ECG Representation Learning with Rigorous Benchmarking and Real-World Validation in Acute Cardiac Care28 Sep 2026
- 2026ECG-Scroll: A Long-Horizon, Streaming Benchmark and Agent Environment for Interpretation of Ambulatory Electrocardiograms27 Sep 2026
- 2026AnesTRACE: Benchmarking Intraoperative Anesthesia from Multimodal Perception to Multi-step Decision-Making26 Sep 2026
- 2026LabFactory: Building and Evaluating Executable AI Labs23 Sep 2026
- 2026Large language models in medical time series analysis7 Sep 2026
- 2026ECGQuest: Benchmarking and Fine-Tuning Language Models for Electrocardiography31 Aug 2026
- 2026Diagnosing as Cardiologists Do: ECG Agents with Doctor-Grounded Priors for Clinical Reasoning Across Diseases and Populations10 Aug 2026
- 2026TimeRLM: Recursive Language Models Enable Precise Anomaly Localization in Long-Context Time-Series4 Aug 2026
- 2026Failures Reveal What Metrics Miss: An Evidence-Driven Agent for Recursive Refinement of ECG Classifiers27 Jul 2026
12 newest of 40 All 40 (JSON)