mlsanityData to 14 Oct 2026

Multimodal Clinical Benchmark for Emergency Care (MC-BEC): A Comprehensive Benchmark for Evaluating Foundation Models in Emergency Medicine

arXiv 2311.04937 ↗First posted 7 Nov 2023cs.LG cs.AIcited by 24

Not on the map. Why?

Abstract (arXiv)

We propose the Multimodal Clinical Benchmark for Emergency Care (MC-BEC), a comprehensive benchmark for evaluating foundation models in Emergency Medicine using a dataset of 100K+ continuously monitored Emergency Department visits from 2020-2022. MC-BEC focuses on clinically relevant prediction tasks at timescales from minutes to days, including predicting patient decompensation, disposition, and emergency department (ED) revisit, and includes a standardized evaluation framework with train-test splits and evaluation metrics. The multimodal dataset includes a wide range of detailed clinical data, including triage information, prior diagnoses and medications, continuously measured vital signs, electrocardiogram and photoplethysmograph waveforms, orders placed and medications administered throughout the visit, free-text reports of imaging studies, and information on ED diagnosis, disposition, and subsequent revisits. We provide performance baselines for each prediction task to enable the evaluation of multimodal, multitask models. We believe that MC-BEC will encourage researchers to develop more effective, generalizable, and accessible foundation models for multimodal clinical data.

Key facts. Cited by 24 papers in the map (data through 14 Oct 2026). Builds on 21 of its 41 references that are in the map. First posted on arXiv 7 Nov 2023.

Builds on

21 of 41 references.

References · 21

  1. 2021On the Opportunities and Risks of Foundation Modelscited by 4,033
  2. 2019Optuna: A Next-generation Hyperparameter Optimization Frameworkcited by 2,501
  3. 2022OFA: Unifying Architectures, Tasks, and Modalities Through a Simple Sequence-to-Sequence Learning Frameworkcited by 745
  4. 2021Perceiver IO: A General Architecture for Structured Inputs & Outputscited by 629
  5. 2019ClinicalBERT: Modeling Clinical Notes and Predicting Hospital Readmissioncited by 493
  6. 2019What Makes Training Multi-Modal Classification Networks Hard?cited by 344
  7. 2017Multitask learning and benchmarking with clinical time series datacited by 290
  8. 2019BEHRT: Transformer for Electronic Health Recordscited by 263
  9. 2019MIMIC-Extract: A Data Extraction, Preprocessing, and Representation Pipeline for MIMIC-IIIcited by 122
  10. 2022Modality Competition: What Makes Joint Training of Multi-modal Network Fail in Deep Learning? (Provably)cited by 122
  11. 2019Well-Read Students Learn Better: On the Importance of Pre-training Compact Modelscited by 120
  12. 2023EHRSHOT: An EHR Benchmark for Few-Shot Evaluation of Foundation Modelscited by 105
9 more
  1. 2020Language Models Are An Effective Patient Representation Learning Technique For Electronic Health Record Datacited by 87
  2. 2022Integrated multimodal artificial intelligence framework for healthcare applicationscited by 71
  3. 2021Generalization in NLI: Ways (Not) To Go Beyond Simple Heuristicscited by 67
  4. 2022An Extensive Data Processing Pipeline for MIMIC-IVcited by 40
  5. 2021HiRID-ICU-Benchmark -- A Comprehensive Machine Learning Benchmark on High-resolution ICU Datacited by 39
  6. 2019Benchmarking machine learning models on multi-centre eICU critical care datasetcited by 35
  7. 2021Benchmarking emergency department triage prediction models with machine learning and large public electronic health recordscited by 31
  8. 2023The Shaky Foundations of Clinical Foundation Models: A Survey of Large Language Models and Foundation Models for EMRscited by 29
  9. 2021Unifying Heterogeneous Electronic Health Records Systems via Text-Based Code Embeddingcited by 24

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 8; 2025: 9; 2026: 7.

24 papers.

Sort:

By area:

  1. 2024GraphArena: Evaluating and Exploring Large Language Models on Graph Computationcited by 49
  2. 2024Emergency Department Decision Support using Clinical Pseudo-notescited by 22
  3. 2025ER-Reason: A Benchmark Dataset for LLM Clinical Reasoning in the Emergency Roomcited by 22
  4. 2024Can Large Language Models abstract Medical Coded Language?cited by 20
  5. 2024Text Serialization and Their Relationship with the Conventional Paradigms of Tabular Machine Learningcited by 17
  6. 2024Enhancing clinical decision support with physiological waveforms -- a multimodal benchmark in emergency carecited by 15
  7. 2025MAP: Evaluation and Multi-Agent Enhancement of Large Language Models for Inpatient Pathwayscited by 10
  8. 2025A Collection of Innovations in Medical AI for patient records in 2024cited by 7
  9. 2025Serialized EHR make for good text representationscited by 7
  10. 2025FoMoH: A clinically meaningful foundation model evaluation for structured electronic health recordscited by 6
  11. 2025MTBBench: A Multimodal Sequential Clinical Decision-Making Benchmark in Oncologycited by 6
  12. 2024Towards Foundation Models for Critical Care Time Seriescited by 4
12 more
  1. 2026AgentRx: A Benchmark Study of LLM Agents for Multimodal Clinical Prediction Taskscited by 3
  2. 2024Fairness at Every Intersection: Uncovering and Mitigating Intersectional Biases in Multimodal Clinical Predictionscited by 2
  3. 2025FairTune: A Bias-Aware Fine-Tuning Framework Towards Fair Heart Rate Prediction from PPGcited by 2
  4. 2025T-FIX: Text-Based Explanations with Features Interpretable to eXpertscited by 2
  5. 2026From Triage to Discharge: A Survey of NLP Tasks, Methods, and Open Challenges in the Emergency Departmentcited by 1
  6. 2026ECG Mirage: Revealing and Mitigating the Underutilisation of ECGs in Vision-Language Models for Clinical Predictioncited by 1
  7. 2024Efficient Multi-View Fusion and Flexible Adaptation to View Missing in Cardiovascular System Signalscited by 0
  8. 2025Stable Prediction of Adverse Events in Medical Time-Series Datacited by 0
  9. 2026When Does Multimodal Learning Help in Healthcare? A Benchmark on EHR and Chest X-Ray Fusioncited by 0
  10. 2026MuteBench: Modality Unavailability Tolerance Evaluation for Incomplete Multimodal Fusioncited by 0
  11. 2026EarlyDx: An Admission-Anchored Benchmark for Open-Ended Generation of Evidence-Supported ED-Encounter Diagnosescited by 0
  12. 2026OpenTumorBoard: A Real-World Benchmark of Multidisciplinary Tumor Board Discussion Trajectoriescited by 0