ESL-Bench: An Event-Driven Synthetic Longitudinal Benchmark for Health Agents
On the map: LLM agents and tool use → Medical and scientific domain agents
Abstract (arXiv)
Longitudinal health agents must reason across multi-source trajectories that combine continuous device streams, sparse clinical exams, and episodic life events - yet evaluating them is hard: real-world data cannot be released at scale, and temporally grounded attribution questions seldom admit definitive answers without structured ground truth. We present ESL-Bench, an event-driven synthesis framework and benchmark providing 100 synthetic users, each with a 1-5 year trajectory comprising a health profile, a multi-phase narrative plan, daily device measurements, periodic exam records, and an event log with explicit per-indicator impact parameters. Each indicator follows a baseline stochastic process driven by discrete events with sigmoid-onset, exponential-decay kernels under saturation and projection constraints; a hybrid pipeline delegates sparse semantic artifacts to LLM-based planning and dense indicator dynamics to algorithmic simulation with hard physiological bounds. Users are each paired with 100 evaluation queries across five dimensions - Lookup, Trend, Comparison, Anomaly, Explanation - stratified into Easy, Medium, and Hard tiers, with all ground-truth answers programmatically computable from the recorded event-indicator relationships. Evaluating 13 methods spanning LLMs with tools, DB-native agents, and memory-augmented RAG, we find that DB agents (48-58%) substantially outperform memory RAG baselines (30-38%), with the gap concentrated on Comparison and Explanation queries where multi-hop reasoning and evidence attribution are required.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Medical and scientific domain agents, one of 16 directions in LLM agents and tool use. Builds on 13 of its 41 references that are in the map. First posted on arXiv 3 Apr 2026.
Builds on
13 of 41 references.
Closest ancestors · 2
Same direction, newest first
- 2025MedAgentBoard: Benchmarking Multi-Agent Collaboration with Conventional Methods for Diverse Medical Tasks18 May
- 2025MedAgentBench: A Realistic Virtual EHR Environment to Benchmark Medical LLM Agents24 Jan
Other references · 11
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
- 2017Generating Multi-label Discrete Patient Records using Generative Adversarial Networkscited by 197
- 2018emrQA: A Large Corpus for Question Answering on Electronic Medical Recordscited by 134
- 2023EHRSHOT: An EHR Benchmark for Few-Shot Evaluation of Foundation Modelscited by 101
- 2025A Survey of Graph Retrieval-Augmented Generation for Customized Large Language Modelscited by 85
- 2021Generating Synthetic Mixed-type Longitudinal Electronic Health Records for Artificial Intelligent Applicationscited by 47
- 2022A Multifaceted Benchmarking of Synthetic Electronic Health Record Generation Modelscited by 43
- 2023EHRSQL: A Practical Text-to-SQL Benchmark for Electronic Health Recordscited by 42
- 2025TIMER: Temporal Instruction Modeling and Evaluation for Longitudinal Clinical Recordscited by 33
- 2024A Review on Generative AI Models for Synthetic Medical Text, Time Series, and Longitudinal Datacited by 10
- 2025DyG-RAG: Dynamic Graph Retrieval-Augmented Generation with Event-Centric Reasoningcited by 8
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026HEARTS: Benchmarking LLM Reasoning on Health Time Series
- 2026LifeLong Digital Twin: A Unified Modeling Paradigm and Agent Harness for Event-Driven Lifelong Health State Trajectories
- 2026Vital Trace: Protocol-Constrained Patient-State Reasoning for Longitudinal Clinical Trajectories
- 2026ClinLens: Towards Long-Horizon Coding Agents for Longitudinal Multimodal Clinical Data Science
- 2026TrajOnco: a multi-agent framework for temporal reasoning over longitudinal EHR for multi-cancer early detection
- 2026LongMedBench: Benchmarking Medical Agents for Long-Horizon Clinical Decision-Making
- 2026LifeAgentBench: Benchmarking LLMs for Long-Horizon, Cross-Dimensional Lifestyle Health Reasoning
- 2026Medical world models in healthcare: foundations, applications, and challenges for trustworthy clinical translation