EpiBench: Verifiable Evaluation of AI Agents on Epigenomics Analysis
On the map: LLM agents and tool use → Medical and scientific domain agents
Abstract (arXiv)
We introduce EpiBench, a verifiable benchmark for short-horizon epigenomics analysis. EpiBench evaluates whether agents can make well-defined analysis decisions from realistic workflow states and return deterministically gradable answers. The benchmark includes 106 evaluations across CUT&Tag/CUT&RUN, ATAC-seq, ChIP-seq, and DNA methylation workflows. Across 5,088 valid trajectories from 16 model-harness pairs, no system passed a majority of attempts: GPT-5.5 / Pi led at 45.0% (143/318 attempts; 95% confidence interval (CI), 36.3--53.7), followed by GPT-5.5 / OpenAI Codex at 39.9% (127/318 attempts; 95% CI, 31.6--48.3). Claude Opus 4.8 Max / Pi and GPT-5.4 / Pi each passed 39.0% (124/318 attempts; 95% CI, 30.2--47.8 and 31.0--47.0, respectively). Performance varies across assay types, and many failed runs still contain parts of the correct answer. Agents often found the right files and computed useful intermediate results, but failed when the task required deeper, assay-specific scientific judgment.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Medical and scientific domain agents, one of 16 directions in LLM agents and tool use. Builds on 3 of its 17 references that are in the map. First posted on arXiv 11 Jun 2026.
Builds on
3 of 17 references.
Closest ancestors · 1
Same direction, newest first
Other references · 2
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026EpiBench: Benchmarking Multi-turn Research Workflows for Multimodal Agents
- 2025BioDSA-1K: Benchmarking Data Science Agents for Biomedical Research
- 2026BioAgent Bench: An AI Agent Evaluation Suite for Bioinformatics
- 2025Benchmarking LLM-based agents for single-cell omics analysis
- 2026TruthInsightBench: An Evidence-Grounded Benchmark for Automated Evaluation of Open-Ended Scientific Discovery Agents
- 2026Evaluating Agentic Bioinformatics through Function, Evidence, and Validation
- 2026VERITAS: A Multi-Agent Co-Scientist for Verifiable Image-Derived Hypothesis Testing ↗
- 2026BixBench3: Benchmarking AI agents on research-study-scale computational biology tasks