mlsanityData to 14 Oct 2026

scBench-Long: Verifiable Benchmarking of Long-Horizon Single-Cell Biology

arXiv 2606.26563 ↗First posted 25 Jun 2026q-bio.GN cs.AIcited by 1

Not on the map. Why?

Abstract (arXiv)

Single-cell studies require analysts to convert raw measurements into specific biological claims through multi-step workflows and integration of metadata, assay context, and auxiliary evidence. Existing AI-biology benchmarks largely measure broad knowledge, executable workflows, or local analysis steps. We introduce scBench-Long, a benchmark for long-horizon single-cell biology in which agents must recover scientific conclusions from raw or near-raw data without prescribed methods. The benchmark contains 21 evaluations spanning melanoma CD8 T-cell reactivity, CD8 RNA+ATAC regulatory inference, human--monkey chimera development, KRAS-driven lung tumor aging, and lethal COVID-19 lung pathology. Tasks cover paired scRNA/TCR sequencing, RNA and chromatin profiling, cross-species transcriptomics, combinatorial scRNA-seq, single-nucleus RNA-seq, immune repertoires, ortholog maps, ligand--receptor resources, and validation evidence. Candidate claims are reproduced, reviewed, and converted into controlled answer vocabularies with deterministic grading and trajectory rubrics. Across 1,068 completed trajectories, the strongest model--harness pair passes 16/63 runs (25.4%). scBench-Long evaluates whether agents can move beyond local analysis steps and make complex scientific claims that are supported by single-cell data.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 8 of its 47 references that are in the map. First posted on arXiv 25 Jun 2026.

Builds on

8 of 47 references.

References · 8

  1. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
  2. 2023Let's Verify Step by Stepcited by 3,789
  3. 2023G-Eval: NLG Evaluation using GPT-4 with Better Human Alignmentcited by 2,276
  4. 2023Large Language Models are not Fair Evaluatorscited by 1,085
  5. 2024LAB-Bench: Measuring Capabilities of Language Models for Biology Researchcited by 156
  6. 2025BixBench: a Comprehensive Benchmark for LLM-based Agents in Computational Biologycited by 89
  7. 2025SpatialBench: Can Agents Analyze Real-World Spatial Biology Data?cited by 6
  8. 2026Verifiable Benchmarking of Long-Horizon Spatial Biologycited by 3

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.