mlsanityData to 14 Oct 2026

Verifiable Benchmarking of Long-Horizon Spatial Biology

arXiv 2605.28065 ↗First posted 27 May 2026cs.AIcited by 3

Not on the map. Why?

Abstract (arXiv)

AI agents are increasingly useful for biological data analysis, but existing benchmarks mostly test broad biological knowledge, executable workflows, or localized analysis steps rather than end-to-end scientific reasoning over spatial measurements. We introduce SpatialBench-Long, a benchmark for long-horizon spatial biology in which agents must recover biological claims from raw or near-raw data and calibrated experimental context without prescribed methods. SpatialBench-Long contains 24 evaluations across primary pancreatic ductal adenocarcinoma (PDAC), engineered glioblastoma organoids and in vivo tumors, Cas9 lineage-traced lung adenocarcinoma, and mouse optic nerve aging/intervention systems, spanning CosMx, Visium, Xenium, multiplexed error-robust fluorescence in situ hybridization (MERFISH), single-cell RNA sequencing (scRNA-seq), Slide-seq, Slide-tags, histology, and lineage-recording data. Candidate claims are hardened through reproduction, independent scientist review, and trajectory inspection. Final answers are graded deterministically over controlled vocabularies and symbols with companion rubrics capturing progress through key analysis chokepoints. Across the SpatialBench-Long benchmark, three model-harness pairs tie at 8/72 runs (11.1%): Gemini 3.5 Flash / Pi terminal coding harness, GPT-5.5 / Pi, and GPT-5.5 / OpenAI Codex. SpatialBench-Long tests whether agents can move beyond executing procedural analysis to deriving accurate scientific conclusions from complex spatial measurements.

Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 6 of its 32 references that are in the map. First posted on arXiv 27 May 2026.

Builds on

6 of 32 references.

References · 6

  1. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
  2. 2023Let's Verify Step by Stepcited by 3,789
  3. 2023Large Language Models are not Fair Evaluatorscited by 1,085
  4. 2024LAB-Bench: Measuring Capabilities of Language Models for Biology Researchcited by 156
  5. 2025BixBench: a Comprehensive Benchmark for LLM-based Agents in Computational Biologycited by 89
  6. 2025SpatialBench: Can Agents Analyze Real-World Spatial Biology Data?cited by 6

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 3.

3 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026How Spatial Biologists Direct and Verify AI-Assisted Analyses ↗
  2. 2026BIABench: Evaluating AI agents on real-world bioimage analysis tasks
  3. 2026CodeCytos: AI-assisted spatial molecular imaging analysis via code-augmented agent action space
  4. 2026LABBench2: An Improved Benchmark for AI Systems Performing Biology Research
  5. 2026SpaCellAgent: A Self-Evolving LLM-Based Multi-Agent Framework for Trajectory Analysis
  6. 2026AssayBench: An Assay-Level Virtual Cell Benchmark for LLMs and Agents
  7. 2026ST-Bench: A Spatial-Temporal Benchmark for Multi-Agent System Generation on Scientific Research Tasks
  8. 2025ContextFlow: Context-Aware Flow Matching For Trajectory Inference From Spatial Omics Data