AblateCell: A Reproduce-then-Ablate Agent for Virtual Cell Repositories
Not on the map. Why?
Abstract (arXiv)
Systematic ablations are essential to attribute performance gains in AI Virtual Cells, yet they are rarely performed because biological repositories are under-standardized and tightly coupled to domain-specific data and formats. While recent coding agents can translate ideas into implementations, they typically stop at producing code and lack a verifier that can reproduce strong baselines and rigorously test which components truly matter. We introduce AblateCell, a reproduce-then-ablate agent for virtual cell repositories that closes this verification gap. AblateCell first reproduces reported baselines end-to-end by auto-configuring environments, resolving dependency and data issues, and rerunning official evaluations while emitting verifiable artifacts. It then conducts closed-loop ablation by generating a graph of isolated repository mutations and adaptively selecting experiments under a reward that trades off performance impact and execution cost. Evaluated on three single-cell perturbation prediction repositories (CPA, GEARS, BioLORD), AblateCell achieves 88.9% (+29.9% to human expert) end-to-end workflow success and 93.3% (+53.3% to heuristic) accuracy in recovering ground-truth critical components. These results enable scalable, repository-grounded verification and attribution directly on biological codebases.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 37 of its 58 references that are in the map. First posted on arXiv 21 Apr 2026.
Builds on
37 of 58 references.
References · 37
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
- 2024SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineeringcited by 1,737
- 2024The AI Scientist: Towards Fully Automated Open-Ended Scientific Discoverycited by 1,071
- 2024Large Language Model based Multi-Agents: A Survey of Progress and Challengescited by 769
- 2025The AI Scientist-v2: Workshop-Level Automated Scientific Discovery via Agentic Tree Searchcited by 422
- 2023RepoCoder: Repository-Level Code Completion Through Iterative Retrieval and Generationcited by 367
- 2024CodeAgent: Enhancing Code Generation with Tool-Integrated Agent Systems for Real-World Repo-level Coding Challengescited by 282
- 2024ResearchAgent: Iterative Research Idea Generation over Scientific Literature with Large Language Modelscited by 210
- 2024SciCode: A Research Coding Benchmark Curated by Scientistscited by 178
- 2024CORE-Bench: Fostering the Credibility of Published Research Through a Computational Reproducibility Agent Benchmarkcited by 123
- 2025From Automation to Autonomy: A Survey on Large Language Models in Scientific Discoverycited by 93
- 2025Agentic AI for Scientific Discovery: A Survey of Progress, Challenges, and Future Directionscited by 77
25 more
- 2025From AI for Science to Agentic Science: A Survey on Autonomous Scientific Discoverycited by 77
- 2025Paper2Code: Automating Code Generation from Scientific Papers in Machine Learningcited by 70
- 2025MLR-Bench: Evaluating AI Agents on Open-Ended Machine Learning Researchcited by 64
- 2024How to Build the Virtual Cell with Artificial Intelligence: Priorities and Opportunitiescited by 57
- 2023Modelling Cellular Perturbations with the Sparse Additive Mechanism Shift Variational Autoencodercited by 38
- 2025A Survey of Scientific Large Language Models: From Data Foundations to Agent Frontierscited by 37
- 2025ResearchCodeBench: Benchmarking LLMs on Implementing Novel Machine Learning Research Codecited by 36
- 2024PerturBench: Benchmarking Machine Learning Models for Cellular Perturbation Analysiscited by 35
- 2023LLMs for Science: Usage for Code Generation and Data Analysiscited by 34
- 2025Scientists' First Exam: Probing Cognitive Abilities of MLLM via Perception, Understanding, and Reasoningcited by 34
- 2025Probing Scientific General Intelligence of LLMs with Scientist-Aligned Workflowscited by 28
- 2024scDiffusion: conditional generation of high-quality single-cell data using diffusion modelcited by 24
- 2025Paper2Agent: Reimagining Research Papers As Interactive and Reliable AI Agentscited by 23
- 2025REPRO-Bench: Can Agentic AI Systems Assess the Reproducibility of Social Science Research?cited by 21
- 2025RepoMaster: Autonomous Exploration and Understanding of GitHub Repositories for Complex Task Solvingcited by 19
- 2025RExBench: Can coding agents autonomously implement AI research extensions?cited by 18
- 2025Process-Level Trajectory Evaluation for Environment Configuration in Software Engineering Agentscited by 18
- 2025AbGen: Evaluating Large Language Models in Ablation Study Design and Evaluation for Scientific Researchcited by 13
- 2025CellForge: Agentic Design of Virtual Cell Modelscited by 13
- 2025Insights from the ICLR Peer Review and Rebuttal Processcited by 11
- 2025Unifying Tree Search Algorithm and Reward Design for LLM Reasoning: A Surveycited by 9
- 2025scPPDM: A Diffusion Model for Single-Cell Drug-Response Predictioncited by 6
- 2025scAgent: Universal Single-Cell Annotation via a LLM Agentcited by 5
- 2025GenCellAgent: Generalizable, Training-Free Cellular Image Segmentation via Large Language Model Agentscited by 3
- 2025AblationBench: Evaluating Automated Planning of Ablations in Empirical AI Researchcited by 2
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Discover, Falsify, Revise: Auditing Input-Use Claims from Source Code to Predictive Contribution in Agent-Discovered Cell Models
- 2026OmniVCBench: Benchmarking Evidence-Grounded Multimodal Reasoning Towards AI Virtual Cells
- 2026AssayBench: An Assay-Level Virtual Cell Benchmark for LLMs and Agents
- 2025VCWorld: A Biological World Model for Virtual Cell Simulation
- 2026Towards Autonomous Mechanistic Reasoning in Virtual Cells
- 2026VERITAS: Towards a General-Purpose Replication Tool for Scientific Research
- 2025From Reproduction to Replication: Evaluating Research Agents with Progressive Code Masking
- 2026VCLMU: Mechanism-Centric Virtual Cell World Modeling for Perturbation Response