Simple Agents Outperform Experts in Biomedical Imaging Workflow Optimization
Not on the map. Why?
Abstract (arXiv)
Adapting production-level computer vision tools to bespoke scientific datasets is a critical "last mile" bottleneck. Current solutions are impractical: fine-tuning requires large annotated datasets scientists often lack, while manual code adaptation costs scientists weeks to months of effort. We consider using AI agents to automate this manual coding, and focus on the open question of optimal agent design for this targeted task. We introduce a systematic evaluation framework for agentic code optimization and use it to study three production-level biomedical imaging pipelines. We demonstrate that a simple agent framework consistently generates adaptation code that outperforms human-expert solutions. Our analysis reveals that common, complex agent architectures are not universally beneficial, leading to a practical roadmap for agent design. We open source our framework and validate our approach by deploying agent-generated functions into a production pipeline, demonstrating a clear pathway for real-world impact.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 34 of its 118 references that are in the map. First posted on arXiv 2 Dec 2025.
Builds on
34 of 118 references.
References · 34
- 2023Segment Anythingcited by 8,158
- 2019Optuna: A Next-generation Hyperparameter Optimization Frameworkcited by 2,455
- 2023Voyager: An Open-Ended Embodied Agent with Large Language Modelscited by 2,081
- 2017A Survey on Deep Learning in Medical Image Analysiscited by 1,182
- 2024The AI Scientist: Towards Fully Automated Open-Ended Scientific Discoverycited by 1,002
- 2024OpenHands: An Open Platform for AI Software Developers as Generalist Agentscited by 956
- 2024MLE-bench: Evaluating Machine Learning Agents on Machine Learning Engineeringcited by 429
- 2020AutoGluon-Tabular: Robust and Accurate AutoML for Structured Datacited by 368
- 2021Domain Adaptation for Medical Image Analysis: A Surveycited by 351
- 2023MLAgentBench: Evaluating Language Agents on Machine Learning Experimentationcited by 339
- 2024ScienceAgentBench: Toward Rigorous Assessment of Language Agents for Data-Driven Scientific Discoverycited by 208
- 2025AIDE: AI-Driven Exploration in the Space of Codecited by 206
22 more
- 2020Auto-Sklearn 2.0: Hands-free AutoML via Meta-Learningcited by 174
- 2024RE-Bench: Evaluating frontier AI R&D capabilities of language model agents against human expertscited by 153
- 2024Efficient Test-Time Adaptation of Vision-Language Modelscited by 138
- 2024AutoML-Agent: A Multi-Agent LLM Framework for Full-Pipeline AutoMLcited by 84
- 2020Annotation-efficient deep learning for automatic medical image segmentationcited by 79
- 2020Auto-PyTorch Tabular: Multi-Fidelity MetaLearning for Efficient and Robust AutoDLcited by 67
- 2025AI Research Agents for Machine Learning: Search, Exploration, and Generalization in MLE-benchcited by 65
- 2025ML-Master: Towards AI-for-AI via Integration of Exploration and Reasoningcited by 57
- 2024CRISPR-GPT for Agentic Automation of Gene-editing Experimentscited by 56
- 2024BioDiscoveryAgent: An AI Agent for Designing Genetic Perturbation Experimentscited by 49
- 2023Overcoming Data Scarcity in Biomedical Imaging with a Foundational Multi-Task Modelcited by 40
- 2023The Multi-modality Cell Segmentation Challenge: Towards Universal Solutionscited by 39
- 2025Current Pathology Foundation Models are unrobust to Medical Center Differencescited by 37
- 2023Domain Generalization in Computational Pathology: Survey and Guidelinescited by 29
- 2023Each Test Image Deserves A Specific Prompt: Continual Test-Time Adaptation for 2D Medical Image Segmentationcited by 29
- 2022Benchmarking the Robustness of Deep Neural Networks to Common Corruptions in Digital Pathologycited by 26
- 2024Sequential Large Language Model-Based Hyper-parameter Optimizationcited by 23
- 2021A large-scale study on research code quality and executioncited by 22
- 2025A co-evolving agentic AI system for medical imaging analysiscited by 16
- 2024Low-Resource Vision Challenges for Foundation Modelscited by 13
- 2024Impact of Stain Variation and Color Normalization for Prognostic Predictions in Pathologycited by 6
- 2024Domain adaptation in small-scale and heterogeneous biological datasetscited by 5
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Can Coding Agents Build Robust Baselines? A Skill-Based Approach for Automating the Medical Imaging Model-Development Pipeline
- 2025ReX-MLE: The Autonomous Agent Benchmark for Medical Imaging Challenges
- 2026A case study of evaluating AI agents on a neuroscience data-to-discovery pipeline
- 2026Towards Autonomous and Auditable Medical Imaging Model Development
- 2025M^3Builder: A Multi-Agent System for Automated Machine Learning in Medical Imaging
- 2026Evolving Medical Imaging Agents via Experience-driven Self-skill Discovery
- 2026Imaging-101: Benchmarking LLM Coding Agents on Scientific Computational Imaging
- 2025Position: Agentic Systems Constitute a Key Component of Next-Generation Intelligent Image Processing