Towards Autonomous and Auditable Medical Imaging Model Development
Not on the map. Why?
Abstract (arXiv)
Large language model (LLM) agents are beginning to automate machine learning engineering (MLE) by coupling planning, code execution, debugging, and empirical feedback. Translating this capability to medical imaging remains difficult because each task imposes modality-specific experimentation and strict requirements for validation protocols and prediction artifacts. Here we introduce AMID, an autonomous multi-agent framework for medical imaging model development. AMID first proposes Data-Conditioned Method Planning, which refines coarse task-level search spaces into executable, parallelizable method lanes grounded in task-specific data analysis and runnable medical-imaging resources. It then develops Verification-Guided Two-Stage Optimization, moving from broad early exploration of diverse method lanes to selective exploitation of promising candidates while enforcing strict verification of validation protocols, metric computation, and prediction artifacts throughout the optimization. Across 20 medical imaging challenge tasks spanning diverse modalities and prediction types, AMID outperformed evaluated general-purpose MLE systems and, on several tasks, approached or matched strong human-designed challenge solutions. These results suggest that AMID can turn task-specific medical imaging model development from bespoke manual engineering into an agentic workflow for producing high-performing and auditable model artifacts across heterogeneous tasks.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 61 of its 81 references that are in the map. First posted on arXiv 12 Jul 2026.
Builds on
61 of 81 references.
References · 61
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,510
- 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,193
- 2020Shortcut Learning in Deep Neural Networkscited by 1,928
- 2017A Survey on Deep Learning in Medical Image Analysiscited by 1,182
- 2024The AI Scientist: Towards Fully Automated Open-Ended Scientific Discoverycited by 1,002
- 2022TotalSegmentator: robust segmentation of 104 anatomical structures in CT imagescited by 597
- 2022MONAI: An open-source framework for deep learning in healthcarecited by 438
- 2024MLE-bench: Evaluating Machine Learning Agents on Machine Learning Engineeringcited by 429
- 2025Agent Laboratory: Using LLM Agents as Research Assistantscited by 405
- 2025The AI Scientist-v2: Workshop-Level Automated Scientific Discovery via Agentic Tree Searchcited by 375
- 2023MLAgentBench: Evaluating Language Agents on Machine Learning Experimentationcited by 339
38 more
- 2023Towards Generalist Biomedical AIcited by 286
- 2025PaperBench: Evaluating AI's Ability to Replicate AI Researchcited by 286
- 2025AIDE: AI-Driven Exploration in the Space of Codecited by 206
- 2023BiomedGPT: A Generalist Vision-Language Foundation Model for Diverse Biomedical Taskscited by 201
- 2021Reading Race: AI Recognises Patient's Racial Identity In Medical Imagescited by 155
- 2023Emergent autonomous scientific research capabilities of large language modelscited by 127
- 2024CORE-Bench: Fostering the Credibility of Published Research Through a Computational Reproducibility Agent Benchmarkcited by 115
- 2023CellViT: Vision Transformers for Precise Cell Segmentation and Classificationcited by 108
- 2024BiomedParse: a biomedical foundation model for image parsing of everything everywhere all at oncecited by 107
- 2022ISLES 2022: A multi-center magnetic resonance imaging stroke lesion segmentation datasetcited by 104
- 2025MedSAM2: Segment Anything in 3D Medical Images and Videoscited by 88
- 2025AI-Researcher: Autonomous Scientific Innovationcited by 88
- 2024SciAgent: Tool-augmented Language Models for Scientific Reasoningcited by 69
- 2024Phikon-v2, A large and public feature extractor for biomarker predictioncited by 67
- 2024VISTA3D: A Unified Segmentation Foundation Model For 3D Medical Imagingcited by 62
- 2025ML-Master: Towards AI-for-AI via Integration of Exploration and Reasoningcited by 57
- 2025DeepScientist: Advancing Frontier-Pushing Scientific Findings Progressivelycited by 56
- 2025CodeScientist: End-to-End Semi-Automated Scientific Discovery with Code-based Experimentationcited by 54
- 2025An AI system to help scientists write expert-level empirical softwarecited by 52
- 2024Autonomous LLM-driven research from data to human-verifiable research paperscited by 50
- 2025Barbarians at the Gate: How AI is Upending Systems Researchcited by 48
- 2026PostTrainBench: Can LLM Agents Automate LLM Post-Training?cited by 45
- 2026CORAL: Towards Autonomous Multi-Agent Evolution for Open-Ended Discoverycited by 38
- 2025R&D-Agent: An LLM-Agent Framework Towards Autonomous Data Sciencecited by 33
- 2025PiFlow: Principle-Aware Scientific Discovery with Multi-Agent Collaborationcited by 25
- 2026AutoResearchClaw: Self-Reinforcing Autonomous Research with Human-AI Collaborationcited by 23
- 2026MARS: Modular Agent with Reflective Search for Automated AI Researchcited by 22
- 2025REPRO-Bench: Can Agentic AI Systems Assess the Reproducibility of Social Science Research?cited by 21
- 2026MLEvolve: A Self-Evolving Framework for Automated Machine Learning Algorithm Discoverycited by 20
- 2025AutoMLGen: Navigating Fine-Grained Optimization for Coding Agentscited by 17
- 2026AutoSOTA: An End-to-End Automated Research System for State-of-the-Art AI Model Discoverycited by 17
- 2026ScientistOne: Towards Human-Level Autonomous Research via Chain-of-Evidencecited by 15
- 2025From Reproduction to Replication: Evaluating Research Agents with Progressive Code Maskingcited by 12
- 2026ARIS: Autonomous Research via Adversarial Multi-Agent Collaborationcited by 12
- 2026MLS-Bench: A Holistic and Rigorous Assessment of AI Systems on Building Better AIcited by 11
- 2025ReplicationBench: Can AI Agents Replicate Astrophysics Research Papers?cited by 10
- 2026AIBuildAI: An AI Agent for Automatically Building AI Modelscited by 10
- 2026Toward Generalist Autonomous Research via Hypothesis-Tree Refinementcited by 10
50 most cited of 61 All 61 (JSON)
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026Can Coding Agents Build Robust Baselines? A Skill-Based Approach for Automating the Medical Imaging Model-Development Pipeline
- 2025M^3Builder: A Multi-Agent System for Automated Machine Learning in Medical Imaging
- 2026Evolving Medical Imaging Agents via Experience-driven Self-skill Discovery
- 2026The Path to Self-Evolving Clinical Systems: Scaling Medical Agents from Assistance to Autonomy
- 2025Simple Agents Outperform Experts in Biomedical Imaging Workflow Optimization
- 2025Learning to Be A Doctor: Searching for Effective Medical Agent Architectures
- 2025Prompt Triage: Structured Optimization Enhances Vision-Language Model Performance on Medical Imaging Benchmarks
- 2025mAIstro: an open-source multi-agentic system for automated end-to-end development of radiomics and deep learning models for medical imaging