mlsanityData to 14 Oct 2026

CellDX AI Autopilot: Agent-Guided Training and Deployment of Pathology Classifiers

arXiv 2605.10362 ↗First posted 11 May 2026cs.CVcited by 0

On the map: LLM agents and tool use → Medical and scientific domain agents

Abstract (arXiv)

Training AI models for computational pathology currently requires access to expensive whole-slide-image datasets, GPU infrastructure, deep expertise in machine learning, and substantial engineering effort. We present CellDX AI Autopilot, a platform that lets users -- from pathologists with no ML background to ML practitioners running many parallel experiments -- train, evaluate, and deploy whole-slide image classifiers through natural language interaction with an AI agent. The platform provides a structured set of agent skills that guide the user through dataset curation, automated hyperparameter tuning, multi-strategy model comparison, and human-in-the-loop deployment, all on a pre-built dataset of over 32,000 cases and 66,000 H&E-stained whole-slide images with pre-extracted features. We describe the agent skill architecture, the underlying Multiple Instance Learning (MIL) training framework supporting four classification strategies, and an iterative pairwise hyperparameter search (grid or seeded random) that reduces tuning cost by over 30x compared to exhaustive search. CellDX AI Autopilot is, to our knowledge, the first system to expose pathology-specialized agent skills and a pathology-specialized training platform to general-purpose AI agents (e.g. any LLM-based agent runtime), delivering end-to-end automated model training without requiring the agent itself to be domain-specific. The platform addresses both the ML-expertise bottleneck that limits adoption in diagnostic pathology and the engineering bottleneck that limits how many experiments a researcher can run cost-effectively.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Medical and scientific domain agents, one of 16 directions in LLM agents and tool use. Builds on 11 of its 24 references that are in the map. First posted on arXiv 11 May 2026.

Builds on

11 of 24 references.

References · 11

  1. 2023AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversationcited by 1,988
  2. 2018Attention-based Deep Multiple Instance Learningcited by 1,095
  3. 2020Data Efficient and Weakly Supervised Computational Pathology on Whole Slide Imagescited by 745
  4. 2023MLAgentBench: Evaluating Language Agents on Machine Learning Experimentationcited by 366
  5. 2022Scaling Vision Transformers to Gigapixel Images via Hierarchical Self-Supervised Learningcited by 359
  6. 2024Data Interpreter: An LLM Agent For Data Sciencecited by 225
  7. 2020Auto-Sklearn 2.0: Hands-free AutoML via Meta-Learningcited by 174
  8. 2024DS-Agent: Automated Data Science by Empowering Large Language Models with Case-Based Reasoningcited by 125
  9. 2023Virchow: A Million-Slide Digital Pathology Foundation Modelcited by 90
  10. 2024Hibou: A Family of Foundational Vision Transformers for Pathologycited by 57
  11. 2023Slideflow: Deep Learning for Digital Histopathology with Real-Time Whole-Slide Visualizationcited by 7

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Democratizing and accelerating AI-driven pathology research through agentic intelligence
  2. 2025CPathAgent: An Agent-based Foundation Model for Interpretable High-Resolution Pathology Image Analysis Mimicking Pathologists' Diagnostic Logic
  3. 2025TeamPath: Building MultiModal Pathology Experts with Reasoning AI Copilots
  4. 2025Evidence-based diagnostic reasoning with multi-agent copilot for human pathology
  5. 2025PathFinder: A Multi-Modal Multi-Agent System for Medical Diagnostic Decision-Making Applied to Histopathology
  6. 2023PathAsst: A Generative Foundation AI Assistant Towards Artificial General Intelligence of Pathology
  7. 2025PixCell: A generative foundation model for digital histopathology images
  8. 2025Pathology-CoT: Learning Visual Chain-of-Thought Agent from Expert Whole Slide Image Diagnosis Behavior