mlsanityData to 14 Oct 2026

CPathAgent: An Agent-based Foundation Model for Interpretable High-Resolution Pathology Image Analysis Mimicking Pathologists' Diagnostic Logic

arXiv 2505.20510 ↗First posted 26 May 2025cs.CVcited by 29

Not on the map. Why?

Abstract (arXiv)

Recent advances in computational pathology have led to the emergence of numerous foundation models. These models typically rely on general-purpose encoders with multi-instance learning for whole slide image (WSI) classification or apply multimodal approaches to generate reports directly from images. However, these models cannot emulate the diagnostic approach of pathologists, who systematically examine slides at low magnification to obtain an overview before progressively zooming in on suspicious regions to formulate comprehensive diagnoses. Instead, existing models directly output final diagnoses without revealing the underlying reasoning process. To address this gap, we introduce CPathAgent, an innovative agent-based approach that mimics pathologists' diagnostic workflow by autonomously navigating across WSI based on observed visual features, thereby generating substantially more transparent and interpretable diagnostic summaries. To achieve this, we develop a multi-stage training strategy that unifies patch-level, region-level, and WSI-level capabilities within a single model, which is essential for replicating how pathologists understand and reason across diverse image scales. Additionally, we construct PathMMU-HR2, the first expert-validated benchmark for large region analysis. This represents a critical intermediate scale between patches and whole slides, reflecting a key clinical reality where pathologists typically examine several key large regions rather than entire slides at once. Extensive experiments demonstrate that CPathAgent consistently outperforms existing approaches across benchmarks at three different image scales, validating the effectiveness of our agent-based diagnostic approach and highlighting a promising direction for computational pathology.

Key facts. Cited by 29 papers in the map (data through 14 Oct 2026). Builds on 39 of its 60 references that are in the map. First posted on arXiv 26 May 2025.

Builds on

39 of 60 references.

References · 39

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2025Qwen3 Technical Reportcited by 8,820
  3. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
  4. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
  5. 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,968
  6. 2025Qwen2.5-VL Technical Reportcited by 5,587
  7. 2023Improved Baselines with Visual Instruction Tuningcited by 4,418
  8. 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,182
  9. 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,568
  10. 2023InstructBLIP: Towards General-purpose Vision-Language Models with Instruction Tuningcited by 2,876
  11. 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,719
  12. 2023MetaGPT: Meta Programming for A Multi-Agent Collaborative Frameworkcited by 1,808
27 more
  1. 2021WebGPT: Browser-assisted question-answering with human feedbackcited by 1,745
  2. 2023LLaVA-Med: Training a Large Language-and-Vision Assistant for Biomedicine in One Daycited by 1,305
  3. 2022WebShop: Towards Scalable Real-World Web Interaction with Grounded Language Agentscited by 1,251
  4. 2018Attention-based Deep Multiple Instance Learningcited by 1,095
  5. 2023ChatDev: Communicative Agents for Software Developmentcited by 919
  6. 2020Data Efficient and Weakly Supervised Computational Pathology on Whole Slide Imagescited by 745
  7. 2023MM-REACT: Prompting ChatGPT for Multimodal Reasoning and Actioncited by 517
  8. 2020Dual-stream Multiple Instance Learning Network for Whole Slide Image Classification with Self-supervised Contrastive Learningcited by 478
  9. 2020PathVQA: 30000+ Questions for Medical Visual Question Answeringcited by 475
  10. 2023Describe, Explain, Plan and Select: Interactive Planning with Large Language Models Enables Open-World Multi-Task Agentscited by 398
  11. 2024AgentClinic: a multimodal agent benchmark to evaluate AI in simulated clinical environmentscited by 231
  12. 2024Agent Hospital: A Simulacrum of Hospital with Evolvable Medical Agentscited by 218
  13. 2023Quilt-1M: One Million Image-Text Pairs for Histopathologycited by 194
  14. 2022Re3: Generating Longer Stories With Recursive Reprompting and Revisioncited by 193
  15. 2024Multimodal Whole Slide Foundation Model for Pathologycited by 162
  16. 2024Virchow2: Scaling Self-Supervised Mixed Magnification Models in Pathologycited by 161
  17. 2024Empowering Biomedical Discovery with AI Agentscited by 118
  18. 2023Quilt-LLaVA: Visual Instruction Tuning by Extracting Localized Narratives from Open-Source Histopathology Videoscited by 86
  19. 2024PRISM: A Multi-Modal Generative Foundation Model for Slide-Level Histopathologycited by 85
  20. 2023Attention-Challenging Multiple Instance Learning for Whole Slide Image Classificationcited by 61
  21. 2023PathAsst: A Generative Foundation AI Assistant Towards Artificial General Intelligence of Pathologycited by 57
  22. 2024SlideChat: A Large Vision-Language Assistant for Whole-Slide Pathology Image Understandingcited by 57
  23. 2024PathMMU: A Massive Multimodal Expert-Level Benchmark for Understanding and Reasoning in Pathologycited by 43
  24. 2024HistGen: Histopathology Report Generation via Local-Global Feature Encoding and Cross-modal Context Interactioncited by 43
  25. 2025PathFinder: A Multi-Modal Multi-Agent System for Medical Diagnostic Decision-Making Applied to Histopathologycited by 39
  26. 2024WSI-VQA: Interpreting Whole Slide Images by Generative Visual Question Answeringcited by 34
  27. 2024CPath-Omni: A Unified Multimodal Foundation Model for Patch and Whole Slide Image Analysis in Computational Pathologycited by 34

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 8; 2026: 21.

29 papers.

Sort:

By area:

  1. 2025Evidence-based diagnostic reasoning with multi-agent copilot for human pathologycited by 27
  2. 2025PathAgent: Toward Interpretable Analysis of Whole-slide Pathology Images via Large Language Model-based Agentic Reasoningcited by 19
  3. 2025Patho-AgenticRAG: Towards Multimodal Agentic Retrieval-Augmented Generation for Pathology VLMs via Reinforcement Learningcited by 13
  4. 2025Pathology-CoT: Learning Visual Chain-of-Thought Agent from Expert Whole Slide Image Diagnosis Behaviorcited by 10
  5. 2025Navigating Gigapixel Pathology Images with Large Multimodal Modelscited by 7
  6. 2026PathReasoner-R1: Instilling Structured Reasoning into Pathology Vision-Language Model via Knowledge-Guided Policy Optimizationcited by 7
  7. 2026PathNavigate: A Training-Free Pathology Agent with Surprise-Guided Scan and Shared Slide Memory for Whole-Slide Image VQAcited by 7
  8. 2025LoC-Path: Learning to Compress for Pathology Multimodal Large Language Modelscited by 6
  9. 2025SurvAgent: Hierarchical CoT-Enhanced Case Banking and Dichotomy-Based Multi-Agent System for Multimodal Survival Predictioncited by 5
  10. 2026Act Like a Pathologist: Tissue-Aware Whole Slide Image Reasoningcited by 5
  11. 2026QCAgent: An agentic framework for quality-controllable pathology report generation from whole slide imagecited by 4
  12. 2025PathFound: An Agentic Multimodal Model Activating Evidence-seeking Pathological Diagnosiscited by 3
17 more
  1. 2026PathView-Bench: Can Multimodal Large Language Models Achieve Fine-grained Multiscale Understanding of Pathology Images?cited by 3
  2. 2026MMNavAgent: Multi-Magnification WSI Navigation Agent for Clinically Consistent Whole-Slide Analysiscited by 2
  3. 2026Computational Pathology in the Era of Emerging Foundation and Agentic AI -- International Expert Perspectives on Clinical Integration and Translational Readinesscited by 2
  4. 2026NuNext: Reframing Nucleus Detection as Next-Point Detectioncited by 2
  5. 2026The Path to Self-Evolving Clinical Systems: Scaling Medical Agents from Assistance to Autonomycited by 2
  6. 2026Do Pathology Vision-Language Models Truly See Pathology?cited by 2
  7. 2026Beyond Relevance: Bayesian Evidence Acquisition for Agentic Whole-Slide Image Reasoningcited by 2
  8. 2026Which Tool Response Should I Trust? Tool-Expertise-Aware Chest X-ray Agent with Multimodal Agentic Learningcited by 1
  9. 2026Agentic Visual Reasoning in Whole-Slide Pathology Images via Active Perceptioncited by 1
  10. 2026PathoSage: Towards Multi-Source Evidence Adjudication in Pathology via Experience-Aware Agentic Workflowcited by 0
  11. 2026Listen, Look, and Learn: Learning Without Forgetting through SAM-Audiocited by 0
  12. 2026How Seemingly Inconsequential Design Choices Dictate Performance of LLMs in Pathologycited by 0
  13. 2026Pathologist Attention-Aligned Report Generation for Prostate Histopathologycited by 0
  14. 2026Evaluating Agentic Bioinformatics through Function, Evidence, and Validationcited by 0
  15. 2026Contamination, Prior, or Evidence? Decomposing and Training Evidence Use in Whole-Slide Vision-Language Modelscited by 0
  16. 2026PathPilot: An Adaptive Question-Conditioned Multi-Magnification Navigation Agent for Whole-Slide Image Analysiscited by 0
  17. 2026PlanPath: Exploration-Guided Orchestration for Patient-Level Pathology Reasoningcited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2026Democratizing and accelerating AI-driven pathology research through agentic intelligence
  2. 2025Exploring General-Purpose Autonomous Multimodal Agents for Pathology Report Generation
  3. 2025WSI-Agents: A Collaborative Multi-Agent System for Multi-Modal Whole Slide Image Analysis
  4. 2026Multimodal Model for Computational Pathology:Representation Learning and Image Compression
  5. 2026LAMMI-Pathology: A Tool-Centric Bottom-Up LVLM-Agent Framework for Molecularly Informed Medical Intelligence in Pathology
  6. 2026Toward Auditable Neuro-Symbolic Reasoning in Pathology: SQL as an Explicit Trace of Evidence
  7. 2026CellDX AI Autopilot: Agent-Guided Training and Deployment of Pathology Classifiers
  8. 2025NOVA: An Agentic Framework for Automated Histopathology Analysis and Discovery