CPathAgent: An Agent-based Foundation Model for Interpretable High-Resolution Pathology Image Analysis Mimicking Pathologists' Diagnostic Logic
Not on the map. Why?
Abstract (arXiv)
Recent advances in computational pathology have led to the emergence of numerous foundation models. These models typically rely on general-purpose encoders with multi-instance learning for whole slide image (WSI) classification or apply multimodal approaches to generate reports directly from images. However, these models cannot emulate the diagnostic approach of pathologists, who systematically examine slides at low magnification to obtain an overview before progressively zooming in on suspicious regions to formulate comprehensive diagnoses. Instead, existing models directly output final diagnoses without revealing the underlying reasoning process. To address this gap, we introduce CPathAgent, an innovative agent-based approach that mimics pathologists' diagnostic workflow by autonomously navigating across WSI based on observed visual features, thereby generating substantially more transparent and interpretable diagnostic summaries. To achieve this, we develop a multi-stage training strategy that unifies patch-level, region-level, and WSI-level capabilities within a single model, which is essential for replicating how pathologists understand and reason across diverse image scales. Additionally, we construct PathMMU-HR2, the first expert-validated benchmark for large region analysis. This represents a critical intermediate scale between patches and whole slides, reflecting a key clinical reality where pathologists typically examine several key large regions rather than entire slides at once. Extensive experiments demonstrate that CPathAgent consistently outperforms existing approaches across benchmarks at three different image scales, validating the effectiveness of our agent-based diagnostic approach and highlighting a promising direction for computational pathology.
Key facts. Cited by 29 papers in the map (data through 14 Oct 2026). Builds on 39 of its 60 references that are in the map. First posted on arXiv 26 May 2025.
Builds on
39 of 60 references.
References · 39
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2025Qwen3 Technical Reportcited by 8,820
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,968
- 2025Qwen2.5-VL Technical Reportcited by 5,587
- 2023Improved Baselines with Visual Instruction Tuningcited by 4,418
- 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,182
- 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,568
- 2023InstructBLIP: Towards General-purpose Vision-Language Models with Instruction Tuningcited by 2,876
- 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,719
- 2023MetaGPT: Meta Programming for A Multi-Agent Collaborative Frameworkcited by 1,808
27 more
- 2021WebGPT: Browser-assisted question-answering with human feedbackcited by 1,745
- 2023LLaVA-Med: Training a Large Language-and-Vision Assistant for Biomedicine in One Daycited by 1,305
- 2022WebShop: Towards Scalable Real-World Web Interaction with Grounded Language Agentscited by 1,251
- 2018Attention-based Deep Multiple Instance Learningcited by 1,095
- 2023ChatDev: Communicative Agents for Software Developmentcited by 919
- 2020Data Efficient and Weakly Supervised Computational Pathology on Whole Slide Imagescited by 745
- 2023MM-REACT: Prompting ChatGPT for Multimodal Reasoning and Actioncited by 517
- 2020Dual-stream Multiple Instance Learning Network for Whole Slide Image Classification with Self-supervised Contrastive Learningcited by 478
- 2020PathVQA: 30000+ Questions for Medical Visual Question Answeringcited by 475
- 2023Describe, Explain, Plan and Select: Interactive Planning with Large Language Models Enables Open-World Multi-Task Agentscited by 398
- 2024AgentClinic: a multimodal agent benchmark to evaluate AI in simulated clinical environmentscited by 231
- 2024Agent Hospital: A Simulacrum of Hospital with Evolvable Medical Agentscited by 218
- 2023Quilt-1M: One Million Image-Text Pairs for Histopathologycited by 194
- 2022Re3: Generating Longer Stories With Recursive Reprompting and Revisioncited by 193
- 2024Multimodal Whole Slide Foundation Model for Pathologycited by 162
- 2024Virchow2: Scaling Self-Supervised Mixed Magnification Models in Pathologycited by 161
- 2024Empowering Biomedical Discovery with AI Agentscited by 118
- 2023Quilt-LLaVA: Visual Instruction Tuning by Extracting Localized Narratives from Open-Source Histopathology Videoscited by 86
- 2024PRISM: A Multi-Modal Generative Foundation Model for Slide-Level Histopathologycited by 85
- 2023Attention-Challenging Multiple Instance Learning for Whole Slide Image Classificationcited by 61
- 2023PathAsst: A Generative Foundation AI Assistant Towards Artificial General Intelligence of Pathologycited by 57
- 2024SlideChat: A Large Vision-Language Assistant for Whole-Slide Pathology Image Understandingcited by 57
- 2024PathMMU: A Massive Multimodal Expert-Level Benchmark for Understanding and Reasoning in Pathologycited by 43
- 2024HistGen: Histopathology Report Generation via Local-Global Feature Encoding and Cross-modal Context Interactioncited by 43
- 2025PathFinder: A Multi-Modal Multi-Agent System for Medical Diagnostic Decision-Making Applied to Histopathologycited by 39
- 2024WSI-VQA: Interpreting Whole Slide Images by Generative Visual Question Answeringcited by 34
- 2024CPath-Omni: A Unified Multimodal Foundation Model for Patch and Whole Slide Image Analysis in Computational Pathologycited by 34
Built on by
Citing papers per year: 2025: 8; 2026: 21.
29 papers.
Sort:
By area:
- 2025Evidence-based diagnostic reasoning with multi-agent copilot for human pathologycited by 27
- 2025PathAgent: Toward Interpretable Analysis of Whole-slide Pathology Images via Large Language Model-based Agentic Reasoningcited by 19
- 2025Patho-AgenticRAG: Towards Multimodal Agentic Retrieval-Augmented Generation for Pathology VLMs via Reinforcement Learningcited by 13
- 2025Pathology-CoT: Learning Visual Chain-of-Thought Agent from Expert Whole Slide Image Diagnosis Behaviorcited by 10
- 2025Navigating Gigapixel Pathology Images with Large Multimodal Modelscited by 7
- 2026PathReasoner-R1: Instilling Structured Reasoning into Pathology Vision-Language Model via Knowledge-Guided Policy Optimizationcited by 7
- 2026PathNavigate: A Training-Free Pathology Agent with Surprise-Guided Scan and Shared Slide Memory for Whole-Slide Image VQAcited by 7
- 2025LoC-Path: Learning to Compress for Pathology Multimodal Large Language Modelscited by 6
- 2025SurvAgent: Hierarchical CoT-Enhanced Case Banking and Dichotomy-Based Multi-Agent System for Multimodal Survival Predictioncited by 5
- 2026Act Like a Pathologist: Tissue-Aware Whole Slide Image Reasoningcited by 5
- 2026QCAgent: An agentic framework for quality-controllable pathology report generation from whole slide imagecited by 4
- 2025PathFound: An Agentic Multimodal Model Activating Evidence-seeking Pathological Diagnosiscited by 3
17 more
- 2026PathView-Bench: Can Multimodal Large Language Models Achieve Fine-grained Multiscale Understanding of Pathology Images?cited by 3
- 2026MMNavAgent: Multi-Magnification WSI Navigation Agent for Clinically Consistent Whole-Slide Analysiscited by 2
- 2026Computational Pathology in the Era of Emerging Foundation and Agentic AI -- International Expert Perspectives on Clinical Integration and Translational Readinesscited by 2
- 2026NuNext: Reframing Nucleus Detection as Next-Point Detectioncited by 2
- 2026The Path to Self-Evolving Clinical Systems: Scaling Medical Agents from Assistance to Autonomycited by 2
- 2026Do Pathology Vision-Language Models Truly See Pathology?cited by 2
- 2026Beyond Relevance: Bayesian Evidence Acquisition for Agentic Whole-Slide Image Reasoningcited by 2
- 2026Which Tool Response Should I Trust? Tool-Expertise-Aware Chest X-ray Agent with Multimodal Agentic Learningcited by 1
- 2026Agentic Visual Reasoning in Whole-Slide Pathology Images via Active Perceptioncited by 1
- 2026PathoSage: Towards Multi-Source Evidence Adjudication in Pathology via Experience-Aware Agentic Workflowcited by 0
- 2026Listen, Look, and Learn: Learning Without Forgetting through SAM-Audiocited by 0
- 2026How Seemingly Inconsequential Design Choices Dictate Performance of LLMs in Pathologycited by 0
- 2026Pathologist Attention-Aligned Report Generation for Prostate Histopathologycited by 0
- 2026Evaluating Agentic Bioinformatics through Function, Evidence, and Validationcited by 0
- 2026Contamination, Prior, or Evidence? Decomposing and Training Evidence Use in Whole-Slide Vision-Language Modelscited by 0
- 2026PathPilot: An Adaptive Question-Conditioned Multi-Magnification Navigation Agent for Whole-Slide Image Analysiscited by 0
- 2026PlanPath: Exploration-Guided Orchestration for Patient-Level Pathology Reasoningcited by 0
- 2026PlanPath: Exploration-Guided Orchestration for Patient-Level Pathology Reasoning13 Oct 2026
- 2026PathPilot: An Adaptive Question-Conditioned Multi-Magnification Navigation Agent for Whole-Slide Image Analysis12 Oct 2026
- 2026Contamination, Prior, or Evidence? Decomposing and Training Evidence Use in Whole-Slide Vision-Language Models26 Sep 2026
- 2026Agentic Visual Reasoning in Whole-Slide Pathology Images via Active Perception9 Aug 2026
- 2026Beyond Relevance: Bayesian Evidence Acquisition for Agentic Whole-Slide Image Reasoning6 Aug 2026
- 2026PathView-Bench: Can Multimodal Large Language Models Achieve Fine-grained Multiscale Understanding of Pathology Images?30 Jul 2026
- 2026Evaluating Agentic Bioinformatics through Function, Evidence, and Validation30 Jul 2026
- 2026Do Pathology Vision-Language Models Truly See Pathology?23 Jul 2026
- 2026Pathologist Attention-Aligned Report Generation for Prostate Histopathology21 Jul 2026
- 2026The Path to Self-Evolving Clinical Systems: Scaling Medical Agents from Assistance to Autonomy13 Jul 2026
- 2026How Seemingly Inconsequential Design Choices Dictate Performance of LLMs in Pathology10 Jun 2026
- 2026Listen, Look, and Learn: Learning Without Forgetting through SAM-Audio9 Jun 2026
17 more
- 2026PathNavigate: A Training-Free Pathology Agent with Surprise-Guided Scan and Shared Slide Memory for Whole-Slide Image VQA22 May 2026
- 2026PathoSage: Towards Multi-Source Evidence Adjudication in Pathology via Experience-Aware Agentic Workflow18 May 2026
- 2026NuNext: Reframing Nucleus Detection as Next-Point Detection7 Mar 2026
- 2026Computational Pathology in the Era of Emerging Foundation and Agentic AI -- International Expert Perspectives on Clinical Integration and Translational Readiness6 Mar 2026
- 2026MMNavAgent: Multi-Magnification WSI Navigation Agent for Clinically Consistent Whole-Slide Analysis2 Mar 2026
- 2026QCAgent: An agentic framework for quality-controllable pathology report generation from whole slide image2 Mar 2026
- 2026Act Like a Pathologist: Tissue-Aware Whole Slide Image Reasoning28 Feb 2026
- 2026Which Tool Response Should I Trust? Tool-Expertise-Aware Chest X-ray Agent with Multimodal Agentic Learning25 Feb 2026
- 2026PathReasoner-R1: Instilling Structured Reasoning into Pathology Vision-Language Model via Knowledge-Guided Policy Optimization29 Jan 2026
- 2025PathFound: An Agentic Multimodal Model Activating Evidence-seeking Pathological Diagnosis29 Dec 2025
- 2025LoC-Path: Learning to Compress for Pathology Multimodal Large Language Models5 Dec 2025
- 2025Navigating Gigapixel Pathology Images with Large Multimodal Models24 Nov 2025
- 2025PathAgent: Toward Interpretable Analysis of Whole-slide Pathology Images via Large Language Model-based Agentic Reasoning21 Nov 2025
- 2025SurvAgent: Hierarchical CoT-Enhanced Case Banking and Dichotomy-Based Multi-Agent System for Multimodal Survival Prediction20 Nov 2025
- 2025Pathology-CoT: Learning Visual Chain-of-Thought Agent from Expert Whole Slide Image Diagnosis Behavior6 Oct 2025
- 2025Patho-AgenticRAG: Towards Multimodal Agentic Retrieval-Augmented Generation for Pathology VLMs via Reinforcement Learning4 Aug 2025
- 2025Evidence-based diagnostic reasoning with multi-agent copilot for human pathology26 Jun 2025
- 2025Patho-AgenticRAG: Towards Multimodal Agentic Retrieval-Augmented Generation for Pathology VLMs via Reinforcement Learningcited by 13
- 2025Navigating Gigapixel Pathology Images with Large Multimodal Modelscited by 7
- 2025LoC-Path: Learning to Compress for Pathology Multimodal Large Language Modelscited by 6
- 2025PathFound: An Agentic Multimodal Model Activating Evidence-seeking Pathological Diagnosiscited by 3
- 2026PathView-Bench: Can Multimodal Large Language Models Achieve Fine-grained Multiscale Understanding of Pathology Images?cited by 3
- 2026The Path to Self-Evolving Clinical Systems: Scaling Medical Agents from Assistance to Autonomycited by 2
- 2026Do Pathology Vision-Language Models Truly See Pathology?cited by 2
- 2026PathoSage: Towards Multi-Source Evidence Adjudication in Pathology via Experience-Aware Agentic Workflowcited by 0
- 2026Contamination, Prior, or Evidence? Decomposing and Training Evidence Use in Whole-Slide Vision-Language Modelscited by 0
- 2026Contamination, Prior, or Evidence? Decomposing and Training Evidence Use in Whole-Slide Vision-Language Models26 Sep 2026
- 2026PathView-Bench: Can Multimodal Large Language Models Achieve Fine-grained Multiscale Understanding of Pathology Images?30 Jul 2026
- 2026Do Pathology Vision-Language Models Truly See Pathology?23 Jul 2026
- 2026The Path to Self-Evolving Clinical Systems: Scaling Medical Agents from Assistance to Autonomy13 Jul 2026
- 2026PathoSage: Towards Multi-Source Evidence Adjudication in Pathology via Experience-Aware Agentic Workflow18 May 2026
- 2025PathFound: An Agentic Multimodal Model Activating Evidence-seeking Pathological Diagnosis29 Dec 2025
- 2025LoC-Path: Learning to Compress for Pathology Multimodal Large Language Models5 Dec 2025
- 2025Navigating Gigapixel Pathology Images with Large Multimodal Models24 Nov 2025
- 2025Patho-AgenticRAG: Towards Multimodal Agentic Retrieval-Augmented Generation for Pathology VLMs via Reinforcement Learning4 Aug 2025
- 2025SurvAgent: Hierarchical CoT-Enhanced Case Banking and Dichotomy-Based Multi-Agent System for Multimodal Survival Predictioncited by 5
- 2026QCAgent: An agentic framework for quality-controllable pathology report generation from whole slide imagecited by 4
- 2026Computational Pathology in the Era of Emerging Foundation and Agentic AI -- International Expert Perspectives on Clinical Integration and Translational Readinesscited by 2
- 2026Beyond Relevance: Bayesian Evidence Acquisition for Agentic Whole-Slide Image Reasoningcited by 2
- 2026Which Tool Response Should I Trust? Tool-Expertise-Aware Chest X-ray Agent with Multimodal Agentic Learningcited by 1
- 2026Evaluating Agentic Bioinformatics through Function, Evidence, and Validationcited by 0
- 2026Beyond Relevance: Bayesian Evidence Acquisition for Agentic Whole-Slide Image Reasoning6 Aug 2026
- 2026Evaluating Agentic Bioinformatics through Function, Evidence, and Validation30 Jul 2026
- 2026Computational Pathology in the Era of Emerging Foundation and Agentic AI -- International Expert Perspectives on Clinical Integration and Translational Readiness6 Mar 2026
- 2026QCAgent: An agentic framework for quality-controllable pathology report generation from whole slide image2 Mar 2026
- 2026Which Tool Response Should I Trust? Tool-Expertise-Aware Chest X-ray Agent with Multimodal Agentic Learning25 Feb 2026
- 2025SurvAgent: Hierarchical CoT-Enhanced Case Banking and Dichotomy-Based Multi-Agent System for Multimodal Survival Prediction20 Nov 2025
- 2025Evidence-based diagnostic reasoning with multi-agent copilot for human pathologycited by 27
- 2025PathAgent: Toward Interpretable Analysis of Whole-slide Pathology Images via Large Language Model-based Agentic Reasoningcited by 19
- 2025Pathology-CoT: Learning Visual Chain-of-Thought Agent from Expert Whole Slide Image Diagnosis Behaviorcited by 10
- 2026PathReasoner-R1: Instilling Structured Reasoning into Pathology Vision-Language Model via Knowledge-Guided Policy Optimizationcited by 7
- 2026Act Like a Pathologist: Tissue-Aware Whole Slide Image Reasoningcited by 5
- 2026Agentic Visual Reasoning in Whole-Slide Pathology Images via Active Perceptioncited by 1
- 2026Agentic Visual Reasoning in Whole-Slide Pathology Images via Active Perception9 Aug 2026
- 2026Act Like a Pathologist: Tissue-Aware Whole Slide Image Reasoning28 Feb 2026
- 2026PathReasoner-R1: Instilling Structured Reasoning into Pathology Vision-Language Model via Knowledge-Guided Policy Optimization29 Jan 2026
- 2025PathAgent: Toward Interpretable Analysis of Whole-slide Pathology Images via Large Language Model-based Agentic Reasoning21 Nov 2025
- 2025Pathology-CoT: Learning Visual Chain-of-Thought Agent from Expert Whole Slide Image Diagnosis Behavior6 Oct 2025
- 2025Evidence-based diagnostic reasoning with multi-agent copilot for human pathology26 Jun 2025
- 2026PathNavigate: A Training-Free Pathology Agent with Surprise-Guided Scan and Shared Slide Memory for Whole-Slide Image VQAcited by 7
- 2026MMNavAgent: Multi-Magnification WSI Navigation Agent for Clinically Consistent Whole-Slide Analysiscited by 2
- 2026NuNext: Reframing Nucleus Detection as Next-Point Detectioncited by 2
- 2026Listen, Look, and Learn: Learning Without Forgetting through SAM-Audiocited by 0
- 2026How Seemingly Inconsequential Design Choices Dictate Performance of LLMs in Pathologycited by 0
- 2026Pathologist Attention-Aligned Report Generation for Prostate Histopathologycited by 0
- 2026PathPilot: An Adaptive Question-Conditioned Multi-Magnification Navigation Agent for Whole-Slide Image Analysiscited by 0
- 2026PlanPath: Exploration-Guided Orchestration for Patient-Level Pathology Reasoningcited by 0
- 2026PlanPath: Exploration-Guided Orchestration for Patient-Level Pathology Reasoning13 Oct 2026
- 2026PathPilot: An Adaptive Question-Conditioned Multi-Magnification Navigation Agent for Whole-Slide Image Analysis12 Oct 2026
- 2026Pathologist Attention-Aligned Report Generation for Prostate Histopathology21 Jul 2026
- 2026How Seemingly Inconsequential Design Choices Dictate Performance of LLMs in Pathology10 Jun 2026
- 2026Listen, Look, and Learn: Learning Without Forgetting through SAM-Audio9 Jun 2026
- 2026PathNavigate: A Training-Free Pathology Agent with Surprise-Guided Scan and Shared Slide Memory for Whole-Slide Image VQA22 May 2026
- 2026NuNext: Reframing Nucleus Detection as Next-Point Detection7 Mar 2026
- 2026MMNavAgent: Multi-Magnification WSI Navigation Agent for Clinically Consistent Whole-Slide Analysis2 Mar 2026
Similar, not cited
Close in wording, no citation either way
- 2026Democratizing and accelerating AI-driven pathology research through agentic intelligence
- 2025Exploring General-Purpose Autonomous Multimodal Agents for Pathology Report Generation
- 2025WSI-Agents: A Collaborative Multi-Agent System for Multi-Modal Whole Slide Image Analysis
- 2026Multimodal Model for Computational Pathology:Representation Learning and Image Compression
- 2026LAMMI-Pathology: A Tool-Centric Bottom-Up LVLM-Agent Framework for Molecularly Informed Medical Intelligence in Pathology
- 2026Toward Auditable Neuro-Symbolic Reasoning in Pathology: SQL as an Explicit Trace of Evidence
- 2026CellDX AI Autopilot: Agent-Guided Training and Deployment of Pathology Classifiers
- 2025NOVA: An Agentic Framework for Automated Histopathology Analysis and Discovery