mlsanityData to 14 Oct 2026

PathPilot: An Adaptive Question-Conditioned Multi-Magnification Navigation Agent for Whole-Slide Image Analysis

arXiv 2610.16734 ↗First posted 12 Oct 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

The diagnostic capability of WSI agents relies on effective slide navigation to identify diagnostically relevant regions and efficiently integrate evidence across the slide. While in clinical practice, pathologists dynamically examine slides across multiple scales, integrating global and cellular evidence in a sequential manner, existing AI navigation approaches mostly operate at a single fixed magnification or rely on predefined magnification traversal. This mismatch prevents existing methods from modeling cross-magnification interactions and adaptive magnification selection inherent to real diagnostic workflows. We propose PathPilot, a clinically consistent multi-magnification WSI navigation agent that explicitly models cross-magnification localization and evidence-adaptive exploration. Specifically, we introduce a CrossMagLoc that learns magnification-specific diagnostic localization from pathologist viewing behavior and integrates information from adjacent magnifications to identify the diagnostically most relevant region within the current ROI, thereby providing a diagnostically informed starting point for subsequent question-conditioned exploration. We further introduce an EviRegionSearch that starts question-conditioned exploration from this region, progressively accumulating question-relevant evidence and adaptively determining the next navigation action according to the remaining evidence requirement. Their iterative interaction enables PathPilot to sequentially explore across ROIs and magnifications until sufficient evidence is acquired. Extensive QA evaluations across five cohorts demonstrate consistent superiority over competing SOTA methods on inter/external cohorts, respectively, validating question-conditioned evidence acquisition across regions and magnifications that mirrors the sequential, knowledge-driven navigation of pathologists.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 24 of its 47 references that are in the map. First posted on arXiv 12 Oct 2026.

Builds on

24 of 47 references.

References · 24

  1. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
  2. 2016V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentationcited by 2,292
  3. 2025InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Modelscited by 1,834
  4. 2025Gemma 3 Technical Reportcited by 1,824
  5. 2023LLaVA-Med: Training a Large Language-and-Vision Assistant for Biomedicine in One Daycited by 1,305
  6. 2018Attention-based Deep Multiple Instance Learningcited by 1,095
  7. 2023Med-Flamingo: a Multimodal Medical Few-shot Learnercited by 392
  8. 2025Lingshu: A Generalist Foundation Model for Unified Multimodal Medical Understanding and Reasoningcited by 230
  9. 2025Hulu-Med: A Transparent Generalist Model towards Holistic Medical Vision-Language Understandingcited by 102
  10. 2023Quilt-LLaVA: Visual Instruction Tuning by Extracting Localized Narratives from Open-Source Histopathology Videoscited by 86
  11. 2021Hierarchical Graph Representations in Digital Pathologycited by 59
  12. 2024SlideChat: A Large Vision-Language Assistant for Whole-Slide Pathology Image Understandingcited by 57
12 more
  1. 2020HookNet: multi-resolution convolutional neural networks for semantic segmentation in histopathology whole-slide imagescited by 45
  2. 2024WSI-LLaVA: A Multimodal Large Language Model for Whole Slide Imagecited by 40
  3. 2025Patho-R1: A Multimodal Reinforcement Learning-Based Pathology Expert Reasonercited by 40
  4. 2025PathFinder: A Multi-Modal Multi-Agent System for Medical Diagnostic Decision-Making Applied to Histopathologycited by 39
  5. 2025CPathAgent: An Agent-based Foundation Model for Interpretable High-Resolution Pathology Image Analysis Mimicking Pathologists' Diagnostic Logiccited by 29
  6. 2019Multi-scale fully convolutional neural networks for histopathology image segmentation: from nuclear aberrations to the global tissue architecturecited by 20
  7. 2024PA-LLaVA: A Large Language-Vision Assistant for Human Pathology Image Understandingcited by 16
  8. 2026PathNavigate: A Training-Free Pathology Agent with Surprise-Guided Scan and Shared Slide Memory for Whole-Slide Image VQAcited by 7
  9. 2025Measuring and Predicting Where and When Pathologists Focus their Visual Attention while Grading Whole Slide Images of Cancercited by 4
  10. 2025Towards Cellular-Scale Interpretability in Pathology Foundation Models for Biomarker Assessmentcited by 2
  11. 2025Democratising Pathology Co-Pilots: An Open Pipeline and Dataset for Whole-Slide Vision-Language Modellingcited by 2
  12. 2026Paired Uterine Whole-Slide Images and Pathology Reports for Multimodal Computational Pathologycited by 1

Built on by

Not cited yet.