Agentic Visual Reasoning in Whole-Slide Pathology Images via Active Perception
On the map: LLM reasoning → Clinical and biomedical applications
Abstract (arXiv)
Whole-slide visual reasoning requires identifying sparse diagnostic evidence in gigapixel pathology slides and integrating observations across spatial scales. Existing WSI methods either compress densely sampled patches into global representations or use pretrained vision-language models with heuristic region selection, weakening links between predictions and morphology or lacking pathology-trained observation policies. We present AdaptivePath, an active-perception framework that formulates WSI evidence acquisition as sequential decision making. The Navigator learns question-agnostic abnormality-driven navigation from pathologist-reviewed labels to select observation locations and spatial extents, avoiding costly question-specific trajectory annotations. We train this policy through alternating representation learning and proximal policy optimization, followed by fine-tuning with geometric and appearance consistency objectives to stabilize focus trajectories. During inference, the Navigator hierarchically acquires sparse observations from low to high magnification under a limited ROI budget. A Morphology Interpreter converts observations into question-conditioned evidence, while the Deliberator evaluates evidence and revises intermediate answers across magnifications. The Arbiter integrates deliberation history to produce final answers. AdaptivePath achieves state-of-the-art zero-shot performance on WSI and region pathology VQA benchmarks and reaches 80.14% accuracy for cancer subtype classification across six TCGA cohorts. In a blinded diagnostic-utility study, pathologists using AdaptivePath-selected observation sequences achieve 82.9% accuracy. These results demonstrate that learned active perception enables effective and traceable visual reasoning over gigapixel pathology slides.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Clinical and biomedical applications, one of 17 directions in LLM reasoning. Builds on 27 of its 36 references that are in the map. First posted on arXiv 9 Aug 2026.
Builds on
27 of 36 references.
Closest ancestors · 5
Same direction, newest first
- 2026EviPathBench: Benchmarking Evidence Acquisition and Reasoning in Vision-Language Models for Whole-Slide Pathology21 Jul
- 2026Enhancing Pathological VLMs with Cross-scale Reasoning16 Jun
- 2025PathAgent: Toward Interpretable Analysis of Whole-slide Pathology Images via Large Language Model-based Agentic Reasoning21 Nov
- 2025Evidence-based diagnostic reasoning with multi-agent copilot for human pathology26 Jun
- 2025Patho-R1: A Multimodal Reinforcement Learning-Based Pathology Expert Reasoner16 May
Other references · 22
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2017Proximal Policy Optimization Algorithmscited by 15,215
- 2023Visual Instruction Tuningcited by 7,869
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
- 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,137
- 2015VQA: Visual Question Answeringcited by 2,506
- 2023LLaVA-Med: Training a Large Language-and-Vision Assistant for Biomedicine in One Daycited by 1,305
- 2021ViLT: Vision-and-Language Transformer Without Convolution or Region Supervisioncited by 1,230
- 2020Data Efficient and Weakly Supervised Computational Pathology on Whole Slide Imagescited by 745
- 2020PathVQA: 30000+ Questions for Medical Visual Question Answeringcited by 475
- 2023NavGPT: Explicit Reasoning in Vision-and-Language Navigation with Large Language Modelscited by 280
- 2023Quilt-LLaVA: Visual Instruction Tuning by Extracting Localized Narratives from Open-Source Histopathology Videoscited by 86
10 more
- 2023PathAsst: A Generative Foundation AI Assistant Towards Artificial General Intelligence of Pathologycited by 57
- 2024SlideChat: A Large Vision-Language Assistant for Whole-Slide Pathology Image Understandingcited by 57
- 2024PathMMU: A Massive Multimodal Expert-Level Benchmark for Understanding and Reasoning in Pathologycited by 43
- 2024WSI-LLaVA: A Multimodal Large Language Model for Whole Slide Imagecited by 40
- 2024WSI-VQA: Interpreting Whole Slide Images by Generative Visual Question Answeringcited by 34
- 2025CPathAgent: An Agent-based Foundation Model for Interpretable High-Resolution Pathology Image Analysis Mimicking Pathologists' Diagnostic Logiccited by 29
- 2025Emulating Human-like Adaptive Vision for Efficient and Flexible Machine Visual Perceptioncited by 15
- 2022RLogist: Fast Observation Strategy on Whole-slide Images with Deep Reinforcement Learningcited by 8
- 2025Navigating Gigapixel Pathology Images with Large Multimodal Modelscited by 7
- 2026PathNavigate: A Training-Free Pathology Agent with Surprise-Guided Scan and Shared Slide Memory for Whole-Slide Image VQAcited by 7
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026Beyond Relevance: Bayesian Evidence Acquisition for Agentic Whole-Slide Image Reasoning
- 2025Pathology-CoT: Learning Visual Chain-of-Thought Agent from Expert Whole Slide Image Diagnosis Behavior
- 2026Act Like a Pathologist: Tissue-Aware Whole Slide Image Reasoning
- 2025PathFound: An Agentic Multimodal Model Activating Evidence-seeking Pathological Diagnosis
- 2026Multimodal Model for Computational Pathology:Representation Learning and Image Compression
- 2026PathoArgus: Advancing Evidence-Grounded Long-Context Visual Reasoning across Gigapixel Whole-Slide and Multi-Slide Case Contexts
- 2025PathFinder: A Multi-Modal Multi-Agent System for Medical Diagnostic Decision-Making Applied to Histopathology
- 2026See, Measure, and Reason: Learning Visually Grounded Reasoning in Pathology