RLogist: Fast Observation Strategy on Whole-slide Images with Deep Reinforcement Learning
Not on the map. Why?
Abstract (arXiv)
Whole-slide images (WSI) in computational pathology have high resolution with gigapixel size, but are generally with sparse regions of interest, which leads to weak diagnostic relevance and data inefficiency for each area in the slide. Most of the existing methods rely on a multiple instance learning framework that requires densely sampling local patches at high magnification. The limitation is evident in the application stage as the heavy computation for extracting patch-level features is inevitable. In this paper, we develop RLogist, a benchmarking deep reinforcement learning (DRL) method for fast observation strategy on WSIs. Imitating the diagnostic logic of human pathologists, our RL agent learns how to find regions of observation value and obtain representative features across multiple resolution levels, without having to analyze each part of the WSI at the high magnification. We benchmark our method on two whole-slide level classification tasks, including detection of metastases in WSIs of lymph node sections, and subtyping of lung cancer. Experimental results demonstrate that RLogist achieves competitive classification performance compared to typical multiple instance learning algorithms, while having a significantly short observation path. In addition, the observation path given by RLogist provides good decision-making interpretability, and its ability of reading path navigation can potentially be used by pathologists for educational/assistive purposes. Our code is available at: urlhttps://github.com/tencent-ailab/RLogist.
Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Builds on 31 of its 53 references that are in the map. First posted on arXiv 4 Dec 2022.
Builds on
31 of 53 references.
References · 31
- 2017Attention Is All You Needcited by 59,932
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2017Proximal Policy Optimization Algorithmscited by 14,441
- 2016OpenAI Gymcited by 1,684
- 2018Soft Actor-Critic Algorithms and Applicationscited by 1,179
- 2018Attention-based Deep Multiple Instance Learningcited by 1,077
- 2020Data Efficient and Weakly Supervised Computational Pathology on Whole Slide Imagescited by 738
- 2021TransMIL: Transformer based Correlated Multiple Instance Learning for Whole Slide Image Classificationcited by 549
- 2020Dual-stream Multiple Instance Learning Network for Whole Slide Image Classification with Self-supervised Contrastive Learningcited by 473
- 2022Scaling Vision Transformers to Gigapixel Images via Hierarchical Self-Supervised Learningcited by 357
- 2017Deep Reinforcement Learning: An Overviewcited by 327
19 more
- 2016Multiple Instance Learning: A Survey of Problem Characteristics and Applicationscited by 163
- 2019Mastering Complex Control in MOBA Games with Deep Reinforcement Learningcited by 150
- 2020Multi-scale Domain-adversarial Multiple-instance CNN for Cancer Subtype Classification with Unannotated Histopathological Imagescited by 81
- 2020Towards Playing Full MOBA Games with Deep Reinforcement Learningcited by 78
- 2020Active MR k-space Sampling with Reinforcement Learningcited by 45
- 2021Deep reinforcement learning in medical imaging: A literature reviewcited by 34
- 2021JueWu-MC: Playing Minecraft with Sample-efficient Hierarchical Reinforcement Learningcited by 28
- 2018Deep Reinforcement Learning for Surgical Gesture Segmentation and Classificationcited by 15
- 2019Learning Where to See: A Novel Attention Model for Automated Immunohistochemical Scoringcited by 14
- 2019PixelRL: Fully Convolutional Network with Reinforcement Learning for Image Processingcited by 13
- 2020Synthetic Sample Selection via Reinforcement Learningcited by 13
- 2020Deep Q-Network-Driven Catheter Segmentation in 3D US by Hybrid Constrained Semi-Supervised Learning and Dual-UNetcited by 11
- 2020Auto-weighting for Breast Cancer Classification in Multimodal Ultrasoundcited by 9
- 2020Reinforcement Learning of Musculoskeletal Control from Functional Simulationscited by 8
- 2017Intelligent Parameter Tuning in Optimization-based Iterative CT Reconstruction via Deep Reinforcement Learningcited by 7
- 2017Group-driven Reinforcement Learning for Personalized mHealth Interventioncited by 6
- 2019Adversarial Policy Gradient for Deep Learning Image Augmentationcited by 4
- 2020Augmenting Policy Learning with Routines Discovered from a Single Demonstrationcited by 4
- 2018Muscle Excitation Estimation in Biomechanical Simulation Using NAF Reinforcement Learningcited by 2
Built on by
Citing papers per year: 2024: 3; 2025: 3; 2026: 2.
8 papers.
- 2024Dynamic Policy-Driven Adaptive Multi-Instance Learning for Whole Slide Image Classificationcited by 12
- 2024Affordable Generative Agentscited by 8
- 2025Advanced Deep Learning and Large Language Models: Comprehensive Insights for Cancer Detectioncited by 4
- 2025Sequential Attention-based Sampling for Histopathological Analysiscited by 2
- 2024HistoGym: A Reinforcement Learning Environment for Histopathological Image Analysiscited by 1
- 2025The Impact of Image Resolution on Biomedical Multimodal Large Language Modelscited by 1
- 2026Agentic Visual Reasoning in Whole-Slide Pathology Images via Active Perceptioncited by 1
- 2026PAVE: A Cognitive Architecture for Legitimate Violation in Generative Agent Societiescited by 0
- 2026Agentic Visual Reasoning in Whole-Slide Pathology Images via Active Perception9 Aug 2026
- 2026PAVE: A Cognitive Architecture for Legitimate Violation in Generative Agent Societies19 May 2026
- 2025The Impact of Image Resolution on Biomedical Multimodal Large Language Models21 Oct 2025
- 2025Sequential Attention-based Sampling for Histopathological Analysis7 Jul 2025
- 2025Advanced Deep Learning and Large Language Models: Comprehensive Insights for Cancer Detection30 Mar 2025
- 2024HistoGym: A Reinforcement Learning Environment for Histopathological Image Analysis16 Aug 2024
- 2024Dynamic Policy-Driven Adaptive Multi-Instance Learning for Whole Slide Image Classification9 Mar 2024
- 2024Affordable Generative Agents3 Feb 2024