mlsanityData to 7 Oct 2026

HistoGym: A Reinforcement Learning Environment for Histopathological Image Analysis

arXiv 2408.08847 ↗First posted 16 Aug 2024eess.IV cs.CV cs.LGcited by 1

Not on the map. Why?

Abstract (arXiv)

In pathological research, education, and clinical practice, the decision-making process based on pathological images is critically important. This significance extends to digital pathology image analysis: its adequacy is demonstrated by the extensive information contained within tissue structures, which is essential for accurate cancer classification and grading. Additionally, its necessity is highlighted by the inherent requirement for interpretability in the conclusions generated by algorithms. For humans, determining tumor type and grade typically involves multi-scale analysis, which presents a significant challenge for AI algorithms. Traditional patch-based methods are inadequate for modeling such complex structures, as they fail to capture the intricate, multi-scale information inherent in whole slide images. Consequently, there is a pressing need for advanced AI techniques capable of efficiently and accurately replicating this complex analytical process. To address this issue, we introduce HistoGym, an open-source reinforcement learning environment for histopathological image analysis. Following OpenAI Gym APIs, HistoGym aims to foster whole slide image diagnosis by mimicking the real-life processes of doctors. Leveraging the pyramid feature of WSIs and the OpenSlide API, HistoGym provides a unified framework for various clinical tasks, including tumor detection and classification. We detail the observation, action, and reward specifications tailored for the histopathological image analysis domain and provide an open-source Python-based interface for both clinicians and researchers. To accommodate different clinical demands, we offer various scenarios for different organs and cancers, including both WSI-based and selected region-based scenarios, showcasing several noteworthy results.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 31 of its 53 references that are in the map. First posted on arXiv 16 Aug 2024.

Builds on

31 of 53 references.

References · 31

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2017Proximal Policy Optimization Algorithmscited by 14,441
  3. 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,690
  4. 2013Playing Atari with Deep Reinforcement Learningcited by 3,211
  5. 2016Asynchronous Methods for Deep Reinforcement Learningcited by 2,218
  6. 2023LLaVA-Med: Training a Large Language-and-Vision Assistant for Biomedicine in One Daycited by 1,287
  7. 2017A Survey on Deep Learning in Medical Image Analysiscited by 1,182
  8. 2018Attention-based Deep Multiple Instance Learningcited by 1,077
  9. 2020Data Efficient and Weakly Supervised Computational Pathology on Whole Slide Imagescited by 738
  10. 2020Deep Reinforcement Learning for Autonomous Driving: A Surveycited by 698
  11. 2019Model-Based Reinforcement Learning for Ataricited by 495
  12. 2020Dual-stream Multiple Instance Learning Network for Whole Slide Image Classification with Self-supervised Contrastive Learningcited by 473
19 more
  1. 2018Distributed Prioritized Experience Replaycited by 260
  2. 2015Explaining NonLinear Classification Decisions with Deep Taylor Decompositioncited by 248
  3. 2021Tianshou: a Highly Modularized Deep Reinforcement Learning Librarycited by 139
  4. 2023Visual Language Pretrained Multiple Instance Zero-Shot Transfer for Histopathology Imagescited by 132
  5. 2021Whole Slide Images are 2D Point Clouds: Context-Aware Survival Prediction using Patch-based Graph Convolutional Networkscited by 124
  6. 2023Artificial Intelligence for Digital and Computational Pathologycited by 106
  7. 2021Learning to Fly -- a Gym Environment with PyBullet Physics for Reinforcement Learning of Multi-agent Quadcopter Controlcited by 68
  8. 2019CGC-Net: Cell Graph Convolutional Network for Grading of Colorectal Cancer Histology Imagescited by 57
  9. 2022VL-InterpreT: An Interactive Visualization Tool for Interpreting Vision-Language Transformerscited by 53
  10. 2019Deep learning-based survival prediction for multiple cancer types using histopathology imagescited by 47
  11. 2019Context-Aware Convolutional Neural Network for Grading of Colorectal Cancer Histology Imagescited by 39
  12. 2020Interpretable Survival Prediction for Colorectal Cancer using Deep Learningcited by 30
  13. 2022Honor of Kings Arena: an Environment for Generalization in Competitive Reinforcement Learningcited by 27
  14. 2019Learning Where to See: A Novel Attention Model for Automated Immunohistochemical Scoringcited by 14
  15. 2021PowerGym: A Reinforcement Learning Environment for Volt-Var Control in Power Distribution Systemscited by 10
  16. 2023Pixel-Level Explanation of Multiple Instance Learning Models in Biomedical Single Cell Imagescited by 9
  17. 2022RLogist: Fast Observation Strategy on Whole-slide Images with Deep Reinforcement Learningcited by 8
  18. 2019Look, Investigate, and Classify: A Deep Hybrid Attention Method for Breast Cancer Classificationcited by 5
  19. 2020Selecting Regions of Interest in Large Multi-Scale Images for Cancer Pathologycited by 1

Built on by

Cited by year

Citing papers per year: 2025: 1.

1 paper.

  1. 2025DiagR1: A Vision-Language Model Trained via Reinforcement Learning for Digestive Pathology Diagnosiscited by 0