mlsanityData to 14 Oct 2026

Deep reinforcement learning in medical imaging: A literature review

arXiv 2103.05115 ↗First posted 5 Mar 2021eess.IV cs.CV cs.LGcited by 34

Not on the map. Why?

Abstract (arXiv)

Deep reinforcement learning (DRL) augments the reinforcement learning framework, which learns a sequence of actions that maximizes the expected reward, with the representative power of deep neural networks. Recent works have demonstrated the great potential of DRL in medicine and healthcare. This paper presents a literature review of DRL in medical imaging. We start with a comprehensive tutorial of DRL, including the latest model-free and model-based algorithms. We then cover existing DRL applications for medical imaging, which are roughly divided into three main categories: (I) parametric medical image analysis tasks including landmark detection, object/lesion detection, registration, and view plane localization; (ii) solving optimization tasks including hyperparameter tuning, selecting augmentation strategies, and neural architecture search; and (iii) miscellaneous applications including surgical gesture segmentation, personalized mobile health intervention, and computational model personalization. The paper concludes with discussions of future perspectives.

Key facts. Cited by 34 papers in the map (data through 14 Oct 2026). Builds on 69 of its 160 references that are in the map. First posted on arXiv 5 Mar 2021.

Builds on

69 of 160 references.

References · 69

  1. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
  2. 2017Proximal Policy Optimization Algorithmscited by 15,215
  3. 2014Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translationcited by 4,057
  4. 2015Continuous control with deep reinforcement learningcited by 3,407
  5. 2013Playing Atari with Deep Reinforcement Learningcited by 3,274
  6. 2015Trust Region Policy Optimizationcited by 2,580
  7. 2016Asynchronous Methods for Deep Reinforcement Learningcited by 2,258
  8. 2015Deep Reinforcement Learning with Double Q-learningcited by 1,745
  9. 2016Neural Architecture Search with Reinforcement Learningcited by 1,499
  10. 2019Meta-World: A Benchmark and Evaluation for Multi-Task and Meta Reinforcement Learningcited by 1,204
  11. 2015Dueling Network Architectures for Deep Reinforcement Learningcited by 785
  12. 2017Deep Reinforcement Learning that Matterscited by 754
38 more
  1. 2013Speech Recognition with Deep Recurrent Neural Networkscited by 669
  2. 2018fastMRI: An Open Dataset and Benchmarks for Accelerated MRIcited by 470
  3. 2016Tutorial on Variational Autoencoderscited by 409
  4. 2016Guided Cost Learning: Deep Inverse Optimal Control via Policy Optimizationcited by 406
  5. 2019Efficient Off-Policy Meta-Reinforcement Learning via Probabilistic Context Variablescited by 389
  6. 2016Learning to reinforcement learncited by 377
  7. 2017Overcoming Exploration in Reinforcement Learning with Demonstrationscited by 340
  8. 2017Deep Reinforcement Learning: An Overviewcited by 333
  9. 2016Safe, Multi-Agent, Reinforcement Learning for Autonomous Drivingcited by 311
  10. 2018nnU-Net: Self-adapting Framework for U-Net-Based Medical Image Segmentationcited by 291
  11. 2018Learning to Adapt in Dynamic, Real-World Environments Through Meta-Reinforcement Learningcited by 276
  12. 2020Model-Based Reinforcement Learning with Value-Targeted Regressioncited by 234
  13. 2020A review of deep learning in medical imaging: Imaging traits, technology trends, case studies with progress highlights, and future promisescited by 231
  14. 2018Model-Ensemble Trust-Region Policy Optimizationcited by 219
  15. 2017Multi-agent Reinforcement Learning in Sequential Social Dilemmascited by 209
  16. 2019Benchmarking Model-Based Reinforcement Learningcited by 162
  17. 2019A Survey of Reinforcement Learning Informed by Natural Languagecited by 154
  18. 2015Deep Spatial Autoencoders for Visuomotor Learningcited by 153
  19. 2018Meta-Reinforcement Learning of Structured Exploration Strategiescited by 130
  20. 2017Third-Person Imitation Learningcited by 103
  21. 2018Model-Based Reinforcement Learning via Meta-Policy Optimizationcited by 101
  22. 2017A Survey of Learning in Multiagent Environments: Dealing with Non-Stationaritycited by 94
  23. 2019Reducing Uncertainty in Undersampled MRI Reconstruction with Active Acquisitioncited by 56
  24. 2019Experience Replay Optimizationcited by 48
  25. 2020Active MR k-space Sampling with Reinforcement Learningcited by 46
  26. 2018Meta Reinforcement Learning with Latent Variable Gaussian Processescited by 44
  27. 2017Multi-step Reinforcement Learning: A Unifying Algorithmcited by 42
  28. 2019Iteratively-Refined Interactive 3D Medical Image Segmentation with Multi-Agent Reinforcement Learningcited by 41
  29. 2016An Artificial Agent for Robust Image Registrationcited by 23
  30. 2019Multiple Landmark Detection using Multi-Agent Reinforcement Learningcited by 23
  31. 2018Automatic View Planning with Multi-scale Deep Reinforcement Learning Agentscited by 20
  32. 2020Searching Learning Strategy with Reinforcement Learning for 3D Medical Image Segmentationcited by 17
  33. 2017Learning to detect chest radiographs containing lung nodules using visual attention networkscited by 16
  34. 2018Deep Reinforcement Learning for Surgical Gesture Segmentation and Classificationcited by 15
  35. 2019Learning Where to See: A Novel Attention Model for Automated Immunohistochemical Scoringcited by 14
  36. 2020Searching Collaborative Agents for Multi-plane Localization in 3D Ultrasoundcited by 14
  37. 2019Resource Optimized Neural Architecture Search for 3D Medical Image Segmentationcited by 13
  38. 2019Agent with Warm Start and Active Termination for Plane Localization in 3D Ultrasoundcited by 13

50 most cited of 69 All 69 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2021: 3; 2022: 13; 2023: 7; 2024: 2; 2025: 6; 2026: 3.

34 papers.

Sort:

By area:

  1. 2022Transforming medical imaging with Transformers? A comparative review of key properties, current progresses, and future perspectivescited by 33
  2. 2022Challenges and Opportunities in Deep Reinforcement Learning with Graph Neural Networks: A Comprehensive review of Algorithms and Applicationscited by 30
  3. 2023Segment Anything Model (SAM) for Radiation Oncologycited by 24
  4. 2022Robust Deep Reinforcement Learning through Bootstrapped Opportunistic Curriculumcited by 15
  5. 2021Deep reinforcement learning with automated label extraction from clinical reports accurately classifies 3D MRI brain volumescited by 12
  6. 2021DuDoTrans: Dual-Domain Transformer Provides More Attention for Sinogram Restoration in Sparse-View CT Reconstructioncited by 12
  7. 2022EmbryosFormer: Deformable Transformer and Collaborative Encoding-Decoding for Embryos Stage Development Classificationcited by 12
  8. 2022SS-3DCapsNet: Self-supervised 3D Capsule Networks for Medical Segmentation on Less Labeled Datacited by 10
  9. 2023I-AI: A Controllable & Interpretable AI System for Decoding Radiologists' Intense Focus for Accurate CXR Diagnosescited by 10
  10. 2022RLogist: Fast Observation Strategy on Whole-slide Images with Deep Reinforcement Learningcited by 8
  11. 2025DRMD: Deep Reinforcement Learning for Malware Detection under Concept Driftcited by 7
  12. 2023How to Fine-tune the Model: Unified Model Shift and Model Bias Policy Optimizationcited by 6
22 more
  1. 2021Flip Learning: Erase to Segmentcited by 5
  2. 2022Reinforced Inverse Scatteringcited by 5
  3. 2023Dual Attention Model with Reinforcement Learning for Classification of Histology Whole-Slide Imagescited by 5
  4. 2024Learning Low-Rank Feature for Thorax Disease Classificationcited by 4
  5. 2025Advanced Deep Learning and Large Language Models: Comprehensive Insights for Cancer Detectioncited by 4
  6. 2022Multimodality Multi-Lead ECG Arrhythmia Classification using Self-Supervised Learningcited by 3
  7. 2023Towards Saner Deep Image Registrationcited by 3
  8. 2025Flip Learning: Weakly Supervised Erase to Segment Nodules in Breast Ultrasoundcited by 3
  9. 2022Strategising template-guided needle placement for MR-targeted prostate biopsycited by 2
  10. 2023Multi-Target Landmark Detection with Incomplete Images via Reinforcement Learning and Shape Priorcited by 2
  11. 2025Comprehensive Review of Reinforcement Learning for Medical Ultrasound Imagingcited by 2
  12. 2022Towards deep observation: A systematic survey on artificial intelligence techniques to monitor fetus via Ultrasound Imagescited by 1
  13. 2022Deep reinforcement learning for fMRI prediction of Autism Spectrum Disordercited by 1
  14. 2022Automated Gadget Discovery in Sciencecited by 1
  15. 2023SolarFormer: Multi-scale Transformer for Solar PV Profilingcited by 1
  16. 2024CarcassFormer: An End-to-end Transformer-based Framework for Simultaneous Localization, Segmentation and Classification of Poultry Carcass Defectcited by 1
  17. 2026EMAD: Evidence-Centric Grounded Multimodal Diagnosis for Alzheimer's Diseasecited by 1
  18. 2022Automated Diagnosis of Cardiovascular Diseases from Cardiac Magnetic Resonance Imaging Using Deep Learning Models: A Reviewcited by 0
  19. 2025TransForSeg: A Multitask Stereo ViT for Joint Stereo Segmentation and 3D Force Estimation in Catheterizationcited by 0
  20. 2025Extending NGU to Multi-Agent RL: A Preliminary Studycited by 0
  21. 20263D MRI Image Pretraining via Controllable 2D Slice Navigation Taskcited by 0
  22. 2026COOPO: Cyclic Offline-Online Policy Optimization Algorithmcited by 0