Actor Critic with Experience Replay-based automatic treatment planning for prostate cancer intensity modulated radiotherapy
On the map: Deep reinforcement learning methods → RL for clinical treatment and surgery
Abstract (arXiv)
Background: Real-time treatment planning in IMRT is challenging due to complex beam interactions. AI has improved automation, but existing models require large, high-quality datasets and lack universal applicability. Deep reinforcement learning (DRL) offers a promising alternative by mimicking human trial-and-error planning. Purpose: Develop a stochastic policy-based DRL agent for automatic treatment planning with efficient training, broad applicability, and robustness against adversarial attacks using Fast Gradient Sign Method (FGSM). Methods: Using the Actor-Critic with Experience Replay (ACER) architecture, the agent tunes treatment planning parameters (TPPs) in inverse planning. Training is based on prostate cancer IMRT cases, using dose-volume histograms (DVHs) as input. The model is trained on a single patient case, validated on two independent cases, and tested on 300+ plans across three datasets. Plan quality is assessed using ProKnow scores, and robustness is tested against adversarial attacks. Results: Despite training on a single case, the model generalizes well. Before ACER-based planning, the mean plan score was 6.20±1.84; after, 93.09% of cases achieved a perfect score of 9, with a mean of 8.93±0.27. The agent effectively prioritizes optimal TPP tuning and remains robust against adversarial attacks. Conclusions: The ACER-based DRL agent enables efficient, high-quality treatment planning in prostate cancer IMRT, demonstrating strong generalizability and robustness.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Placed in RL for clinical treatment and surgery, one of 15 directions in Deep reinforcement learning methods. Builds on 11 of its 32 references that are in the map. First posted on arXiv 1 Feb 2025.
Builds on
11 of 32 references.
References · 11
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
- 2014Explaining and Harnessing Adversarial Examplescited by 7,364
- 2016Densely Connected Convolutional Networkscited by 6,720
- 2013Intriguing properties of neural networkscited by 5,155
- 2015Trust Region Policy Optimizationcited by 2,580
- 2016Asynchronous Methods for Deep Reinforcement Learningcited by 2,258
- 2017Adversarial Attacks on Neural Network Policiescited by 320
- 2016Safe and Efficient Off-Policy Reinforcement Learningcited by 264
- 2016Sample Efficient Actor-Critic with Experience Replaycited by 188
- 2020Dose Prediction with Deep Learning for Prostate Cancer Radiation Therapy: Model Adaptation to Different Treatment Planning Practicescited by 6
Built on by
Citing papers per year: 2025: 1; 2026: 1.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2024Automating proton PBS treatment planning for head and neck cancers using policy gradient-based deep reinforcement learning
- 2025Automatic Treatment Planning using Reinforcement Learning for High-dose-rate Prostate Brachytherapy
- 2025Autonomous Radiotherapy Treatment Planning Using DOLA: A Privacy-Preserving, LLM-Based Optimization Agent
- 2025Patient-Specific Deep Reinforcement Learning for Automatic Replanning in Head-and-Neck Cancer Proton Therapy
- 2025Zero-Shot Large Language Model Agents for Fully Automated Radiotherapy Treatment Planning
- 2025Transforming Multimodal Models into Action Models for Radiotherapy
- 2024Automated radiotherapy treatment planning guided by GPT-4Vision
- 2025Automated Treatment Planning for Interstitial HDR Brachytherapy for Locally Advanced Cervical Cancer using Deep Reinforcement Learning