Online Robustness Training for Deep Reinforcement Learning
Not on the map. Why?
Abstract (arXiv)
In deep reinforcement learning (RL), adversarial attacks can trick an agent into unwanted states and disrupt training. We propose a system called Robust Student-DQN (RS-DQN), which permits online robustness training alongside Q networks, while preserving competitive performance. We show that RS-DQN can be combined with (i) state-of-the-art adversarial training and (ii) provably robust training to obtain an agent that is resilient to strong attacks during training and evaluation.
Key facts. Cited by 26 papers in the map (data through 14 Oct 2026). First posted on arXiv 3 Nov 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 5; 2022: 6; 2023: 5; 2024: 3; 2025: 6; 2026: 1.
26 papers.
Sort:
By area:
- 2021Robust Reinforcement Learning on State Observations with Learned Optimal Adversarycited by 135
- 2021Who Is the Strongest Enemy? Towards Optimal and Efficient Evasion Attacks in Deep RLcited by 55
- 2022Efficient Adversarial Training without Attacking: Worst-Case-Aware Robust Reinforcement Learningcited by 43
- 2021CROP: Certifying Robust Policies for Reinforcement Learning through Functional Smoothingcited by 42
- 2022COPA: Certifying Robust Policies for Offline Reinforcement Learning against Poisoning Attackscited by 26
- 2023Omnidirectional Information Gathering for Knowledge Transfer-based Audio-Visual Navigationcited by 19
- 2024RAT: Adversarial Attacks on Deep Reinforcement Agents for Targeted Behaviorscited by 16
- 2022Admissible Policy Teaching through Reward Designcited by 12
- 2021Resilient Machine Learning for Networked Cyber Physical Systems: A Survey for Machine Learning Security to Securing Machine Learning for CPScited by 10
- 2025Rethinking Adversarial Attacks in Reinforcement Learning from Policy Distribution Perspectivecited by 10
- 2022Certifiably Robust Policy Learning against Adversarial Communication in Multi-agent Systemscited by 7
- 2023Rethinking Adversarial Policies: A Generalized Attack Formulation and Provable Defense in RLcited by 7
14 more
- 2023Improve Robustness of Reinforcement Learning against Observation Perturbations via l_∞ Lipschitz Policy Networkscited by 7
- 2024Towards Optimal Adversarial Robust Q-learning with Bellman Infinity-errorcited by 4
- 2021Improving Robustness of Deep Reinforcement Learning Agents: Environment Attack based on the Critic Networkcited by 3
- 2023Certifiably Robust Reinforcement Learning through Model-Based Abstract Interpretationcited by 3
- 2025Advancing Robustness in Deep Reinforcement Learning with an Ensemble Defense Approachcited by 3
- 2022Security of Deep Reinforcement Learning for Autonomous Driving: A Surveycited by 2
- 2025Action Robust Reinforcement Learning via Optimal Adversary Aware Policy Optimizationcited by 1
- 2026TCRL: Temporal-Coupled Adversarial Training for Robust Constrained Reinforcement Learning in Worst-Case Scenarioscited by 1
- 2022Measuring Interventional Robustness in Reinforcement Learningcited by 0
- 2023Game-Theoretic Robust Reinforcement Learning Handles Temporally-Coupled Perturbationscited by 0
- 2024On the Perturbed States for Transformed Input-robust Reinforcement Learningcited by 0
- 2025Towards Robust Deep Reinforcement Learning against Environmental State Perturbationcited by 0
- 2025A Dynamical Systems Framework for Reinforcement Learning Safety and Robustness Verificationcited by 0
- 2025On the Tension Between Optimality and Adversarial Robustness in Policy Optimizationcited by 0
- 2026TCRL: Temporal-Coupled Adversarial Training for Robust Constrained Reinforcement Learning in Worst-Case Scenarios13 Feb 2026
- 2025On the Tension Between Optimality and Adversarial Robustness in Policy Optimization1 Dec 2025
- 2025A Dynamical Systems Framework for Reinforcement Learning Safety and Robustness Verification21 Aug 2025
- 2025Advancing Robustness in Deep Reinforcement Learning with an Ensemble Defense Approach22 Jul 2025
- 2025Action Robust Reinforcement Learning via Optimal Adversary Aware Policy Optimization4 Jul 2025
- 2025Towards Robust Deep Reinforcement Learning against Environmental State Perturbation10 Jun 2025
- 2025Rethinking Adversarial Attacks in Reinforcement Learning from Policy Distribution Perspective7 Jan 2025
- 2024RAT: Adversarial Attacks on Deep Reinforcement Agents for Targeted Behaviors14 Dec 2024
- 2024On the Perturbed States for Transformed Input-robust Reinforcement Learning31 Jul 2024
- 2024Towards Optimal Adversarial Robust Q-learning with Bellman Infinity-error3 Feb 2024
- 2023Improve Robustness of Reinforcement Learning against Observation Perturbations via l_∞ Lipschitz Policy Networks14 Dec 2023
- 2023Omnidirectional Information Gathering for Knowledge Transfer-based Audio-Visual Navigation20 Aug 2023
14 more
- 2023Game-Theoretic Robust Reinforcement Learning Handles Temporally-Coupled Perturbations22 Jul 2023
- 2023Rethinking Adversarial Policies: A Generalized Attack Formulation and Provable Defense in RL27 May 2023
- 2023Certifiably Robust Reinforcement Learning through Model-Based Abstract Interpretation26 Jan 2023
- 2022Security of Deep Reinforcement Learning for Autonomous Driving: A Survey12 Dec 2022
- 2022Efficient Adversarial Training without Attacking: Worst-Case-Aware Robust Reinforcement Learning12 Oct 2022
- 2022Measuring Interventional Robustness in Reinforcement Learning19 Sep 2022
- 2022Certifiably Robust Policy Learning against Adversarial Communication in Multi-agent Systems21 Jun 2022
- 2022COPA: Certifying Robust Policies for Offline Reinforcement Learning against Poisoning Attacks16 Mar 2022
- 2022Admissible Policy Teaching through Reward Design6 Jan 2022
- 2021CROP: Certifying Robust Policies for Reinforcement Learning through Functional Smoothing17 Jun 2021
- 2021Who Is the Strongest Enemy? Towards Optimal and Efficient Evasion Attacks in Deep RL9 Jun 2021
- 2021Improving Robustness of Deep Reinforcement Learning Agents: Environment Attack based on the Critic Network7 Apr 2021
- 2021Resilient Machine Learning for Networked Cyber Physical Systems: A Survey for Machine Learning Security to Securing Machine Learning for CPS14 Feb 2021
- 2021Robust Reinforcement Learning on State Observations with Learned Optimal Adversary21 Jan 2021
- 2024RAT: Adversarial Attacks on Deep Reinforcement Agents for Targeted Behaviorscited by 16
- 2025Rethinking Adversarial Attacks in Reinforcement Learning from Policy Distribution Perspectivecited by 10
- 2024Towards Optimal Adversarial Robust Q-learning with Bellman Infinity-errorcited by 4
- 2025Advancing Robustness in Deep Reinforcement Learning with an Ensemble Defense Approachcited by 3
- 2025Action Robust Reinforcement Learning via Optimal Adversary Aware Policy Optimizationcited by 1
- 2026TCRL: Temporal-Coupled Adversarial Training for Robust Constrained Reinforcement Learning in Worst-Case Scenarioscited by 1
- 2024On the Perturbed States for Transformed Input-robust Reinforcement Learningcited by 0
- 2025Towards Robust Deep Reinforcement Learning against Environmental State Perturbationcited by 0
- 2025A Dynamical Systems Framework for Reinforcement Learning Safety and Robustness Verificationcited by 0
- 2025On the Tension Between Optimality and Adversarial Robustness in Policy Optimizationcited by 0
- 2026TCRL: Temporal-Coupled Adversarial Training for Robust Constrained Reinforcement Learning in Worst-Case Scenarios13 Feb 2026
- 2025On the Tension Between Optimality and Adversarial Robustness in Policy Optimization1 Dec 2025
- 2025A Dynamical Systems Framework for Reinforcement Learning Safety and Robustness Verification21 Aug 2025
- 2025Advancing Robustness in Deep Reinforcement Learning with an Ensemble Defense Approach22 Jul 2025
- 2025Action Robust Reinforcement Learning via Optimal Adversary Aware Policy Optimization4 Jul 2025
- 2025Towards Robust Deep Reinforcement Learning against Environmental State Perturbation10 Jun 2025
- 2025Rethinking Adversarial Attacks in Reinforcement Learning from Policy Distribution Perspective7 Jan 2025
- 2024RAT: Adversarial Attacks on Deep Reinforcement Agents for Targeted Behaviors14 Dec 2024
- 2024On the Perturbed States for Transformed Input-robust Reinforcement Learning31 Jul 2024
- 2024Towards Optimal Adversarial Robust Q-learning with Bellman Infinity-error3 Feb 2024
- 2021Robust Reinforcement Learning on State Observations with Learned Optimal Adversarycited by 135
- 2021Who Is the Strongest Enemy? Towards Optimal and Efficient Evasion Attacks in Deep RLcited by 55
- 2022Efficient Adversarial Training without Attacking: Worst-Case-Aware Robust Reinforcement Learningcited by 43
- 2021CROP: Certifying Robust Policies for Reinforcement Learning through Functional Smoothingcited by 42
- 2023Omnidirectional Information Gathering for Knowledge Transfer-based Audio-Visual Navigationcited by 19
- 2022Admissible Policy Teaching through Reward Designcited by 12
- 2021Resilient Machine Learning for Networked Cyber Physical Systems: A Survey for Machine Learning Security to Securing Machine Learning for CPScited by 10
- 2022Certifiably Robust Policy Learning against Adversarial Communication in Multi-agent Systemscited by 7
- 2023Rethinking Adversarial Policies: A Generalized Attack Formulation and Provable Defense in RLcited by 7
- 2023Improve Robustness of Reinforcement Learning against Observation Perturbations via l_∞ Lipschitz Policy Networkscited by 7
- 2021Improving Robustness of Deep Reinforcement Learning Agents: Environment Attack based on the Critic Networkcited by 3
- 2023Certifiably Robust Reinforcement Learning through Model-Based Abstract Interpretationcited by 3
12 most cited of 14 All 14 (JSON)
- 2023Improve Robustness of Reinforcement Learning against Observation Perturbations via l_∞ Lipschitz Policy Networks14 Dec 2023
- 2023Omnidirectional Information Gathering for Knowledge Transfer-based Audio-Visual Navigation20 Aug 2023
- 2023Game-Theoretic Robust Reinforcement Learning Handles Temporally-Coupled Perturbations22 Jul 2023
- 2023Rethinking Adversarial Policies: A Generalized Attack Formulation and Provable Defense in RL27 May 2023
- 2023Certifiably Robust Reinforcement Learning through Model-Based Abstract Interpretation26 Jan 2023
- 2022Efficient Adversarial Training without Attacking: Worst-Case-Aware Robust Reinforcement Learning12 Oct 2022
- 2022Measuring Interventional Robustness in Reinforcement Learning19 Sep 2022
- 2022Certifiably Robust Policy Learning against Adversarial Communication in Multi-agent Systems21 Jun 2022
- 2022Admissible Policy Teaching through Reward Design6 Jan 2022
- 2021CROP: Certifying Robust Policies for Reinforcement Learning through Functional Smoothing17 Jun 2021
- 2021Who Is the Strongest Enemy? Towards Optimal and Efficient Evasion Attacks in Deep RL9 Jun 2021
- 2021Improving Robustness of Deep Reinforcement Learning Agents: Environment Attack based on the Critic Network7 Apr 2021
12 newest of 14 All 14 (JSON)