Whatever Does Not Kill Deep Reinforcement Learning, Makes It Stronger
Not on the map. Why?
Abstract (arXiv)
Recent developments have established the vulnerability of deep Reinforcement Learning (RL) to policy manipulation attacks via adversarial perturbations. In this paper, we investigate the robustness and resilience of deep RL to training-time and test-time attacks. Through experimental results, we demonstrate that under noncontiguous training-time attacks, Deep Q-Network (DQN) agents can recover and adapt to the adversarial conditions by reactively adjusting the policy. Our results also show that policies learned under adversarial perturbations are more robust to test-time attacks. Furthermore, we compare the performance of ε-greedy and parameter-space noise exploration methods in terms of robustness and resilience against adversarial perturbations.
Key facts. Cited by 35 papers in the map (data through 14 Oct 2026). First posted on arXiv 23 Dec 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 6; 2022: 9; 2023: 7; 2024: 4; 2025: 8; 2026: 1.
35 papers.
Sort:
By area:
- 2021Robust Reinforcement Learning on State Observations with Learned Optimal Adversarycited by 135
- 2022Efficient Adversarial Training without Attacking: Worst-Case-Aware Robust Reinforcement Learningcited by 43
- 2021CROP: Certifying Robust Policies for Reinforcement Learning through Functional Smoothingcited by 42
- 2022Trustworthy Reinforcement Learning Against Intrinsic Vulnerabilities: Robustness, Safety, and Generalizabilitycited by 36
- 2022COPA: Certifying Robust Policies for Offline Reinforcement Learning against Poisoning Attackscited by 26
- 2021Defense Against Reward Poisoning Attacks in Reinforcement Learningcited by 21
- 2022Robust Deep Reinforcement Learning through Bootstrapped Opportunistic Curriculumcited by 15
- 2023Implicit Poisoning Attacks in Two-Agent Reinforcement Learning: Adversarial Policies for Training-Time Attackscited by 14
- 2022A Search-Based Testing Approach for Deep Reinforcement Learning Agentscited by 13
- 2021Resilient Machine Learning for Networked Cyber Physical Systems: A Survey for Machine Learning Security to Securing Machine Learning for CPScited by 10
- 2023Adjustable Robust Reinforcement Learning for Online 3D Bin Packingcited by 10
- 2021Real-time Adversarial Perturbations against Deep Reinforcement Learning Policies: Attacks and Defensescited by 9
23 more
- 2022Efficient Reward Poisoning Attacks on Online Deep Reinforcement Learningcited by 9
- 2024Mitigating Adversarial Perturbations for Deep Reinforcement Learning via Vector Quantizationcited by 6
- 2022Deep-Attack over the Deep Reinforcement Learningcited by 5
- 2023Black-Box Targeted Reward Poisoning Attack Against Online Deep Reinforcement Learningcited by 5
- 2024Towards Optimal Adversarial Robust Q-learning with Bellman Infinity-errorcited by 4
- 2023SoK: Adversarial Machine Learning Attacks and Defences in Multi-Agent Reinforcement Learningcited by 3
- 2023Toward Evaluating Robustness of Reinforcement Learning with Adversarial Policycited by 3
- 2025Advancing Robustness in Deep Reinforcement Learning with an Ensemble Defense Approachcited by 3
- 2021On Assessing The Safety of Reinforcement Learning algorithms Using Formal Methodscited by 2
- 2025Policy Teaching via Data Poisoning in Learning from Human Preferencescited by 2
- 2025A Conceptual Framework for AI-based Decision Systems in Critical Infrastructurescited by 2
- 2023Policy Resilience to Environment Poisoning Attacks on Reinforcement Learningcited by 1
- 2022Attacking and Defending Deep Reinforcement Learning Policiescited by 0
- 2022Explainable and Safe Reinforcement Learning for Autonomous Air Mobilitycited by 0
- 2023Game-Theoretic Robust Reinforcement Learning Handles Temporally-Coupled Perturbationscited by 0
- 2024On the Perturbed States for Transformed Input-robust Reinforcement Learningcited by 0
- 2024Robust off-policy Reinforcement Learning via Soft Constrained Adversarycited by 0
- 2025On the Definition of Robustness and Resilience of AI Agents for Real-time Congestion Managementcited by 0
- 2025Off-Policy Actor-Critic for Adversarial Observation Robustness: Virtual Alternative Training via Symmetric Policy Evaluationcited by 0
- 2025Meta Policy Switching for Secure UAV Deconfliction in Adversarial Airspacecited by 0
- 2025Neutral Agent-based Adversarial Policy Learning against Deep Reinforcement Learning in Multi-party Open Systemscited by 0
- 2025On the Tension Between Optimality and Adversarial Robustness in Policy Optimizationcited by 0
- 2026Certifying Lower Bounds for Risk-Sensitive Reinforcement Learning under Adversarial State Perturbationscited by 0
- 2026Certifying Lower Bounds for Risk-Sensitive Reinforcement Learning under Adversarial State Perturbations9 Sep 2026
- 2025On the Tension Between Optimality and Adversarial Robustness in Policy Optimization1 Dec 2025
- 2025Neutral Agent-based Adversarial Policy Learning against Deep Reinforcement Learning in Multi-party Open Systems13 Oct 2025
- 2025Advancing Robustness in Deep Reinforcement Learning with an Ensemble Defense Approach22 Jul 2025
- 2025Meta Policy Switching for Secure UAV Deconfliction in Adversarial Airspace26 Jun 2025
- 2025Off-Policy Actor-Critic for Adversarial Observation Robustness: Virtual Alternative Training via Symmetric Policy Evaluation20 Jun 2025
- 2025A Conceptual Framework for AI-based Decision Systems in Critical Infrastructures21 Apr 2025
- 2025On the Definition of Robustness and Resilience of AI Agents for Real-time Congestion Management17 Apr 2025
- 2025Policy Teaching via Data Poisoning in Learning from Human Preferences13 Mar 2025
- 2024Mitigating Adversarial Perturbations for Deep Reinforcement Learning via Vector Quantization4 Oct 2024
- 2024Robust off-policy Reinforcement Learning via Soft Constrained Adversary31 Aug 2024
- 2024On the Perturbed States for Transformed Input-robust Reinforcement Learning31 Jul 2024
23 more
- 2024Towards Optimal Adversarial Robust Q-learning with Bellman Infinity-error3 Feb 2024
- 2023Adjustable Robust Reinforcement Learning for Online 3D Bin Packing6 Oct 2023
- 2023Game-Theoretic Robust Reinforcement Learning Handles Temporally-Coupled Perturbations22 Jul 2023
- 2023Black-Box Targeted Reward Poisoning Attack Against Online Deep Reinforcement Learning18 May 2023
- 2023Toward Evaluating Robustness of Reinforcement Learning with Adversarial Policy4 May 2023
- 2023Policy Resilience to Environment Poisoning Attacks on Reinforcement Learning24 Apr 2023
- 2023Implicit Poisoning Attacks in Two-Agent Reinforcement Learning: Adversarial Policies for Training-Time Attacks27 Feb 2023
- 2023SoK: Adversarial Machine Learning Attacks and Defences in Multi-Agent Reinforcement Learning11 Jan 2023
- 2022Explainable and Safe Reinforcement Learning for Autonomous Air Mobility24 Nov 2022
- 2022Efficient Adversarial Training without Attacking: Worst-Case-Aware Robust Reinforcement Learning12 Oct 2022
- 2022Trustworthy Reinforcement Learning Against Intrinsic Vulnerabilities: Robustness, Safety, and Generalizability16 Sep 2022
- 2022Robust Deep Reinforcement Learning through Bootstrapped Opportunistic Curriculum21 Jun 2022
- 2022A Search-Based Testing Approach for Deep Reinforcement Learning Agents15 Jun 2022
- 2022Efficient Reward Poisoning Attacks on Online Deep Reinforcement Learning30 May 2022
- 2022Attacking and Defending Deep Reinforcement Learning Policies16 May 2022
- 2022Deep-Attack over the Deep Reinforcement Learning2 May 2022
- 2022COPA: Certifying Robust Policies for Offline Reinforcement Learning against Poisoning Attacks16 Mar 2022
- 2021On Assessing The Safety of Reinforcement Learning algorithms Using Formal Methods8 Nov 2021
- 2021CROP: Certifying Robust Policies for Reinforcement Learning through Functional Smoothing17 Jun 2021
- 2021Real-time Adversarial Perturbations against Deep Reinforcement Learning Policies: Attacks and Defenses16 Jun 2021
- 2021Resilient Machine Learning for Networked Cyber Physical Systems: A Survey for Machine Learning Security to Securing Machine Learning for CPS14 Feb 2021
- 2021Defense Against Reward Poisoning Attacks in Reinforcement Learning10 Feb 2021
- 2021Robust Reinforcement Learning on State Observations with Learned Optimal Adversary21 Jan 2021
- 2024Mitigating Adversarial Perturbations for Deep Reinforcement Learning via Vector Quantizationcited by 6
- 2024Towards Optimal Adversarial Robust Q-learning with Bellman Infinity-errorcited by 4
- 2025Advancing Robustness in Deep Reinforcement Learning with an Ensemble Defense Approachcited by 3
- 2024On the Perturbed States for Transformed Input-robust Reinforcement Learningcited by 0
- 2024Robust off-policy Reinforcement Learning via Soft Constrained Adversarycited by 0
- 2025Off-Policy Actor-Critic for Adversarial Observation Robustness: Virtual Alternative Training via Symmetric Policy Evaluationcited by 0
- 2025Meta Policy Switching for Secure UAV Deconfliction in Adversarial Airspacecited by 0
- 2025Neutral Agent-based Adversarial Policy Learning against Deep Reinforcement Learning in Multi-party Open Systemscited by 0
- 2025On the Tension Between Optimality and Adversarial Robustness in Policy Optimizationcited by 0
- 2026Certifying Lower Bounds for Risk-Sensitive Reinforcement Learning under Adversarial State Perturbationscited by 0
- 2026Certifying Lower Bounds for Risk-Sensitive Reinforcement Learning under Adversarial State Perturbations9 Sep 2026
- 2025On the Tension Between Optimality and Adversarial Robustness in Policy Optimization1 Dec 2025
- 2025Neutral Agent-based Adversarial Policy Learning against Deep Reinforcement Learning in Multi-party Open Systems13 Oct 2025
- 2025Advancing Robustness in Deep Reinforcement Learning with an Ensemble Defense Approach22 Jul 2025
- 2025Meta Policy Switching for Secure UAV Deconfliction in Adversarial Airspace26 Jun 2025
- 2025Off-Policy Actor-Critic for Adversarial Observation Robustness: Virtual Alternative Training via Symmetric Policy Evaluation20 Jun 2025
- 2024Mitigating Adversarial Perturbations for Deep Reinforcement Learning via Vector Quantization4 Oct 2024
- 2024Robust off-policy Reinforcement Learning via Soft Constrained Adversary31 Aug 2024
- 2024On the Perturbed States for Transformed Input-robust Reinforcement Learning31 Jul 2024
- 2024Towards Optimal Adversarial Robust Q-learning with Bellman Infinity-error3 Feb 2024
- 2021Robust Reinforcement Learning on State Observations with Learned Optimal Adversarycited by 135
- 2022Efficient Adversarial Training without Attacking: Worst-Case-Aware Robust Reinforcement Learningcited by 43
- 2021CROP: Certifying Robust Policies for Reinforcement Learning through Functional Smoothingcited by 42
- 2022Trustworthy Reinforcement Learning Against Intrinsic Vulnerabilities: Robustness, Safety, and Generalizabilitycited by 36
- 2021Defense Against Reward Poisoning Attacks in Reinforcement Learningcited by 21
- 2022Robust Deep Reinforcement Learning through Bootstrapped Opportunistic Curriculumcited by 15
- 2023Implicit Poisoning Attacks in Two-Agent Reinforcement Learning: Adversarial Policies for Training-Time Attackscited by 14
- 2022A Search-Based Testing Approach for Deep Reinforcement Learning Agentscited by 13
- 2021Resilient Machine Learning for Networked Cyber Physical Systems: A Survey for Machine Learning Security to Securing Machine Learning for CPScited by 10
- 2023Adjustable Robust Reinforcement Learning for Online 3D Bin Packingcited by 10
- 2021Real-time Adversarial Perturbations against Deep Reinforcement Learning Policies: Attacks and Defensescited by 9
- 2022Efficient Reward Poisoning Attacks on Online Deep Reinforcement Learningcited by 9
12 most cited of 23 All 23 (JSON)
- 2025A Conceptual Framework for AI-based Decision Systems in Critical Infrastructures21 Apr 2025
- 2025On the Definition of Robustness and Resilience of AI Agents for Real-time Congestion Management17 Apr 2025
- 2023Adjustable Robust Reinforcement Learning for Online 3D Bin Packing6 Oct 2023
- 2023Game-Theoretic Robust Reinforcement Learning Handles Temporally-Coupled Perturbations22 Jul 2023
- 2023Black-Box Targeted Reward Poisoning Attack Against Online Deep Reinforcement Learning18 May 2023
- 2023Toward Evaluating Robustness of Reinforcement Learning with Adversarial Policy4 May 2023
- 2023Policy Resilience to Environment Poisoning Attacks on Reinforcement Learning24 Apr 2023
- 2023Implicit Poisoning Attacks in Two-Agent Reinforcement Learning: Adversarial Policies for Training-Time Attacks27 Feb 2023
- 2023SoK: Adversarial Machine Learning Attacks and Defences in Multi-Agent Reinforcement Learning11 Jan 2023
- 2022Explainable and Safe Reinforcement Learning for Autonomous Air Mobility24 Nov 2022
- 2022Efficient Adversarial Training without Attacking: Worst-Case-Aware Robust Reinforcement Learning12 Oct 2022
- 2022Trustworthy Reinforcement Learning Against Intrinsic Vulnerabilities: Robustness, Safety, and Generalizability16 Sep 2022
12 newest of 23 All 23 (JSON)