Online Cyber-Attack Detection in Smart Grid: A Reinforcement Learning Approach
Not on the map. Why?
Abstract (arXiv)
Early detection of cyber-attacks is crucial for a safe and reliable operation of the smart grid. In the literature, outlier detection schemes making sample-by-sample decisions and online detection schemes requiring perfect attack models have been proposed. In this paper, we formulate the online attack/anomaly detection problem as a partially observable Markov decision process (POMDP) problem and propose a universal robust online detection algorithm using the framework of model-free reinforcement learning (RL) for POMDPs. Numerical studies illustrate the effectiveness of the proposed RL-based algorithm in timely and accurate detection of cyber-attacks targeting the smart grid.
Key facts. Cited by 14 papers in the map (data through 7 Oct 2026). First posted on arXiv 14 Sep 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 4; 2022: 3; 2023: 4; 2024: 1; 2025: 2.
14 papers.
Sort:
- 2021Reinforcement Learning for IoT Security: A Comprehensive Surveycited by 21
- 2021Reinforcement Learning for Feedback-Enabled Cyber Resiliencecited by 18
- 2021Intrusion Prevention through Optimal Stoppingcited by 18
- 2023Learning Near-Optimal Intrusion Responses Against Dynamic Attackerscited by 13
- 2021Learning Intrusion Prevention Policies through Optimal Stoppingcited by 11
- 2022Machine Learning for Intrusion Detection in Industrial Control Systems: Applications, Challenges, and Recommendationscited by 8
- 2022Learning Security Strategies through Game Play and Optimal Stoppingcited by 5
- 2025Online Incident Response Planning under Model Misspecification through Bayesian Learning and Belief Quantizationcited by 5
- 2024A Comprehensive Survey on the Security of Smart Grid: Challenges, Mitigations, and Future Research Opportunitiescited by 4
- 2025Learning Optimal Defender Strategies for CAGE-2 using a POMDP Modelcited by 3
- 2022Principled Data-Driven Decision Support for Cyber-Forensic Investigationscited by 1
- 2023Trustworthy Artificial Intelligence Framework for Proactive Detection and Risk Explanation of Cyber Attacks in Smart Gridcited by 1
- 2025Learning Optimal Defender Strategies for CAGE-2 using a POMDP Model8 Sep 2025
- 2025Online Incident Response Planning under Model Misspecification through Bayesian Learning and Belief Quantization20 Aug 2025
- 2024A Comprehensive Survey on the Security of Smart Grid: Challenges, Mitigations, and Future Research Opportunities10 Jul 2024
- 2023Trustworthy Artificial Intelligence Framework for Proactive Detection and Risk Explanation of Cyber Attacks in Smart Grid12 Jun 2023
- 2023Deep Reinforcement Learning for Online Error Detection in Cyber-Physical Systems3 Feb 2023
- 2023Optimization Algorithms in Smart Grids: A Systematic Literature Review16 Jan 2023
- 2023Learning Near-Optimal Intrusion Responses Against Dynamic Attackers11 Jan 2023
- 2022Principled Data-Driven Decision Support for Cyber-Forensic Investigations23 Nov 2022
- 2022Learning Security Strategies through Game Play and Optimal Stopping29 May 2022
- 2022Machine Learning for Intrusion Detection in Industrial Control Systems: Applications, Challenges, and Recommendations24 Feb 2022
- 2021Intrusion Prevention through Optimal Stopping30 Oct 2021
- 2021Reinforcement Learning for Feedback-Enabled Cyber Resilience2 Jul 2021
2 more
- 2021Reinforcement Learning for IoT Security: A Comprehensive Surveycited by 21
- 2021Reinforcement Learning for Feedback-Enabled Cyber Resiliencecited by 18
- 2021Intrusion Prevention through Optimal Stoppingcited by 18
- 2023Learning Near-Optimal Intrusion Responses Against Dynamic Attackerscited by 13
- 2021Learning Intrusion Prevention Policies through Optimal Stoppingcited by 11
- 2022Machine Learning for Intrusion Detection in Industrial Control Systems: Applications, Challenges, and Recommendationscited by 8
- 2022Learning Security Strategies through Game Play and Optimal Stoppingcited by 5
- 2025Online Incident Response Planning under Model Misspecification through Bayesian Learning and Belief Quantizationcited by 5
- 2024A Comprehensive Survey on the Security of Smart Grid: Challenges, Mitigations, and Future Research Opportunitiescited by 4
- 2025Learning Optimal Defender Strategies for CAGE-2 using a POMDP Modelcited by 3
- 2022Principled Data-Driven Decision Support for Cyber-Forensic Investigationscited by 1
- 2023Trustworthy Artificial Intelligence Framework for Proactive Detection and Risk Explanation of Cyber Attacks in Smart Gridcited by 1
12 most cited of 14 All 14 (JSON)
- 2025Learning Optimal Defender Strategies for CAGE-2 using a POMDP Model8 Sep 2025
- 2025Online Incident Response Planning under Model Misspecification through Bayesian Learning and Belief Quantization20 Aug 2025
- 2024A Comprehensive Survey on the Security of Smart Grid: Challenges, Mitigations, and Future Research Opportunities10 Jul 2024
- 2023Trustworthy Artificial Intelligence Framework for Proactive Detection and Risk Explanation of Cyber Attacks in Smart Grid12 Jun 2023
- 2023Deep Reinforcement Learning for Online Error Detection in Cyber-Physical Systems3 Feb 2023
- 2023Optimization Algorithms in Smart Grids: A Systematic Literature Review16 Jan 2023
- 2023Learning Near-Optimal Intrusion Responses Against Dynamic Attackers11 Jan 2023
- 2022Principled Data-Driven Decision Support for Cyber-Forensic Investigations23 Nov 2022
- 2022Learning Security Strategies through Game Play and Optimal Stopping29 May 2022
- 2022Machine Learning for Intrusion Detection in Industrial Control Systems: Applications, Challenges, and Recommendations24 Feb 2022
- 2021Intrusion Prevention through Optimal Stopping30 Oct 2021
- 2021Reinforcement Learning for Feedback-Enabled Cyber Resilience2 Jul 2021
12 newest of 14 All 14 (JSON)