POPQORN: Quantifying Robustness of Recurrent Neural Networks
Not on the map. Why?
Abstract (arXiv)
The vulnerability to adversarial attacks has been a critical issue for deep neural networks. Addressing this issue requires a reliable way to evaluate the robustness of a network. Recently, several methods have been developed to compute textitrobustness quantification for neural networks, namely, certified lower bounds of the minimum adversarial perturbation. Such methods, however, were devised for feed-forward networks, e.g. multi-layer perceptron or convolutional networks. It remains an open problem to quantify robustness for recurrent networks, especially LSTM and GRU. For such networks, there exist additional challenges in computing the robustness quantification, such as handling the inputs at multiple steps and the interaction between gates and states. In this work, we propose textitPOPQORN (Propagated-output Quantified Robustness for RNNs), a general algorithm to quantify robustness of RNNs, including vanilla RNNs, LSTMs, and GRUs. We demonstrate its effectiveness on different network architectures and show that the robustness quantification on individual steps can lead to new insights.
Key facts. Cited by 37 papers in the map (data through 14 Oct 2026). First posted on arXiv 17 May 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 12; 2022: 7; 2023: 10; 2024: 3; 2025: 3; 2026: 2.
37 papers.
Sort:
By area:
- 2023A Survey of Safety and Trustworthiness of Large Language Models through the Lens of Verification and Validationcited by 93
- 2021On Guaranteed Optimal Robust Explanations for NLP Modelscited by 54
- 2022Causality-based Neural Network Repaircited by 47
- 2023Text-CRS: A Generalized Certified Robustness Framework against Textual Adversarial Attackscited by 34
- 2021A Review of Formal Methods applied to Machine Learningcited by 33
- 2021Framing RNN as a kernel method: A neural ODE approachcited by 23
- 2022A Survey of Adversarial Defences and Robustness in NLPcited by 23
- 2021Certified Robustness to Programmable Transformations in LSTMscited by 18
- 2021Probabilistic Verification of Neural Networks Against Group Fairnesscited by 17
- 2024NLP Verification: Towards a General Methodology for Certifying Robustnesscited by 16
- 2021On Recurrent Neural Networks for learning-based control: recent results and ideas for future developmentscited by 14
- 2021Exploring Robust Architectures for Deep Artificial Neural Networkscited by 11
25 more
- 2022LinSyn: Synthesizing Tight Linear Bounds for Arbitrary Neural Network Activation Functionscited by 10
- 2022Localized Randomized Smoothing for Collective Robustness Certificationcited by 10
- 2023TextDefense: Adversarial Text Detection based on Word Importance Entropycited by 9
- 2021DeepSplit: Scalable Verification of Deep Neural Networks via Operator Splittingcited by 8
- 2023TextShield: Beyond Successfully Detecting Adversarial Sentences in Text Classificationcited by 8
- 2023Rate-Adaptive Coding Mechanism for Semantic Communications With Multi-Modal Datacited by 6
- 2021Fast Training of Provably Robust Neural Networks by SinglePropcited by 5
- 2023Repairing Deep Neural Networks Based on Behavior Imitationcited by 4
- 2023CertPri: Certifiable Prioritization for Deep Neural Networks via Movement Cost in Feature Spacecited by 4
- 2025Exact Verification of Graph Neural Networks with Incremental Constraint Solvingcited by 4
- 2021Robust Learning of Recurrent Neural Networks in Presence of Exogenous Noisecited by 3
- 2024A Certified Robust Watermark For Large Language Modelscited by 3
- 2022Robustness Analysis of Classification Using Recurrent Neural Networks with Perturbed Sequential Inputcited by 2
- 2022Tightening Robustness Verification of MaxPool-based Neural Networks via Minimizing the Over-Approximation Zonecited by 1
- 2023Model-Agnostic Reachability Analysis on Deep Neural Networkscited by 1
- 2023RNN-Guard: Certified Robustness Against Multi-frame Attacks for Recurrent Neural Networkscited by 1
- 2021Machine Learning and Deep Learning for Fixed-Text Keystroke Dynamicscited by 0
- 2021Machine Learning-Based Analysis of Free-Text Keystroke Dynamicscited by 0
- 2022A Domain-Theoretic Framework for Robustness Analysis of Neural Networkscited by 0
- 2023STR-Cert: Robustness Certification for Deep Text Recognition on Deep Learning Pipelines and Vision Transformerscited by 0
- 2024Towards General Robustness Verification of MaxPool-based Convolutional Neural Networks via Tightening Linear Approximationcited by 0
- 2025LTL Verification of Memoryful Neural Agentscited by 0
- 2025Tighter Truncated Rectangular Prism Approximation for RNN Robustness Verificationcited by 0
- 2026Probabilistic Verification of Recurrent Neural Networks for Single and Multi-Agent Reinforcement Learningcited by 0
- 2026Robustness Verification of Recurrent Neural Networks with Abstraction Refinementcited by 0
- 2026Robustness Verification of Recurrent Neural Networks with Abstraction Refinement10 Jun 2026
- 2026Probabilistic Verification of Recurrent Neural Networks for Single and Multi-Agent Reinforcement Learning14 May 2026
- 2025Tighter Truncated Rectangular Prism Approximation for RNN Robustness Verification12 Nov 2025
- 2025Exact Verification of Graph Neural Networks with Incremental Constraint Solving12 Aug 2025
- 2025LTL Verification of Memoryful Neural Agents4 Mar 2025
- 2024A Certified Robust Watermark For Large Language Models29 Sep 2024
- 2024Towards General Robustness Verification of MaxPool-based Convolutional Neural Networks via Tightening Linear Approximation2 Jun 2024
- 2024NLP Verification: Towards a General Methodology for Certifying Robustness15 Mar 2024
- 2023STR-Cert: Robustness Certification for Deep Text Recognition on Deep Learning Pipelines and Vision Transformers28 Nov 2023
- 2023Text-CRS: A Generalized Certified Robustness Framework against Textual Adversarial Attacks31 Jul 2023
- 2023CertPri: Certifiable Prioritization for Deep Neural Networks via Movement Cost in Feature Space18 Jul 2023
- 2023A Survey of Safety and Trustworthiness of Large Language Models through the Lens of Verification and Validation19 May 2023
25 more
- 2023Rate-Adaptive Coding Mechanism for Semantic Communications With Multi-Modal Data18 May 2023
- 2023Repairing Deep Neural Networks Based on Behavior Imitation5 May 2023
- 2023RNN-Guard: Certified Robustness Against Multi-frame Attacks for Recurrent Neural Networks17 Apr 2023
- 2023Model-Agnostic Reachability Analysis on Deep Neural Networks3 Apr 2023
- 2023TextDefense: Adversarial Text Detection based on Word Importance Entropy12 Feb 2023
- 2023TextShield: Beyond Successfully Detecting Adversarial Sentences in Text Classification3 Feb 2023
- 2022Tightening Robustness Verification of MaxPool-based Neural Networks via Minimizing the Over-Approximation Zone13 Nov 2022
- 2022Localized Randomized Smoothing for Collective Robustness Certification28 Oct 2022
- 2022Causality-based Neural Network Repair20 Apr 2022
- 2022A Survey of Adversarial Defences and Robustness in NLP12 Mar 2022
- 2022Robustness Analysis of Classification Using Recurrent Neural Networks with Perturbed Sequential Input10 Mar 2022
- 2022A Domain-Theoretic Framework for Robustness Analysis of Neural Networks1 Mar 2022
- 2022LinSyn: Synthesizing Tight Linear Bounds for Arbitrary Neural Network Activation Functions31 Jan 2022
- 2021On Recurrent Neural Networks for learning-based control: recent results and ideas for future developments26 Nov 2021
- 2021Probabilistic Verification of Neural Networks Against Group Fairness18 Jul 2021
- 2021Machine Learning-Based Analysis of Free-Text Keystroke Dynamics1 Jul 2021
- 2021Machine Learning and Deep Learning for Fixed-Text Keystroke Dynamics1 Jul 2021
- 2021Exploring Robust Architectures for Deep Artificial Neural Networks30 Jun 2021
- 2021DeepSplit: Scalable Verification of Deep Neural Networks via Operator Splitting16 Jun 2021
- 2021Framing RNN as a kernel method: A neural ODE approach2 Jun 2021
- 2021On Guaranteed Optimal Robust Explanations for NLP Models8 May 2021
- 2021Robust Learning of Recurrent Neural Networks in Presence of Exogenous Noise3 May 2021
- 2021A Review of Formal Methods applied to Machine Learning6 Apr 2021
- 2021Certified Robustness to Programmable Transformations in LSTMs15 Feb 2021
- 2021Fast Training of Provably Robust Neural Networks by SingleProp1 Feb 2021
- 2022Causality-based Neural Network Repaircited by 47
- 2024A Certified Robust Watermark For Large Language Modelscited by 3
- 2024A Certified Robust Watermark For Large Language Models29 Sep 2024
- 2022Causality-based Neural Network Repair20 Apr 2022
- 2023A Survey of Safety and Trustworthiness of Large Language Models through the Lens of Verification and Validationcited by 93
- 2021On Guaranteed Optimal Robust Explanations for NLP Modelscited by 54
- 2023Text-CRS: A Generalized Certified Robustness Framework against Textual Adversarial Attackscited by 34
- 2021A Review of Formal Methods applied to Machine Learningcited by 33
- 2021Framing RNN as a kernel method: A neural ODE approachcited by 23
- 2022A Survey of Adversarial Defences and Robustness in NLPcited by 23
- 2021Certified Robustness to Programmable Transformations in LSTMscited by 18
- 2021Probabilistic Verification of Neural Networks Against Group Fairnesscited by 17
- 2024NLP Verification: Towards a General Methodology for Certifying Robustnesscited by 16
- 2021On Recurrent Neural Networks for learning-based control: recent results and ideas for future developmentscited by 14
- 2021Exploring Robust Architectures for Deep Artificial Neural Networkscited by 11
- 2022LinSyn: Synthesizing Tight Linear Bounds for Arbitrary Neural Network Activation Functionscited by 10
12 most cited of 35 All 35 (JSON)
- 2026Robustness Verification of Recurrent Neural Networks with Abstraction Refinement10 Jun 2026
- 2026Probabilistic Verification of Recurrent Neural Networks for Single and Multi-Agent Reinforcement Learning14 May 2026
- 2025Tighter Truncated Rectangular Prism Approximation for RNN Robustness Verification12 Nov 2025
- 2025Exact Verification of Graph Neural Networks with Incremental Constraint Solving12 Aug 2025
- 2025LTL Verification of Memoryful Neural Agents4 Mar 2025
- 2024Towards General Robustness Verification of MaxPool-based Convolutional Neural Networks via Tightening Linear Approximation2 Jun 2024
- 2024NLP Verification: Towards a General Methodology for Certifying Robustness15 Mar 2024
- 2023STR-Cert: Robustness Certification for Deep Text Recognition on Deep Learning Pipelines and Vision Transformers28 Nov 2023
- 2023Text-CRS: A Generalized Certified Robustness Framework against Textual Adversarial Attacks31 Jul 2023
- 2023CertPri: Certifiable Prioritization for Deep Neural Networks via Movement Cost in Feature Space18 Jul 2023
- 2023A Survey of Safety and Trustworthiness of Large Language Models through the Lens of Verification and Validation19 May 2023
- 2023Rate-Adaptive Coding Mechanism for Semantic Communications With Multi-Modal Data18 May 2023
12 newest of 35 All 35 (JSON)