Verifying message-passing neural networks via topology-based bounds tightening
Not on the map. Why?
Abstract (arXiv)
Since graph neural networks (GNNs) are often vulnerable to attack, we need to know when we can trust them. We develop a computationally effective approach towards providing robust certificates for message-passing neural networks (MPNNs) using a Rectified Linear Unit (ReLU) activation function. Because our work builds on mixed-integer optimization, it encodes a wide variety of subproblems, for example it admits (i) both adding and removing edges, (ii) both global and local budgets, and (iii) both topological perturbations and feature modifications. Our key technology, topology-based bounds tightening, uses graph structure to tighten bounds. We also experiment with aggressive bounds tightening to dynamically change the optimization constraints by tightening variable bounds. To demonstrate the effectiveness of these strategies, we implement an extension to the open-source branch-and-cut solver SCIP. We test on both node and graph classification problems and consider topological attacks that both add and remove edges.
Key facts. Cited by 10 papers in the map (data through 7 Oct 2026). Builds on 36 of its 54 references that are in the map. First posted on arXiv 21 Feb 2024.
Builds on
36 of 54 references.
References · 36
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
- 2017Inductive Representation Learning on Large Graphscited by 6,284
- 2019Fast Graph Representation Learning with PyTorch Geometriccited by 2,414
- 2019Certified Adversarial Robustness via Randomized Smoothingcited by 1,324
- 2018Predict then Propagate: Graph Neural Networks meet Personalized PageRankcited by 987
- 2020TUDataset: A collection of benchmark datasets for learning with graphscited by 718
- 2018Efficient Neural Network Robustness Certification with General Activation Functionscited by 439
- 2018Adversarial Attacks on Neural Networks for Graph Datacited by 395
- 2018Adversarial Attack on Graph Structured Datacited by 300
- 2019Adversarial Attacks on Graph Neural Networks via Meta Learningcited by 261
- 2018Towards Fast Computation of Certified Robustness for ReLU Networkscited by 254
- 2019Topology Attack and Defense for Graph Neural Networks: An Optimization Perspectivecited by 196
24 more
- 2017An approach to reachability analysis for feed-forward ReLU neural networkscited by 126
- 2018Strong mixed-integer programming formulations for trained neural networkscited by 115
- 2021Robustness of Graph Neural Networks at Scalecited by 100
- 2021PRIMA: General and Precise Neural Network Certification via Scalable Convex Hull Approximationscited by 77
- 2020Towards More Practical Adversarial Attacks on Graph Neural Networkscited by 76
- 2019Certifiable Robustness to Graph Perturbationscited by 62
- 2019Certifiable Robustness and Robust Training for Graph Convolutional Networkscited by 59
- 2020Certified Robustness of Graph Neural Networks against Adversarial Structural Perturbationcited by 57
- 2020Efficient Robustness Certificates for Discrete Data: Sparsity-Aware Randomized Smoothing for Graphs, Images and Morecited by 56
- 2020Scalable Attack on Graph Data by Injecting Vicious Nodescited by 50
- 2020The Convex Relaxation Barrier, Revisited: Tightened Single-Neuron Relaxations for Neural Network Verificationcited by 50
- 2021Partition-based formulations for mixed-integer optimization of trained ReLU neural networkscited by 39
- 2022OMLT: Optimization & Machine Learning Toolkitcited by 34
- 2020PANE: scalable and effective attributed network embeddingcited by 23
- 2022Scalable Verification of GNN-based Job Schedulerscited by 18
- 2020Indirect Adversarial Attacks via Poisoning Neighbors for Graph Convolutional Networkscited by 16
- 2023Enabling Research through the SCIP Optimization Suite 8.0cited by 13
- 2022Fundamental Limits in Formal Verification of Message-Passing Neural Networkscited by 9
- 2023Mixed-Integer Optimisation of Graph Neural Networks for Computer-Aided Molecular Designcited by 9
- 2023PySCIPOpt-ML: Embedding Trained Machine Learning Models into Mixed-Integer Programscited by 8
- 2023Augmenting optimization-based molecular design with graph neural networkscited by 6
- 2023Computational Tradeoffs of Optimization-Based Bound Tightening in ReLU Networkscited by 6
- 2024Bound Tightening using Rolling-Horizon Decomposition for Neural Network Verificationcited by 6
- 2023Optimizing over trained GNNs via symmetry breakingcited by 5
Built on by
Citing papers per year: 2024: 3; 2025: 5; 2026: 2.
10 papers.
- 2024Provable Robustness of (Graph) Neural Networks Against Data Poisoning and Backdoor Attackscited by 5
- 2024Exact Certification of (Graph) Neural Networks Against Label Poisoningcited by 5
- 2025Exact Verification of Graph Neural Networks with Incremental Constraint Solvingcited by 4
- 2025Global optimization of graph acquisition functions for neural architecture searchcited by 2
- 2025Bridging Efficiency and Safety: Formal Verification of Neural Networks with Early Exitscited by 1
- 2024Certifying Robustness of Graph Convolutional Networks for Node Perturbation with Polyhedra Abstract Interpretationcited by 0
- 2025Optimization over Trained (and Sparse) Neural Networks: A Surrogate within a Surrogatecited by 0
- 2025Robustness Verification of Graph Neural Networks Via Lightweight Satisfiability Testingcited by 0
- 2026NNV3: Expanding Neural Network Verification to New Architectures and Domainscited by 0
- 2026Reachability-Based Formal Verification of Graph Neural Networks with Node and Edge Featurescited by 0
- 2026Reachability-Based Formal Verification of Graph Neural Networks with Node and Edge Features24 Sep 2026
- 2026NNV3: Expanding Neural Network Verification to New Architectures and Domains24 Sep 2026
- 2025Bridging Efficiency and Safety: Formal Verification of Neural Networks with Early Exits23 Dec 2025
- 2025Robustness Verification of Graph Neural Networks Via Lightweight Satisfiability Testing21 Oct 2025
- 2025Exact Verification of Graph Neural Networks with Incremental Constraint Solving12 Aug 2025
- 2025Global optimization of graph acquisition functions for neural architecture search29 May 2025
- 2025Optimization over Trained (and Sparse) Neural Networks: A Surrogate within a Surrogate4 May 2025
- 2024Exact Certification of (Graph) Neural Networks Against Label Poisoning30 Nov 2024
- 2024Provable Robustness of (Graph) Neural Networks Against Data Poisoning and Backdoor Attacks15 Jul 2024
- 2024Certifying Robustness of Graph Convolutional Networks for Node Perturbation with Polyhedra Abstract Interpretation14 May 2024