The Fifth International Verification of Neural Networks Competition (VNN-COMP 2024): Summary and Results
Not on the map. Why?
Abstract (arXiv)
This report summarizes the 5th International Verification of Neural Networks Competition (VNN-COMP 2024), held as a part of the 7th International Symposium on AI Verification (SAIV), that was collocated with the 36th International Conference on Computer-Aided Verification (CAV). VNN-COMP is held annually to facilitate the fair and objective comparison of state-of-the-art neural network verification tools, encourage the standardization of tool interfaces, and bring together the neural network verification community. To this end, standardized formats for networks (ONNX) and specification (VNN-LIB) were defined, tools were evaluated on equal-cost hardware (using an automatic evaluation pipeline based on AWS instances), and tool parameters were chosen by the participants before the final test sets were made public. In the 2024 iteration, 8 teams participated on a diverse set of 12 regular and 8 extended benchmarks. This report summarizes the rules, benchmarks, participating tools, results, and lessons learned from this iteration of this competition.
Key facts. Cited by 42 papers in the map (data through 7 Oct 2026). First posted on arXiv 28 Dec 2024.
Builds on
0 of 0 references.
No references here yet.
Built on by
Citing papers per year: 2024: 1; 2025: 20; 2026: 21.
42 papers.
Sort:
By area:
- 2024Scalable Neural Network Verification with Branch-and-bound Inferred Cutting Planescited by 33
- 2025Neural Network Verification is a Programming Language Challengecited by 12
- 2025SDP-CROWN: Efficient Bound Propagation for Neural Network Verification with Tightness of Semidefinite Programmingcited by 10
- 2026Formal Mechanistic Interpretability: Automated Circuit Discovery with Provable Guaranteescited by 10
- 2025Clip-and-Verify: Linear Constraint-Driven Domain Clipping for Accelerating Neural Network Verificationcited by 9
- 2025Out of the Shadows: Exploring a Latent Space for Neural Network Verificationcited by 6
- 2025Transformers are Inherently Succinctcited by 4
- 2025Proof Minimization in Neural Network Verificationcited by 4
- 2025PICID: Proof-Driven Clause Learning in Neural Network Verificationcited by 3
- 2025Probabilistic Robustness Analysis in High Dimensional Space: Application to Semantic Segmentation Networkcited by 3
- 2025Floating-Point Neural Network Verification at the Software Levelcited by 2
- 2025SAIL: Sound Abstract Interpreters with LLMscited by 2
30 more
- 2026Recursive querying of neural networks via weighted structurescited by 2
- 2026Parallel Differentiable Reachability for Learning and Planning with Certified Neural Dynamics and Controllerscited by 2
- 2025A Scalable Approach to Probabilistic Neuro-Symbolic Robustness Verificationcited by 1
- 2025Verification of Autonomous Neural Car Control with KeYmaera Xcited by 1
- 2025Certified Neural Approximations of Nonlinear Dynamicscited by 1
- 2025Bridging Efficiency and Safety: Formal Verification of Neural Networks with Early Exitscited by 1
- 2026Provably Explaining Neural Additive Modelscited by 1
- 2026IoUCert: Robustness Verification for Anchor-based Object Detectorscited by 1
- 2025Language Models That Walk the Talk: A Framework for Formal Fairness Certificatescited by 0
- 2025Interior-Point Vanishing Problem in Semidefinite Relaxations for Neural Network Verificationcited by 0
- 2025The CAISAR Platform: Extending the Reach of Machine Learning Specification and Verificationcited by 0
- 2025Efficient Certified Reasoning for Binarized Neural Networkscited by 0
- 2025Of Good Demons and Bad Angels: Guaranteeing Safe Control under Finite Precisioncited by 0
- 2025Formal Reasoning About Confidence and Automated Verification of Neural Networkscited by 0
- 2026Cascading Robustness Verification: Toward Efficient Model-Agnostic Certificationcited by 0
- 2026Synthesis and Verification of Transformer Programs (Technical Report)cited by 0
- 2026Certified Learning under Distribution Shift: Sound Verification and Identifiable Structurecited by 0
- 2026From Decoupled to Coupled: Robustness Verification for Learning-based Keypoint Detection with Joint Specificationscited by 0
- 2026The Luna Bound Propagator for Formal Analysis of Neural Networkscited by 0
- 2026Certified geometric robustness -- Super-DeepGcited by 0
- 2026Precise Verification of Transformers through ReLU-Catalyzed Abstraction Refinementcited by 0
- 2026Verified SHAP: Provable Bounds for Exact Shapley Values of Neural Networkscited by 0
- 2026The Complexity of Verifying Feedforward Neural Networks in Quantised Settingscited by 0
- 2026Scaling Neural Network Verification with Tensor Parallelism and Fully Sharded Data Parallelismcited by 0
- 2026Shifting-based Optimizable Linear Relaxations for General Activation Functionscited by 0
- 2026Learning Lookahead Lemmas for Neural Network Verificationcited by 0
- 2026Branch and Bound for Relational Verification of Neural Networkscited by 0
- 2026Reachability-Based Formal Verification of Graph Neural Networks with Node and Edge Featurescited by 0
- 2026Verifying Neural Networks with Reinforcement Learningcited by 0
- 2026CLAD: Constrained Abstract Domain for Neural Network Verificationcited by 0
- 2026CLAD: Constrained Abstract Domain for Neural Network Verification28 Sep 2026
- 2026Verifying Neural Networks with Reinforcement Learning28 Sep 2026
- 2026Reachability-Based Formal Verification of Graph Neural Networks with Node and Edge Features24 Sep 2026
- 2026Branch and Bound for Relational Verification of Neural Networks13 Aug 2026
- 2026Learning Lookahead Lemmas for Neural Network Verification31 Jul 2026
- 2026Shifting-based Optimizable Linear Relaxations for General Activation Functions18 Jun 2026
- 2026Scaling Neural Network Verification with Tensor Parallelism and Fully Sharded Data Parallelism8 Jun 2026
- 2026The Complexity of Verifying Feedforward Neural Networks in Quantised Settings28 May 2026
- 2026Parallel Differentiable Reachability for Learning and Planning with Certified Neural Dynamics and Controllers25 May 2026
- 2026Verified SHAP: Provable Bounds for Exact Shapley Values of Neural Networks22 May 2026
- 2026Precise Verification of Transformers through ReLU-Catalyzed Abstraction Refinement14 May 2026
- 2026Certified geometric robustness -- Super-DeepG27 Apr 2026
30 more
- 2026The Luna Bound Propagator for Formal Analysis of Neural Networks25 Mar 2026
- 2026From Decoupled to Coupled: Robustness Verification for Learning-based Keypoint Detection with Joint Specifications5 Mar 2026
- 2026IoUCert: Robustness Verification for Anchor-based Object Detectors3 Mar 2026
- 2026Provably Explaining Neural Additive Models19 Feb 2026
- 2026Formal Mechanistic Interpretability: Automated Circuit Discovery with Provable Guarantees18 Feb 2026
- 2026Synthesis and Verification of Transformer Programs (Technical Report)18 Feb 2026
- 2026Certified Learning under Distribution Shift: Sound Verification and Identifiable Structure6 Feb 2026
- 2026Cascading Robustness Verification: Toward Efficient Model-Agnostic Certification4 Feb 2026
- 2026Recursive querying of neural networks via weighted structures6 Jan 2026
- 2025Bridging Efficiency and Safety: Formal Verification of Neural Networks with Early Exits23 Dec 2025
- 2025Clip-and-Verify: Linear Constraint-Driven Domain Clipping for Accelerating Neural Network Verification11 Dec 2025
- 2025SAIL: Sound Abstract Interpreters with LLMs17 Nov 2025
- 2025Proof Minimization in Neural Network Verification11 Nov 2025
- 2025Formal Reasoning About Confidence and Automated Verification of Neural Networks10 Nov 2025
- 2025Floating-Point Neural Network Verification at the Software Level27 Oct 2025
- 2025Transformers are Inherently Succinct22 Oct 2025
- 2025Probabilistic Robustness Analysis in High Dimensional Space: Application to Semantic Segmentation Network15 Sep 2025
- 2025Of Good Demons and Bad Angels: Guaranteeing Safe Control under Finite Precision30 Jul 2025
- 2025Efficient Certified Reasoning for Binarized Neural Networks25 Jun 2025
- 2025Interior-Point Vanishing Problem in Semidefinite Relaxations for Neural Network Verification12 Jun 2025
- 2025The CAISAR Platform: Extending the Reach of Machine Learning Specification and Verification10 Jun 2025
- 2025SDP-CROWN: Efficient Bound Propagation for Neural Network Verification with Tightness of Semidefinite Programming7 Jun 2025
- 2025Out of the Shadows: Exploring a Latent Space for Neural Network Verification23 May 2025
- 2025Certified Neural Approximations of Nonlinear Dynamics21 May 2025
- 2025Language Models That Walk the Talk: A Framework for Formal Fairness Certificates19 May 2025
- 2025Verification of Autonomous Neural Car Control with KeYmaera X4 Apr 2025
- 2025PICID: Proof-Driven Clause Learning in Neural Network Verification15 Mar 2025
- 2025A Scalable Approach to Probabilistic Neuro-Symbolic Robustness Verification5 Feb 2025
- 2025Neural Network Verification is a Programming Language Challenge10 Jan 2025
- 2024Scalable Neural Network Verification with Branch-and-bound Inferred Cutting Planes31 Dec 2024
- 2024Scalable Neural Network Verification with Branch-and-bound Inferred Cutting Planescited by 33
- 2025Neural Network Verification is a Programming Language Challengecited by 12
- 2025SDP-CROWN: Efficient Bound Propagation for Neural Network Verification with Tightness of Semidefinite Programmingcited by 10
- 2026Formal Mechanistic Interpretability: Automated Circuit Discovery with Provable Guaranteescited by 10
- 2025Clip-and-Verify: Linear Constraint-Driven Domain Clipping for Accelerating Neural Network Verificationcited by 9
- 2025Out of the Shadows: Exploring a Latent Space for Neural Network Verificationcited by 6
- 2025Transformers are Inherently Succinctcited by 4
- 2025Proof Minimization in Neural Network Verificationcited by 4
- 2025PICID: Proof-Driven Clause Learning in Neural Network Verificationcited by 3
- 2025Probabilistic Robustness Analysis in High Dimensional Space: Application to Semantic Segmentation Networkcited by 3
- 2025Floating-Point Neural Network Verification at the Software Levelcited by 2
- 2025SAIL: Sound Abstract Interpreters with LLMscited by 2
12 most cited of 40 All 40 (JSON)
- 2026CLAD: Constrained Abstract Domain for Neural Network Verification28 Sep 2026
- 2026Verifying Neural Networks with Reinforcement Learning28 Sep 2026
- 2026Reachability-Based Formal Verification of Graph Neural Networks with Node and Edge Features24 Sep 2026
- 2026Branch and Bound for Relational Verification of Neural Networks13 Aug 2026
- 2026Learning Lookahead Lemmas for Neural Network Verification31 Jul 2026
- 2026Shifting-based Optimizable Linear Relaxations for General Activation Functions18 Jun 2026
- 2026Scaling Neural Network Verification with Tensor Parallelism and Fully Sharded Data Parallelism8 Jun 2026
- 2026The Complexity of Verifying Feedforward Neural Networks in Quantised Settings28 May 2026
- 2026Parallel Differentiable Reachability for Learning and Planning with Certified Neural Dynamics and Controllers25 May 2026
- 2026Verified SHAP: Provable Bounds for Exact Shapley Values of Neural Networks22 May 2026
- 2026Precise Verification of Transformers through ReLU-Catalyzed Abstraction Refinement14 May 2026
- 2026Certified geometric robustness -- Super-DeepG27 Apr 2026
12 newest of 40 All 40 (JSON)