mlsanityData to 7 Oct 2026

The Fourth International Verification of Neural Networks Competition (VNN-COMP 2023): Summary and Results

arXiv 2312.16760 ↗First posted 28 Dec 2023cs.LG cs.AI cs.SEcited by 38

Not on the map. Why?

Abstract (arXiv)

This report summarizes the 4th International Verification of Neural Networks Competition (VNN-COMP 2023), held as a part of the 6th Workshop on Formal Methods for ML-Enabled Autonomous Systems (FoMLAS), that was collocated with the 35th International Conference on Computer-Aided Verification (CAV). VNN-COMP is held annually to facilitate the fair and objective comparison of state-of-the-art neural network verification tools, encourage the standardization of tool interfaces, and bring together the neural network verification community. To this end, standardized formats for networks (ONNX) and specification (VNN-LIB) were defined, tools were evaluated on equal-cost hardware (using an automatic evaluation pipeline based on AWS instances), and tool parameters were chosen by the participants before the final test sets were made public. In the 2023 iteration, 7 teams participated on a diverse set of 10 scored and 4 unscored benchmarks. This report summarizes the rules, benchmarks, participating tools, results, and lessons learned from this iteration of this competition.

Key facts. Cited by 38 papers in the map (data through 7 Oct 2026). First posted on arXiv 28 Dec 2023.

Builds on

0 of 0 references.

No references here yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 20; 2025: 8; 2026: 10.

38 papers.

Sort:

  1. 2024Marabou 2.0: A Versatile Formal Analyzer of Neural Networkscited by 81
  2. 2024Neural Network Verification with Branch-and-Bound for General Nonlinearitiescited by 47
  3. 2024Scalable Neural Network Verification with Branch-and-bound Inferred Cutting Planescited by 33
  4. 2024Human vs. Machine: Behavioral Differences Between Expert Humans and Language Models in Wargame Simulationscited by 20
  5. 2024Formally Verifying Deep Reinforcement Learning Controllers with Lyapunov Barrier Certificatescited by 15
  6. 2025Neural Network Verification is a Programming Language Challengecited by 12
  7. 2024Detecting Brittle Decisions for Free: Leveraging Margin Consistency in Deep Robust Classifierscited by 10
  8. 2024Neural Network Verification with PyRATcited by 9
  9. 2025Clip-and-Verify: Linear Constraint-Driven Domain Clipping for Accelerating Neural Network Verificationcited by 9
  10. 2024Formal Verification of Graph Convolutional Networks with Uncertain Node Features and Uncertain Graph Structurecited by 8
  11. 2024Provably Safe Neural Network Controllers via Differential Dynamic Logiccited by 7
  12. 2024DeepCDCL: An CDCL-based Neural Network Verification Frameworkcited by 6
26 more
  1. 2024SoundnessBench: A Soundness Benchmark for Neural Network Verifierscited by 5
  2. 2024Certifying Robustness of Learning-Based Keypoint Detection and Pose Estimation Methodscited by 4
  3. 2025Advancing Neural Network Verification through Hierarchical Safety Abstract Interpretationcited by 4
  4. 2025Position: Certified Robustness Does Not (Yet) Imply Model Securitycited by 4
  5. 2024Learning Minimal Neural Specificationscited by 3
  6. 2026FAME: Formal Abstract Minimal Explanation for Neural Networkscited by 3
  7. 2024Achieving the Tightest Relaxation of Sigmoids for Formal Verificationcited by 2
  8. 2024Verification of Neural Networks against Convolutional Perturbations via Parameterised Kernelscited by 2
  9. 2024Robust width: A lightweight and certifiable adversarial defensecited by 1
  10. 2024VeriFlow: Modeling Distributions for Neural Network Verificationcited by 1
  11. 2024SMLE: Safe Machine Learning via Embedded Overapproximationcited by 1
  12. 2025A General Framework for Property-Driven Machine Learningcited by 1
  13. 2024Training Safe Neural Networks with Global SDP Boundscited by 0
  14. 2024Creating a Formally Verified Neural Network for Autonomous Navigation: An Experience Reportcited by 0
  15. 2025BoxRL-NNV: Boxed Refinement of Latin Hypercube Samples for Neural Network Verificationcited by 0
  16. 2025Language Models That Walk the Talk: A Framework for Formal Fairness Certificatescited by 0
  17. 2025The CAISAR Platform: Extending the Reach of Machine Learning Specification and Verificationcited by 0
  18. 2026From Decoupled to Coupled: Robustness Verification for Learning-based Keypoint Detection with Joint Specificationscited by 0
  19. 2026Analyzing Symbolic Properties for DRL Agents in Systems and Networkingcited by 0
  20. 2026Lipschitz Optimization for Formal Verification of Homographiescited by 0
  21. 2026Scaling Neural Network Verification with Tensor Parallelism and Fully Sharded Data Parallelismcited by 0
  22. 2026Shifting-based Optimizable Linear Relaxations for General Activation Functionscited by 0
  23. 2026A Survey on the Verification of Reinforcement Learning Policiescited by 0
  24. 2026Learning Lookahead Lemmas for Neural Network Verificationcited by 0
  25. 2026NNV3: Expanding Neural Network Verification to New Architectures and Domainscited by 0
  26. 2026Reachability-Based Formal Verification of Graph Neural Networks with Node and Edge Featurescited by 0