mlsanityData to 7 Oct 2026

Neuro-Symbolic Verification of Deep Neural Networks

arXiv 2203.00938 ↗First posted 2 Mar 2022cs.AI cs.LG cs.LOcited by 21

Not on the map. Why?

Abstract (arXiv)

Formal verification has emerged as a powerful approach to ensure the safety and reliability of deep neural networks. However, current verification tools are limited to only a handful of properties that can be expressed as first-order constraints over the inputs and output of a network. While adversarial robustness and fairness fall under this category, many real-world properties (e.g., "an autonomous vehicle has to stop in front of a stop sign") remain outside the scope of existing verification technology. To mitigate this severe practical restriction, we introduce a novel framework for verifying neural networks, named neuro-symbolic verification. The key idea is to use neural networks as part of the otherwise logical specification, enabling the verification of a wide variety of complex, real-world properties, including the one above. Moreover, we demonstrate how neuro-symbolic verification can be implemented on top of existing verification infrastructure for neural networks, making our framework easily accessible to researchers and practitioners alike.

Key facts. Cited by 21 papers in the map (data through 7 Oct 2026). Builds on 13 of its 47 references that are in the map. First posted on arXiv 2 Mar 2022.

Builds on

13 of 47 references.

References · 13

  1. 2013Intriguing properties of neural networkscited by 5,114
  2. 2017Reluplex: An Efficient SMT Solver for Verifying Deep Neural Networkscited by 739
  3. 2019The Neuro-Symbolic Concept Learner: Interpreting Scenes, Words, and Sentences From Natural Supervisioncited by 369
  4. 2018Neural-Symbolic VQA: Disentangling Reasoning from Vision and Language Understandingcited by 304
  5. 2020Neurosymbolic AI: The 3rd Wavecited by 253
  6. 2019Neural-Symbolic Computing: An Effective Methodology for Principled Integration of Machine Learning and Reasoningcited by 149
  7. 2020Preventing Repeated Real World AI Failures by Cataloging Incidents: The AI Incident Databasecited by 95
  8. 2020Right for the Right Concept: Revising Neuro-Symbolic Concepts by Interacting with their Explanationscited by 94
  9. 2020From Statistical Relational to Neuro-Symbolic Artificial Intelligencecited by 63
  10. 2021Introduction to Neural Network Verificationcited by 63
  11. 2020Generative Neurosymbolic Machinescited by 57
  12. 2018Concolic Testing for Deep Neural Networkscited by 51
1 more
  1. 2020Conversational Neuro-Symbolic Commonsense Reasoningcited by 28

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2022: 2; 2023: 3; 2024: 6; 2025: 7; 2026: 3.

21 papers.

Sort:

By area:

  1. 2024Marabou 2.0: A Versatile Formal Analyzer of Neural Networkscited by 81
  2. 2023Not All Neuro-Symbolic Concepts Are Created Equal: Analysis and Mitigation of Reasoning Shortcutscited by 63
  3. 2024BEARS Make Neuro-Symbolic Models Aware of their Reasoning Shortcutscited by 36
  4. 2024A Neuro-Symbolic Benchmark Suite for Concept Quality and Reasoning Shortcutscited by 19
  5. 2022Toward Certified Robustness Against Real-World Distribution Shiftscited by 16
  6. 2025Shortcuts and Identifiability in Concept-based Models from a Neuro-Symbolic Lenscited by 13
  7. 2025Neural Network Verification is a Programming Language Challengecited by 12
  8. 2023Value Functions are Control Barrier Functions: Verification of Safe Policies using Control Theorycited by 5
  9. 2025PICID: Proof-Driven Clause Learning in Neural Network Verificationcited by 3
  10. 2023On the verification of Embeddings using Hybrid Markov Logiccited by 2
  11. 2025Neuro-Symbolic AI for Cybersecurity: State of the Art, Challenges, and Opportunitiescited by 2
  12. 2022Modular design patterns for neural-symbolic integration: refinement and combinationcited by 1
9 more
  1. 2024VeriFlow: Modeling Distributions for Neural Network Verificationcited by 1
  2. 2025A Scalable Approach to Probabilistic Neuro-Symbolic Robustness Verificationcited by 1
  3. 2026NeuroShield: A Neuro-Symbolic Framework for Adversarial Robustnesscited by 1
  4. 2026Neuro-Symbolic Artificial Intelligence: A Task-Directed Survey in the Black-Box Models Eracited by 1
  5. 2024Probabilistic ML Verification via Weighted Model Integrationcited by 0
  6. 2024Bridging the Gap: Representation Spaces in Neuro-Symbolic AIcited by 0
  7. 2025The CAISAR Platform: Extending the Reach of Machine Learning Specification and Verificationcited by 0
  8. 2025Attack logics, not outputs: Towards efficient robustification of deep neural networks by falsifying concept-based propertiescited by 0
  9. 2026Mining Verdict Boundaries for Neural Network Verificationcited by 0