Neuro-Symbolic Verification of Deep Neural Networks
Not on the map. Why?
Abstract (arXiv)
Formal verification has emerged as a powerful approach to ensure the safety and reliability of deep neural networks. However, current verification tools are limited to only a handful of properties that can be expressed as first-order constraints over the inputs and output of a network. While adversarial robustness and fairness fall under this category, many real-world properties (e.g., "an autonomous vehicle has to stop in front of a stop sign") remain outside the scope of existing verification technology. To mitigate this severe practical restriction, we introduce a novel framework for verifying neural networks, named neuro-symbolic verification. The key idea is to use neural networks as part of the otherwise logical specification, enabling the verification of a wide variety of complex, real-world properties, including the one above. Moreover, we demonstrate how neuro-symbolic verification can be implemented on top of existing verification infrastructure for neural networks, making our framework easily accessible to researchers and practitioners alike.
Key facts. Cited by 21 papers in the map (data through 7 Oct 2026). Builds on 13 of its 47 references that are in the map. First posted on arXiv 2 Mar 2022.
Builds on
13 of 47 references.
References · 13
- 2013Intriguing properties of neural networkscited by 5,114
- 2017Reluplex: An Efficient SMT Solver for Verifying Deep Neural Networkscited by 739
- 2019The Neuro-Symbolic Concept Learner: Interpreting Scenes, Words, and Sentences From Natural Supervisioncited by 369
- 2018Neural-Symbolic VQA: Disentangling Reasoning from Vision and Language Understandingcited by 304
- 2020Neurosymbolic AI: The 3rd Wavecited by 253
- 2019Neural-Symbolic Computing: An Effective Methodology for Principled Integration of Machine Learning and Reasoningcited by 149
- 2020Preventing Repeated Real World AI Failures by Cataloging Incidents: The AI Incident Databasecited by 95
- 2020Right for the Right Concept: Revising Neuro-Symbolic Concepts by Interacting with their Explanationscited by 94
- 2020From Statistical Relational to Neuro-Symbolic Artificial Intelligencecited by 63
- 2021Introduction to Neural Network Verificationcited by 63
- 2020Generative Neurosymbolic Machinescited by 57
- 2018Concolic Testing for Deep Neural Networkscited by 51
1 more
- 2020Conversational Neuro-Symbolic Commonsense Reasoningcited by 28
Built on by
Citing papers per year: 2022: 2; 2023: 3; 2024: 6; 2025: 7; 2026: 3.
21 papers.
Sort:
By area:
- 2024Marabou 2.0: A Versatile Formal Analyzer of Neural Networkscited by 81
- 2023Not All Neuro-Symbolic Concepts Are Created Equal: Analysis and Mitigation of Reasoning Shortcutscited by 63
- 2024BEARS Make Neuro-Symbolic Models Aware of their Reasoning Shortcutscited by 36
- 2024A Neuro-Symbolic Benchmark Suite for Concept Quality and Reasoning Shortcutscited by 19
- 2022Toward Certified Robustness Against Real-World Distribution Shiftscited by 16
- 2025Shortcuts and Identifiability in Concept-based Models from a Neuro-Symbolic Lenscited by 13
- 2025Neural Network Verification is a Programming Language Challengecited by 12
- 2023Value Functions are Control Barrier Functions: Verification of Safe Policies using Control Theorycited by 5
- 2025PICID: Proof-Driven Clause Learning in Neural Network Verificationcited by 3
- 2023On the verification of Embeddings using Hybrid Markov Logiccited by 2
- 2025Neuro-Symbolic AI for Cybersecurity: State of the Art, Challenges, and Opportunitiescited by 2
- 2022Modular design patterns for neural-symbolic integration: refinement and combinationcited by 1
9 more
- 2024VeriFlow: Modeling Distributions for Neural Network Verificationcited by 1
- 2025A Scalable Approach to Probabilistic Neuro-Symbolic Robustness Verificationcited by 1
- 2026NeuroShield: A Neuro-Symbolic Framework for Adversarial Robustnesscited by 1
- 2026Neuro-Symbolic Artificial Intelligence: A Task-Directed Survey in the Black-Box Models Eracited by 1
- 2024Probabilistic ML Verification via Weighted Model Integrationcited by 0
- 2024Bridging the Gap: Representation Spaces in Neuro-Symbolic AIcited by 0
- 2025The CAISAR Platform: Extending the Reach of Machine Learning Specification and Verificationcited by 0
- 2025Attack logics, not outputs: Towards efficient robustification of deep neural networks by falsifying concept-based propertiescited by 0
- 2026Mining Verdict Boundaries for Neural Network Verificationcited by 0
- 2026Mining Verdict Boundaries for Neural Network Verification31 Jul 2026
- 2026Neuro-Symbolic Artificial Intelligence: A Task-Directed Survey in the Black-Box Models Era3 Mar 2026
- 2026NeuroShield: A Neuro-Symbolic Framework for Adversarial Robustness19 Jan 2026
- 2025Attack logics, not outputs: Towards efficient robustification of deep neural networks by falsifying concept-based properties1 Oct 2025
- 2025Neuro-Symbolic AI for Cybersecurity: State of the Art, Challenges, and Opportunities8 Sep 2025
- 2025The CAISAR Platform: Extending the Reach of Machine Learning Specification and Verification10 Jun 2025
- 2025PICID: Proof-Driven Clause Learning in Neural Network Verification15 Mar 2025
- 2025Shortcuts and Identifiability in Concept-based Models from a Neuro-Symbolic Lens16 Feb 2025
- 2025A Scalable Approach to Probabilistic Neuro-Symbolic Robustness Verification5 Feb 2025
- 2025Neural Network Verification is a Programming Language Challenge10 Jan 2025
- 2024Bridging the Gap: Representation Spaces in Neuro-Symbolic AI7 Nov 2024
- 2024VeriFlow: Modeling Distributions for Neural Network Verification20 Jun 2024
9 more
- 2024A Neuro-Symbolic Benchmark Suite for Concept Quality and Reasoning Shortcuts14 Jun 2024
- 2024BEARS Make Neuro-Symbolic Models Aware of their Reasoning Shortcuts19 Feb 2024
- 2024Probabilistic ML Verification via Weighted Model Integration7 Feb 2024
- 2024Marabou 2.0: A Versatile Formal Analyzer of Neural Networks25 Jan 2024
- 2023On the verification of Embeddings using Hybrid Markov Logic13 Dec 2023
- 2023Value Functions are Control Barrier Functions: Verification of Safe Policies using Control Theory6 Jun 2023
- 2023Not All Neuro-Symbolic Concepts Are Created Equal: Analysis and Mitigation of Reasoning Shortcuts31 May 2023
- 2022Modular design patterns for neural-symbolic integration: refinement and combination9 Jun 2022
- 2022Toward Certified Robustness Against Real-World Distribution Shifts8 Jun 2022
- 2024Marabou 2.0: A Versatile Formal Analyzer of Neural Networkscited by 81
- 2023Not All Neuro-Symbolic Concepts Are Created Equal: Analysis and Mitigation of Reasoning Shortcutscited by 63
- 2024BEARS Make Neuro-Symbolic Models Aware of their Reasoning Shortcutscited by 36
- 2024A Neuro-Symbolic Benchmark Suite for Concept Quality and Reasoning Shortcutscited by 19
- 2022Toward Certified Robustness Against Real-World Distribution Shiftscited by 16
- 2025Shortcuts and Identifiability in Concept-based Models from a Neuro-Symbolic Lenscited by 13
- 2025Neural Network Verification is a Programming Language Challengecited by 12
- 2023Value Functions are Control Barrier Functions: Verification of Safe Policies using Control Theorycited by 5
- 2025PICID: Proof-Driven Clause Learning in Neural Network Verificationcited by 3
- 2023On the verification of Embeddings using Hybrid Markov Logiccited by 2
- 2025Neuro-Symbolic AI for Cybersecurity: State of the Art, Challenges, and Opportunitiescited by 2
- 2022Modular design patterns for neural-symbolic integration: refinement and combinationcited by 1
12 most cited of 20 All 20 (JSON)
- 2026Mining Verdict Boundaries for Neural Network Verification31 Jul 2026
- 2026Neuro-Symbolic Artificial Intelligence: A Task-Directed Survey in the Black-Box Models Era3 Mar 2026
- 2026NeuroShield: A Neuro-Symbolic Framework for Adversarial Robustness19 Jan 2026
- 2025Attack logics, not outputs: Towards efficient robustification of deep neural networks by falsifying concept-based properties1 Oct 2025
- 2025Neuro-Symbolic AI for Cybersecurity: State of the Art, Challenges, and Opportunities8 Sep 2025
- 2025The CAISAR Platform: Extending the Reach of Machine Learning Specification and Verification10 Jun 2025
- 2025PICID: Proof-Driven Clause Learning in Neural Network Verification15 Mar 2025
- 2025Shortcuts and Identifiability in Concept-based Models from a Neuro-Symbolic Lens16 Feb 2025
- 2025Neural Network Verification is a Programming Language Challenge10 Jan 2025
- 2024Bridging the Gap: Representation Spaces in Neuro-Symbolic AI7 Nov 2024
- 2024VeriFlow: Modeling Distributions for Neural Network Verification20 Jun 2024
- 2024A Neuro-Symbolic Benchmark Suite for Concept Quality and Reasoning Shortcuts14 Jun 2024
12 newest of 20 All 20 (JSON)