Towards Verified Artificial Intelligence
Not on the map. Why?
Abstract (arXiv)
Verified artificial intelligence (AI) is the goal of designing AI-based systems that that have strong, ideally provable, assurances of correctness with respect to mathematically-specified requirements. This paper considers Verified AI from a formal methods perspective. We describe five challenges for achieving Verified AI, and five corresponding principles for addressing these challenges.
Key facts. Cited by 36 papers in the map (data through 7 Oct 2026). First posted on arXiv 27 Jun 2016.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 9; 2022: 10; 2023: 8; 2024: 3; 2025: 1; 2026: 5.
36 papers.
Sort:
By area:
- 2021Trustworthy AI: From Principles to Practicescited by 206
- 2024Towards Guaranteed Safe AI: A Framework for Ensuring Robust and Reliable AI Systemscited by 94
- 2023A Survey of Safety and Trustworthiness of Large Language Models through the Lens of Verification and Validationcited by 91
- 2021Software Engineering for AI-Based Systems: A Surveycited by 68
- 2022Logic-Based Explainability in Machine Learningcited by 47
- 2021Categorical Foundations of Gradient-Based Learningcited by 44
- 2023Does Physical Adversarial Example Really Matter to Autonomous Driving? Towards System-Level Effect of Adversarial Object Evasion Attackcited by 37
- 2022A System-Level View on Out-of-Distribution Data in Roboticscited by 33
- 2021Taxonomy of Machine Learning Safety: A Survey and Primercited by 22
- 2023From Robustness to Explainability and Back Againcited by 14
- 2023Disproving XAI Myths with Formal Methods -- Initial Resultscited by 12
- 2022If a Human Can See It, So Should Your System: Reliability Requirements for Machine Vision Componentscited by 11
24 more
- 2022Correct-by-Construction Runtime Enforcement in AI -- A Surveycited by 10
- 2021A Review of Testing Object-Based Environment Perception for Safe Automated Drivingcited by 9
- 2023Design Principles for Lifelong Learning AI Acceleratorscited by 9
- 2021Parallel and Multi-Objective Falsification with Scenic and VerifAIcited by 8
- 2022PAC Verification of Statistical Algorithmscited by 8
- 2021Customizable Reference Runtime Monitoring of Neural Networks using Resolution Boxescited by 6
- 2022Monitoring of Perception Systems: Deterministic, Probabilistic, and Learning-based Fault Detection and Identificationcited by 6
- 2023What, Indeed, is an Achievable Provable Guarantee for Learning-Enabled Safety Critical Systemscited by 6
- 2025Space Explanations of Neural Network Classificationcited by 5
- 2026Skilldex: A Package Manager and Registry for Agent Skill Packages with Hierarchical Scope-Based Distributioncited by 5
- 2021Weighted Graph-Based Signal Temporal Logic Inference Using Neural Networkscited by 4
- 2023Robustness Verification for Knowledge-Based Logic of Risky Driving Scenescited by 3
- 2024Deep Learning with Parametric Lensescited by 3
- 2022Test and Evaluation of Quadrupedal Walking Gaits through Sim2Real Gap Quantificationcited by 1
- 2022Understanding the Impact of Edge Cases from Occluded Pedestrians for ML Systemscited by 1
- 2023Safety of autonomous vehicles: A survey on Model-based vs. AI-based approachescited by 1
- 2026Learning Contextual Runtime Monitors for Safe AI-Based Autonomycited by 1
- 2026Algorithmic Unverifiability of Safety for Fixed and Recursively Self-Improving Systemscited by 1
- 2021Certifiable Artificial Intelligence Through Data Fusioncited by 0
- 2022Safe AI -- How is this Possible?cited by 0
- 2022An Empirical Analysis of the Use of Real-Time Reachability for the Safety Assurance of Autonomous Vehiclescited by 0
- 2024Probabilistic ML Verification via Weighted Model Integrationcited by 0
- 2026Interactions Between Crosscoder Features: A Compact Proofs Perspectivecited by 0
- 2026Neuron Activation-based Computation of Logical Explanations for Deep Neural Networkscited by 0
- 2026Neuron Activation-based Computation of Logical Explanations for Deep Neural Networks12 Sep 2026
- 2026Algorithmic Unverifiability of Safety for Fixed and Recursively Self-Improving Systems26 Jun 2026
- 2026Interactions Between Crosscoder Features: A Compact Proofs Perspective8 Jun 2026
- 2026Skilldex: A Package Manager and Registry for Agent Skill Packages with Hierarchical Scope-Based Distribution18 Apr 2026
- 2026Learning Contextual Runtime Monitors for Safe AI-Based Autonomy28 Jan 2026
- 2025Space Explanations of Neural Network Classification27 Nov 2025
- 2024Towards Guaranteed Safe AI: A Framework for Ensuring Robust and Reliable AI Systems10 May 2024
- 2024Deep Learning with Parametric Lenses30 Mar 2024
- 2024Probabilistic ML Verification via Weighted Model Integration7 Feb 2024
- 2023Robustness Verification for Knowledge-Based Logic of Risky Driving Scenes27 Dec 2023
- 2023Design Principles for Lifelong Learning AI Accelerators5 Oct 2023
- 2023Does Physical Adversarial Example Really Matter to Autonomous Driving? Towards System-Level Effect of Adversarial Object Evasion Attack23 Aug 2023
24 more
- 2023What, Indeed, is an Achievable Provable Guarantee for Learning-Enabled Safety Critical Systems20 Jul 2023
- 2023From Robustness to Explainability and Back Again5 Jun 2023
- 2023Safety of autonomous vehicles: A survey on Model-based vs. AI-based approaches29 May 2023
- 2023A Survey of Safety and Trustworthiness of Large Language Models through the Lens of Verification and Validation19 May 2023
- 2023Disproving XAI Myths with Formal Methods -- Initial Results13 May 2023
- 2022A System-Level View on Out-of-Distribution Data in Robotics28 Dec 2022
- 2022PAC Verification of Statistical Algorithms28 Nov 2022
- 2022Logic-Based Explainability in Machine Learning24 Oct 2022
- 2022Correct-by-Construction Runtime Enforcement in AI -- A Survey30 Aug 2022
- 2022Monitoring of Perception Systems: Deterministic, Probabilistic, and Learning-based Fault Detection and Identification22 May 2022
- 2022An Empirical Analysis of the Use of Real-Time Reachability for the Safety Assurance of Autonomous Vehicles3 May 2022
- 2022Understanding the Impact of Edge Cases from Occluded Pedestrians for ML Systems26 Apr 2022
- 2022If a Human Can See It, So Should Your System: Reliability Requirements for Machine Vision Components8 Feb 2022
- 2022Safe AI -- How is this Possible?25 Jan 2022
- 2022Test and Evaluation of Quadrupedal Walking Gaits through Sim2Real Gap Quantification4 Jan 2022
- 2021Certifiable Artificial Intelligence Through Data Fusion3 Nov 2021
- 2021Trustworthy AI: From Principles to Practices4 Oct 2021
- 2021Weighted Graph-Based Signal Temporal Logic Inference Using Neural Networks16 Sep 2021
- 2021Parallel and Multi-Objective Falsification with Scenic and VerifAI9 Jul 2021
- 2021Taxonomy of Machine Learning Safety: A Survey and Primer9 Jun 2021
- 2021Software Engineering for AI-Based Systems: A Survey5 May 2021
- 2021Customizable Reference Runtime Monitoring of Neural Networks using Resolution Boxes25 Apr 2021
- 2021Categorical Foundations of Gradient-Based Learning2 Mar 2021
- 2021A Review of Testing Object-Based Environment Perception for Safe Automated Driving16 Feb 2021
- 2021Trustworthy AI: From Principles to Practicescited by 206
- 2023A Survey of Safety and Trustworthiness of Large Language Models through the Lens of Verification and Validationcited by 91
- 2021Software Engineering for AI-Based Systems: A Surveycited by 68
- 2022Logic-Based Explainability in Machine Learningcited by 47
- 2021Categorical Foundations of Gradient-Based Learningcited by 44
- 2023Does Physical Adversarial Example Really Matter to Autonomous Driving? Towards System-Level Effect of Adversarial Object Evasion Attackcited by 37
- 2022A System-Level View on Out-of-Distribution Data in Roboticscited by 33
- 2021Taxonomy of Machine Learning Safety: A Survey and Primercited by 22
- 2023From Robustness to Explainability and Back Againcited by 14
- 2023Disproving XAI Myths with Formal Methods -- Initial Resultscited by 12
- 2022If a Human Can See It, So Should Your System: Reliability Requirements for Machine Vision Componentscited by 11
- 2022Correct-by-Construction Runtime Enforcement in AI -- A Surveycited by 10
12 most cited of 34 All 34 (JSON)
- 2026Neuron Activation-based Computation of Logical Explanations for Deep Neural Networks12 Sep 2026
- 2026Algorithmic Unverifiability of Safety for Fixed and Recursively Self-Improving Systems26 Jun 2026
- 2026Interactions Between Crosscoder Features: A Compact Proofs Perspective8 Jun 2026
- 2026Learning Contextual Runtime Monitors for Safe AI-Based Autonomy28 Jan 2026
- 2025Space Explanations of Neural Network Classification27 Nov 2025
- 2024Deep Learning with Parametric Lenses30 Mar 2024
- 2024Probabilistic ML Verification via Weighted Model Integration7 Feb 2024
- 2023Robustness Verification for Knowledge-Based Logic of Risky Driving Scenes27 Dec 2023
- 2023Design Principles for Lifelong Learning AI Accelerators5 Oct 2023
- 2023Does Physical Adversarial Example Really Matter to Autonomous Driving? Towards System-Level Effect of Adversarial Object Evasion Attack23 Aug 2023
- 2023What, Indeed, is an Achievable Provable Guarantee for Learning-Enabled Safety Critical Systems20 Jul 2023
- 2023From Robustness to Explainability and Back Again5 Jun 2023
12 newest of 34 All 34 (JSON)