Certification of embedded systems based on Machine Learning: A survey
Not on the map. Why?
Abstract (arXiv)
Advances in machine learning (ML) open the way to innovating functions in the avionic domain, such as navigation/surveillance assistance (e.g. vision-based navigation, obstacle sensing, virtual sensing), speechto-text applications, autonomous flight, predictive maintenance or cockpit assistance. Current certification standards and practices, which were defined and refined decades over decades with classical programming in mind, do not however support this new development paradigm. This article provides an overview of the main challenges raised by the use ML in the demonstration of compliance with regulation requirements, and a survey of literature relevant to these challenges, with particular focus on the issues of robustness and explainability of ML results.
Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Builds on 42 of its 69 references that are in the map. First posted on arXiv 14 Jun 2021.
Builds on
42 of 69 references.
References · 42
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2014Explaining and Harnessing Adversarial Examplescited by 7,287
- 2017A Unified Approach to Interpreting Model Predictionscited by 6,488
- 2017Towards Deep Learning Models Resistant to Adversarial Attackscited by 6,326
- 2013Intriguing properties of neural networkscited by 5,114
- 2016"Why Should I Trust You?": Explaining the Predictions of Any Classifiercited by 5,040
- 2015You Only Look Once: Unified, Real-Time Object Detectioncited by 4,829
- 2014Neural Machine Translation by Jointly Learning to Align and Translatecited by 4,530
- 2016Towards Evaluating the Robustness of Neural Networkscited by 2,976
- 2017What Uncertainties Do We Need in Bayesian Deep Learning for Computer Vision?cited by 2,335
- 2013Visualizing and Understanding Convolutional Networkscited by 2,278
- 2016Adversarial examples in the physical worldcited by 1,762
30 more
- 2017Understanding Black-box Predictions via Influence Functionscited by 1,714
- 2017Learning Important Features Through Propagating Activation Differencescited by 1,454
- 2015DeepFool: a simple and accurate method to fool deep neural networkscited by 1,315
- 2018Sanity Checks for Saliency Mapscited by 1,149
- 2016Adversarial Machine Learning at Scalecited by 934
- 2015The Limitations of Deep Learning in Adversarial Settingscited by 784
- 2017Reluplex: An Efficient SMT Solver for Verifying Deep Neural Networkscited by 739
- 2017ZOO: Zeroth Order Optimization based Black-box Attacks to Deep Neural Networks without Training Substitute Modelscited by 656
- 2017Interpretable Explanations of Black Boxes by Meaningful Perturbationcited by 611
- 2019On Evaluating Adversarial Robustnesscited by 442
- 2017Wild Patterns: Ten Years After the Rise of Adversarial Machine Learningcited by 411
- 2017Parseval Networks: Improving Robustness to Adversarial Examplescited by 288
- 2016Safety Verification of Deep Neural Networkscited by 262
- 2017Real Time Image Saliency for Black Box Classifierscited by 246
- 2018Deep k-Nearest Neighbors: Towards Confident, Interpretable and Robust Deep Learningcited by 203
- 2018Lipschitz-Margin Training: Scalable Certification of Perturbation Invariance for Deep Neural Networkscited by 193
- 2018Formal Security Analysis of Neural Networks using Symbolic Intervalscited by 185
- 2019You Only Propagate Once: Accelerating Adversarial Training via Maximal Principlecited by 181
- 2018Local Rule-Based Explanations of Black Box Decision Systemscited by 165
- 2016Generating Visual Explanationscited by 156
- 2019Enhancing Adversarial Example Transferability with an Intermediate Level Attackcited by 139
- 2019A Convex Relaxation Barrier to Tight Robustness Verification of Neural Networkscited by 124
- 2019Adversarial Examples Are a Natural Consequence of Test Error in Noisecited by 114
- 2020Explaining the Explainer: A First Theoretical Analysis of LIMEcited by 89
- 2017Efficient Defenses Against Adversarial Attackscited by 53
- 2020Towards CRISP-ML(Q): A Machine Learning Process Model with Quality Assurance Methodologycited by 41
- 2019Assuring the Machine Learning Lifecycle: Desiderata, Methods, and Challengescited by 39
- 2020Practical No-box Adversarial Attacks against DNNscited by 32
- 2019On the Hardness of Robust Classificationcited by 23
- 2020Ensuring Dataset Quality for Machine Learning Certificationcited by 7
Built on by
Citing papers per year: 2021: 3; 2022: 2; 2023: 1.
6 papers.
- 2021How to Certify Machine Learning Based Safety-critical Systems? A Systematic Literature Reviewcited by 36
- 2021RoMA: a Method for Neural Network Robustness Measurement and Assessmentcited by 10
- 2022On the Robustness of Explanations of Deep Neural Network Models: A Surveycited by 5
- 2021Agility in Software 2.0 -- Notebook Interfaces and MLOps with Buttresses and Rebarscited by 4
- 2022Exploring ML testing in practice -- Lessons learned from an interactive rapid review with Axis Communicationscited by 3
- 2023Rethinking Certification for Trustworthy Machine Learning-Based Applicationscited by 2
- 2023Rethinking Certification for Trustworthy Machine Learning-Based Applications26 May 2023
- 2022On the Robustness of Explanations of Deep Neural Network Models: A Survey9 Nov 2022
- 2022Exploring ML testing in practice -- Lessons learned from an interactive rapid review with Axis Communications30 Mar 2022
- 2021Agility in Software 2.0 -- Notebook Interfaces and MLOps with Buttresses and Rebars28 Nov 2021
- 2021RoMA: a Method for Neural Network Robustness Measurement and Assessment21 Oct 2021
- 2021How to Certify Machine Learning Based Safety-critical Systems? A Systematic Literature Review26 Jul 2021