Towards a Safety Case for Hardware Fault Tolerance in Convolutional Neural Networks Using Activation Range Supervision
Not on the map. Why?
Abstract (arXiv)
Convolutional neural networks (CNNs) have become an established part of numerous safety-critical computer vision applications, including human robot interactions and automated driving. Real-world implementations will need to guarantee their robustness against hardware soft errors corrupting the underlying platform memory. Based on the previously observed efficacy of activation clipping techniques, we build a prototypical safety case for classifier CNNs by demonstrating that range supervision represents a highly reliable fault detector and mitigator with respect to relevant bit flips, adopting an eight-exponent floating point data representation. We further explore novel, non-uniform range restriction methods that effectively suppress the probability of silent data corruptions and uncorrectable errors. As a safety-relevant end-to-end use case, we showcase the benefit of our approach in a vehicle classification scenario, using ResNet-50 and the traffic camera data set MIOVision. The quantitative evidence provided in this work can be leveraged to inspire further and possibly more complex CNN safety arguments.
Key facts. Cited by 7 papers in the map (data through 7 Oct 2026). Builds on 9 of its 33 references that are in the map. First posted on arXiv 16 Aug 2021.
Builds on
9 of 33 references.
References · 9
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
- 2019Terminal Brain Damage: Exposing the Graceless Degradation in Deep Neural Networks Under Hardware Fault Attackscited by 55
- 2019FT-ClipAct: Resilience Analysis of Deep Neural Networks and Improving their Fault Tolerance using Clipped Activationcited by 31
- 2021Silent Data Corruptions at Scalecited by 22
- 2020FT-CNN: Algorithm-Based Fault Tolerance for Convolutional Neural Networkscited by 21
- 2020HarDNN: Feature Map Vulnerability Evaluation in CNNscited by 16
- 2020A Low-cost Fault Corrector for Deep Neural Networks through Range Restrictioncited by 5
- 2020MILR: Mathematically Induced Layer Recovery for Plaintext Space Error Correction of CNNscited by 3
Built on by
Citing papers per year: 2022: 1; 2023: 3; 2024: 2; 2025: 0; 2026: 1.
7 papers.
- 2022Hardware faults that matter: Understanding and Estimating the safety impact of hardware faults on object detection DNNscited by 7
- 2023A Low-cost Strategic Monitoring Approach for Scalable and Interpretable Error Detection in Deep Neural Networkscited by 6
- 2024Hybrid Convolutional Neural Networks with Reliability Guaranteecited by 2
- 2023Large-Scale Application of Fault Injection into PyTorch Models -- an Extension to PyTorchFI for Validation Efficiencycited by 1
- 2023Hardware Resilience Properties of Text-Guided Image Classifierscited by 1
- 2024Global Clipper: Enhancing Safety and Reliability of Transformer-based Object Detection Modelscited by 1
- 2026TERMon: Detecting Persistent Behavioral Threats in Edge AI via Hardware-Native Ternary Runtime Monitorcited by 0
- 2026TERMon: Detecting Persistent Behavioral Threats in Edge AI via Hardware-Native Ternary Runtime Monitor18 Sep 2026
- 2024Global Clipper: Enhancing Safety and Reliability of Transformer-based Object Detection Models5 Jun 2024
- 2024Hybrid Convolutional Neural Networks with Reliability Guarantee8 May 2024
- 2023Hardware Resilience Properties of Text-Guided Image Classifiers23 Nov 2023
- 2023A Low-cost Strategic Monitoring Approach for Scalable and Interpretable Error Detection in Deep Neural Networks31 Oct 2023
- 2023Large-Scale Application of Fault Injection into PyTorch Models -- an Extension to PyTorchFI for Validation Efficiency30 Oct 2023
- 2022Hardware faults that matter: Understanding and Estimating the safety impact of hardware faults on object detection DNNs7 Sep 2022