EPSILON: Adaptive Fault Mitigation in Approximate Deep Neural Network using Statistical Signatures
Not on the map. Why?
Abstract (arXiv)
The increasing adoption of approximate computing in deep neural network accelerators (AxDNNs) promises significant energy efficiency gains. However, permanent faults in AxDNNs can severely degrade their performance compared to their accurate counterparts (AccDNNs). Traditional fault detection and mitigation approaches, while effective for AccDNNs, introduce substantial overhead and latency, making them impractical for energy-constrained real-time deployment. To address this, we introduce EPSILON, a lightweight framework that leverages pre-computed statistical signatures and layer-wise importance metrics for efficient fault detection and mitigation in AxDNNs. Our framework introduces a novel non-parametric pattern-matching algorithm that enables constant-time fault detection without interrupting normal execution while dynamically adapting to different network architectures and fault patterns. EPSILON maintains model accuracy by intelligently adjusting mitigation strategies based on a statistical analysis of weight distribution and layer criticality while preserving the energy benefits of approximate computing. Extensive evaluations across various approximate multipliers, AxDNN architectures, popular datasets (MNIST, CIFAR-10, CIFAR-100, ImageNet-1k), and fault scenarios demonstrate that EPSILON maintains 80.05% accuracy while offering 22% improvement in inference time and 28% improvement in energy efficiency, establishing EPSILON as a practical solution for deploying reliable AxDNNs in safety-critical edge applications.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 16 of its 42 references that are in the map. First posted on arXiv 24 Apr 2025.
Builds on
16 of 42 references.
References · 16
- 2015Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learningcited by 4,416
- 2017What Uncertainties Do We Need in Bayesian Deep Learning for Computer Vision?cited by 2,335
- 2020Energy-based Out-of-distribution Detectioncited by 1,296
- 2017BranchyNet: Fast Inference via Early Exiting from Deep Neural Networkscited by 591
- 2014Deeply-Supervised Netscited by 364
- 2019Depth-Adaptive Transformercited by 227
- 2023EE-LLM: Large-Scale Training and Inference of Early-Exit Large Language Models with 3D Parallelismcited by 69
- 2019ALWANN: Automatic Layer-Wise Approximation of Deep Neural Network Accelerators without Retrainingcited by 28
- 2023A Systematic Literature Review on Hardware Reliability Assessment Methods for Deep Neural Networkscited by 23
- 2021Improving DNN Fault Tolerance using Weight Pruning and Differential Crossbar Mapping for ReRAM-based Edge AIcited by 10
- 2023Adaptive Deep Neural Network Inference Optimization with EENetcited by 9
- 2021Exploring Fault-Energy Trade-offs in Approximate DNN Hardware Acceleratorscited by 6
4 more
- 2023Hierarchical Training of Deep Neural Networks Using Early Exitingcited by 5
- 2023Exposing Reliability Degradation and Mitigation in Approximate DNNs under Permanent Faultscited by 4
- 2024DE3-BERT: Distance-Enhanced Early Exiting for BERT based on Prototypical Networkscited by 3
- 2023eFAT: Improving the Effectiveness of Fault-Aware Training for Mitigating Permanent Faults in DNN Hardware Acceleratorscited by 1
Built on by
Not cited yet.