WARD: Runtime Workload-Adaptive Vision TRansformer Framework for Dependable Edge AI
Not on the map. Why?
Abstract (arXiv)
Edge-deployed AI operate under dynamically changing power budgets, reliability requirements, and input distributions, requiring continuous adaptation. Such conditions arise in long-running edge AI applications, including autonomous systems, industrial monitoring, and satellite onboard intelligence. Existing fault-tolerant methods assume static operating conditions, whereas continual learning techniques neglect concurrent hardware faults during online adaptation. Moreover, the practical deployment of runtime-adaptive reliability frameworks on programmable AI accelerators remains largely unexplored. This paper presents WARD, a runtime-adaptive Vision Transformer framework that combines channel-wise subnetwork partitioning, reliability-aware continual learning, and dynamic operating-mode scheduling to jointly optimize performance, fault tolerance, and adaptation according to runtime conditions. Two physically isolated subnetworks execute under four operating modes (i.e. Full-Precision Mode, Low-Power Mode, High-Reliability Mode, and Adaptive Mode) that dynamically adjust computational cost and reliability while ensuring uninterrupted inference for real-time requirements. To validate the practical deployability of the proposed framework, WARD is implemented on a lightweight FPGA-based accelerator extended with runtime hardware support for mode scheduling and resource management. Experimental results demonstrate that the proposed split architecture achieves a network-level failure rate of only 1.79% under high Bit Error Rates. The hardware implementation incurs less than 5% area overhead and supports runtime mode transitions within few clock cycles, demonstrating that adaptive reliability management can be integrated into programmable edge AI accelerators with negligible implementation overhead.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 16 of its 36 references that are in the map. First posted on arXiv 20 Jul 2026.
Builds on
16 of 36 references.
References · 16
- 2017Attention Is All You Needcited by 60,361
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2016Layer Normalizationcited by 5,669
- 2016Overcoming catastrophic forgetting in neural networkscited by 4,787
- 2016Learning without Forgettingcited by 2,496
- 2016iCaRL: Incremental Classifier and Representation Learningcited by 2,333
- 2017EuroSAT: A Novel Dataset and Deep Learning Benchmark for Land Use and Land Cover Classificationcited by 1,496
- 2023A Comprehensive Survey of Continual Learning: Theory, Method and Applicationcited by 872
- 2021ImageNet-21K Pretraining for the Massescited by 613
- 2017Efficient Processing of Deep Neural Networks: A Tutorial and Surveycited by 434
- 2023Soft Error Reliability Analysis of Vision Transformerscited by 10
- 2023Efficient Model Adaptation for Continual Learning at the Edgecited by 3
4 more
- 2026Safe-NEureka: a Hybrid Modular Redundant DNN Accelerator for On-board Satellite AI Processingcited by 2
- 2024Continual Deep Learning on the Edge via Stochastic Local Competition among Subnetworkscited by 1
- 2026The Anatomy of Silent Data Corruption: GPU Error Pattern Study and Modeling Guidancecited by 1
- 2026SENTRY: Statistical Reliability Analysis of Vision Transformers Under Soft Errorscited by 1
Built on by
Not cited yet.