ReRAM-aware Model Finetuning addressing I-V Non-linearity and Retention Errors
Not on the map. Why?
Abstract (arXiv)
Traditional CPU, GPU, and NPU architectures are increasingly limited by the von Neumann bottleneck. While In-Memory Computing (IMC) using ReRAM crossbar arrays offers a high-density, energy-efficient alternative, its practical deployment is constrained through their non-idealities. Existing hardware-aware training frameworks often require training from scratch, which is computationally prohibitive for modern large-scale models. In this work, we propose a finetuning-based hardware-aware training algorithm that enables robust DNN deployment on ReRAM with minimal training overhead. Our approach mitigates I-V non-linearity by applying a range-shrunk sinh transformation and incorporates retention errors directly into a regularization loss during the finetuning process. We evaluate our framework across models and tasks such as image classification and question-answering (QA). Experimental results demonstrate that our method achieves similar accuracy on large-scale models like ResNet18 and DeiT-Tiny as the base model. In-case of ImageNet for MobileNetV3 families the technique has only less than 2% accuracy degradation. Further, applying the technique on the SQuAD v2 dataset results in only 1 point degradation of F-1 score.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 9 of its 51 references that are in the map. First posted on arXiv 16 Jun 2026.
Builds on
9 of 51 references.
References · 9
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2020Training data-efficient image transformers & distillation through attentioncited by 4,586
- 2019Searching for MobileNetV3cited by 1,994
- 2018Know What You Don't Know: Unanswerable Questions for SQuADcited by 1,554
- 2019TinyBERT: Distilling BERT for Natural Language Understandingcited by 1,167
- 2020MobileBERT: a Compact Task-Agnostic BERT for Resource-Limited Devicescited by 482
- 2019MLPerf Inference Benchmarkcited by 199
- 2023Hardware-aware training for large-scale and diverse deep learning inference workloads using in-memory computing-based acceleratorscited by 43
- 2023CRAFT: Criticality-Aware Fault-Tolerance Enhancement Techniques for Emerging Memories-Based Deep Neural Networkscited by 2
Built on by
Not cited yet.