mlsanityData to 14 Oct 2026

ReRAM-aware Model Finetuning addressing I-V Non-linearity and Retention Errors

arXiv 2606.17471 ↗First posted 16 Jun 2026cs.LG cs.SY eess.SYcited by 0

Not on the map. Why?

Abstract (arXiv)

Traditional CPU, GPU, and NPU architectures are increasingly limited by the von Neumann bottleneck. While In-Memory Computing (IMC) using ReRAM crossbar arrays offers a high-density, energy-efficient alternative, its practical deployment is constrained through their non-idealities. Existing hardware-aware training frameworks often require training from scratch, which is computationally prohibitive for modern large-scale models. In this work, we propose a finetuning-based hardware-aware training algorithm that enables robust DNN deployment on ReRAM with minimal training overhead. Our approach mitigates I-V non-linearity by applying a range-shrunk sinh transformation and incorporates retention errors directly into a regularization loss during the finetuning process. We evaluate our framework across models and tasks such as image classification and question-answering (QA). Experimental results demonstrate that our method achieves similar accuracy on large-scale models like ResNet18 and DeiT-Tiny as the base model. In-case of ImageNet for MobileNetV3 families the technique has only less than 2% accuracy degradation. Further, applying the technique on the SQuAD v2 dataset results in only 1 point degradation of F-1 score.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 9 of its 51 references that are in the map. First posted on arXiv 16 Jun 2026.

Builds on

9 of 51 references.

References · 9

  1. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  2. 2020Training data-efficient image transformers & distillation through attentioncited by 4,586
  3. 2019Searching for MobileNetV3cited by 1,994
  4. 2018Know What You Don't Know: Unanswerable Questions for SQuADcited by 1,554
  5. 2019TinyBERT: Distilling BERT for Natural Language Understandingcited by 1,167
  6. 2020MobileBERT: a Compact Task-Agnostic BERT for Resource-Limited Devicescited by 482
  7. 2019MLPerf Inference Benchmarkcited by 199
  8. 2023Hardware-aware training for large-scale and diverse deep learning inference workloads using in-memory computing-based acceleratorscited by 43
  9. 2023CRAFT: Criticality-Aware Fault-Tolerance Enhancement Techniques for Emerging Memories-Based Deep Neural Networkscited by 2

Built on by

Not cited yet.