mlsanityData to 13 Oct 2026

Real Image Denoising with Knowledge Distillation for High-Performance Mobile NPUs

arXiv 2605.03680 ↗First posted 5 May 2026cs.CV cs.LGcited by 2

Not on the map. Why?

Abstract (arXiv)

While deep-learning-based image restoration has achieved unprecedented fidelity, deployment on mobile Neural Processing Units (NPUs) remains bottlenecked by operator incompatibility and memory-access overhead. We propose an NPU-aware hardware-algorithm co-design approach for real-world image denoising on mobile NPUs. Our approach employs a high-capacity teacher to supervise a lightweight student network specifically designed to leverage the tiled-memory architectures of modern mobile SoCs. By prioritizing NPU-native primitives -- standard 3x3 convolutions, ReLU activations, and nearest-neighbor upsampling -- and employing a progressive context expansion strategy (up to 1024x1024 crops), the model achieves 37.66 dB PSNR / 0.9278 SSIM on the validation benchmark and 37.58 dB PSNR / 0.9098 SSIM on the held-out test benchmark at full resolution (2432x3200) in the Mobile AI 2026 challenge. Following the official challenge rules, the inference runtime is measured under a standardized Full HD (1088x1920) protocol, where it runs in 34.0 ms on the MediaTek Dimensity 9500 and 46.1 ms on the Qualcomm Snapdragon 8 Elite NPU. We further reveal an "Inference Inversion" effect, where strict adherence to NPU-compatible operations enables dedicated NPU execution up to 3.88x faster than the integrated mobile GPU. The 1.96M-parameter student recovers 99.8% of the teacher's restoration quality via high-alpha knowledge distillation (alpha = 0.9), achieving a 21.2x parameter reduction while closing the PSNR gap from 1.63 dB to only 0.05 dB. These results establish hardware-aware distillation as an effective strategy for unifying high-fidelity denoising with practical deployment across diverse mobile NPU architectures. The proposed lightweight student model (LiteDenoiseNet) and its training statistics are provided in the NN Dataset, available at https://github.com/ABrain-One/NN-Dataset.

Key facts. Cited by 2 papers in the map (data through 13 Oct 2026). Builds on 22 of its 29 references that are in the map. First posted on arXiv 5 May 2026.

Builds on

22 of 29 references.

References · 22

  1. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,656
  2. 2015Distilling the Knowledge in a Neural Networkcited by 10,180
  3. 2021SwinIR: Image Restoration Using Swin Transformercited by 1,876
  4. 2014FitNets: Hints for Thin Deep Netscited by 1,631
  5. 2021Restormer: Efficient Transformer for High-Resolution Image Restorationcited by 1,622
  6. 2016Beyond a Gaussian Denoiser: Residual Learning of Deep CNN for Image Denoisingcited by 1,354
  7. 2021Uformer: A General U-Shaped Transformer for Image Restorationcited by 865
  8. 2021Multi-Stage Progressive Image Restorationcited by 813
  9. 2022Simple Baselines for Image Restorationcited by 703
  10. 2020Learning Enriched Features for Real Image Restoration and Enhancementcited by 311
  11. 2018Toward Convolutional Blind Denoising of Real Photographscited by 274
  12. 2021HINet: Half Instance Normalization Network for Image Restorationcited by 236
10 more
  1. 2017Benchmarking Denoising Algorithms with Real Photographscited by 209
  2. 2019Real Image Denoising with Feature Attentioncited by 176
  3. 2020Practical Deep Raw Image Denoising on Mobile Devicescited by 76
  4. 2020NTIRE 2020 Challenge on Real Image Denoising: Dataset, Methods and Resultscited by 51
  5. 2025LEMUR Neural Network Dataset: Towards Seamless AutoMLcited by 20
  6. 2021Fast Camera Image Denoising on Mobile GPUs with Deep Learning, Mobile AI 2021 Challenge: Reportcited by 15
  7. 2020Lightweight Modules for Efficient Deep Learning based Image Restorationcited by 6
  8. 2022Multiple Degradation and Reconstruction Network for Single Image Denoising via Knowledge Distillationcited by 5
  9. 2022Lightweight network towards real-time image denoising on mobile devicescited by 3
  10. 2024LIR: A Lightweight Baseline for Image Restorationcited by 1

Built on by

Cited by year (2026 to 13 Oct)

Citing papers per year: 2026: 2.

2 papers.