Real Image Denoising with Knowledge Distillation for High-Performance Mobile NPUs
Not on the map. Why?
Abstract (arXiv)
While deep-learning-based image restoration has achieved unprecedented fidelity, deployment on mobile Neural Processing Units (NPUs) remains bottlenecked by operator incompatibility and memory-access overhead. We propose an NPU-aware hardware-algorithm co-design approach for real-world image denoising on mobile NPUs. Our approach employs a high-capacity teacher to supervise a lightweight student network specifically designed to leverage the tiled-memory architectures of modern mobile SoCs. By prioritizing NPU-native primitives -- standard 3x3 convolutions, ReLU activations, and nearest-neighbor upsampling -- and employing a progressive context expansion strategy (up to 1024x1024 crops), the model achieves 37.66 dB PSNR / 0.9278 SSIM on the validation benchmark and 37.58 dB PSNR / 0.9098 SSIM on the held-out test benchmark at full resolution (2432x3200) in the Mobile AI 2026 challenge. Following the official challenge rules, the inference runtime is measured under a standardized Full HD (1088x1920) protocol, where it runs in 34.0 ms on the MediaTek Dimensity 9500 and 46.1 ms on the Qualcomm Snapdragon 8 Elite NPU. We further reveal an "Inference Inversion" effect, where strict adherence to NPU-compatible operations enables dedicated NPU execution up to 3.88x faster than the integrated mobile GPU. The 1.96M-parameter student recovers 99.8% of the teacher's restoration quality via high-alpha knowledge distillation (alpha = 0.9), achieving a 21.2x parameter reduction while closing the PSNR gap from 1.63 dB to only 0.05 dB. These results establish hardware-aware distillation as an effective strategy for unifying high-fidelity denoising with practical deployment across diverse mobile NPU architectures. The proposed lightweight student model (LiteDenoiseNet) and its training statistics are provided in the NN Dataset, available at https://github.com/ABrain-One/NN-Dataset.
Key facts. Cited by 2 papers in the map (data through 13 Oct 2026). Builds on 22 of its 29 references that are in the map. First posted on arXiv 5 May 2026.
Builds on
22 of 29 references.
References · 22
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,656
- 2015Distilling the Knowledge in a Neural Networkcited by 10,180
- 2021SwinIR: Image Restoration Using Swin Transformercited by 1,876
- 2014FitNets: Hints for Thin Deep Netscited by 1,631
- 2021Restormer: Efficient Transformer for High-Resolution Image Restorationcited by 1,622
- 2016Beyond a Gaussian Denoiser: Residual Learning of Deep CNN for Image Denoisingcited by 1,354
- 2021Uformer: A General U-Shaped Transformer for Image Restorationcited by 865
- 2021Multi-Stage Progressive Image Restorationcited by 813
- 2022Simple Baselines for Image Restorationcited by 703
- 2020Learning Enriched Features for Real Image Restoration and Enhancementcited by 311
- 2018Toward Convolutional Blind Denoising of Real Photographscited by 274
- 2021HINet: Half Instance Normalization Network for Image Restorationcited by 236
10 more
- 2017Benchmarking Denoising Algorithms with Real Photographscited by 209
- 2019Real Image Denoising with Feature Attentioncited by 176
- 2020Practical Deep Raw Image Denoising on Mobile Devicescited by 76
- 2020NTIRE 2020 Challenge on Real Image Denoising: Dataset, Methods and Resultscited by 51
- 2025LEMUR Neural Network Dataset: Towards Seamless AutoMLcited by 20
- 2021Fast Camera Image Denoising on Mobile GPUs with Deep Learning, Mobile AI 2021 Challenge: Reportcited by 15
- 2020Lightweight Modules for Efficient Deep Learning based Image Restorationcited by 6
- 2022Multiple Degradation and Reconstruction Network for Single Image Denoising via Knowledge Distillationcited by 5
- 2022Lightweight network towards real-time image denoising on mobile devicescited by 3
- 2024LIR: A Lightweight Baseline for Image Restorationcited by 1
Built on by
Citing papers per year: 2026: 2.
2 papers.