Feature Distillation Interaction Weighting Network for Lightweight Image Super-Resolution
On the map: Knowledge distillation → General knowledge distillation methods
Abstract (arXiv)
Convolutional neural networks based single-image super-resolution (SISR) has made great progress in recent years. However, it is difficult to apply these methods to real-world scenarios due to the computational and memory cost. Meanwhile, how to take full advantage of the intermediate features under the constraints of limited parameters and calculations is also a huge challenge. To alleviate these issues, we propose a lightweight yet efficient Feature Distillation Interaction Weighted Network (FDIWN). Specifically, FDIWN utilizes a series of specially designed Feature Shuffle Weighted Groups (FSWG) as the backbone, and several novel mutual Wide-residual Distillation Interaction Blocks (WDIB) form an FSWG. In addition, Wide Identical Residual Weighting (WIRW) units and Wide Convolutional Residual Weighting (WCRW) units are introduced into WDIB for better feature distillation. Moreover, a Wide-Residual Distillation Connection (WRDC) framework and a Self-Calibration Fusion (SCF) unit are proposed to interact features with different scales more flexibly and efficiently.Extensive experiments show that our FDIWN is superior to other models to strike a good balance between model performance and efficiency. The code is available at https://github.com/IVIPLab/FDIWN.
Key facts. Cited by 29 papers in the map (data through 14 Oct 2026). Placed in General knowledge distillation methods, one of 12 directions in Knowledge distillation. Builds on 23 of its 39 references that are in the map. First posted on arXiv 16 Dec 2021.
Builds on
23 of 39 references.
References · 23
- 2015Deep Compression: Compressing Deep Neural Networks with Pruning, Trained Quantization and Huffman Codingcited by 2,329
- 2017Enhanced Deep Residual Networks for Single Image Super-Resolutioncited by 1,552
- 2018Image Super-Resolution Using Very Deep Residual Channel Attention Networkscited by 1,264
- 2014Image Super-Resolution Using Deep Convolutional Networkscited by 1,224
- 2015Accurate Image Super-Resolution Using Very Deep Convolutional Networkscited by 903
- 2018Residual Dense Network for Image Super-Resolutioncited by 799
- 2017Deep Laplacian Pyramid Networks for Fast and Accurate Super-Resolutioncited by 453
- 2016Accelerating the Super-Resolution Convolutional Neural Networkcited by 394
- 2015Deeply-Recursive Convolutional Network for Image Super-Resolutioncited by 317
- 2018Fast, Accurate, and Lightweight Super-Resolution with Cascading Residual Networkcited by 264
- 2021Coordinate Attention for Efficient Mobile Network Designcited by 241
- 2019Lightweight Image Super-Resolution with Information Multi-distillation Networkcited by 227
11 more
- 2018Deep Back-Projection Networks For Super-Resolutioncited by 225
- 2020Residual Feature Distillation Network for Lightweight Image Super-Resolutioncited by 122
- 2018Fast and Accurate Single Image Super-Resolution via Information Distillation Networkcited by 121
- 2021LAPAR: Linearly-Assembled Pixel-Adaptive Regression Network for Single Image Super-Resolution and Beyondcited by 88
- 2018Wide Activation for Efficient and Accurate Image Super-Resolutioncited by 65
- 2021SA-Net: Shuffle Attention for Deep Convolutional Neural Networkscited by 54
- 2020Multi-Attention Based Ultra Lightweight Image Super-Resolutioncited by 23
- 2020MDCN: Multi-scale Dense Cross Network for Image Super-Resolutioncited by 19
- 2019Lightweight Image Super-Resolution with Adaptive Weighted Learning Networkcited by 16
- 2019s-LWSR: Super Lightweight Super-Resolution Networkcited by 11
- 2021Lightweight Image Super-Resolution with Multi-scale Feature Interaction Networkcited by 9
Built on by
Citing papers per year: 2022: 6; 2023: 8; 2024: 4; 2025: 8; 2026: 3.
29 papers.
Sort:
By area:
- 2022Residual Local Feature Network for Efficient Super-Resolutioncited by 53
- 2024CAMixerSR: Only Details Need More "Attention"cited by 30
- 2023Swift Parameter-free Attention Network for Efficient Super-Resolutioncited by 24
- 2022Lightweight Bimodal Network for Single-Image Super-Resolution via Symmetric CNN and Recursive Transformercited by 22
- 2022CTCNet: A CNN-Transformer Cooperation Network for Face Image Super-Resolutioncited by 19
- 2022Cross-receptive Focused Inference Network for Lightweight Image Super-Resolutioncited by 16
- 2022Efficient Image Super-Resolution with Feature Interaction Weighted Hybrid Networkcited by 13
- 2024Transforming Image Super-Resolution: A ConvFormer-based Efficient Approachcited by 13
- 2025Real-World Remote Sensing Image Dehazing: Benchmark and Baselinecited by 10
- 2023AsConvSR: Fast and Lightweight Super-Resolution Network with Assembled Convolutionscited by 8
- 2025Dual-domain Modulation Network for Lightweight Image Super-Resolutioncited by 8
- 2023Fully 1×1 Convolutional Network for Lightweight Image Super-Resolutioncited by 6
17 more
- 2026Training-Free Model Ensemble for Single-Image Super-Resolution via Strong-Branch Compensationcited by 6
- 2023Efficient Mixed Transformer for Single Image Super-Resolutioncited by 4
- 2023Toward Real-World Light Field Super-Resolutioncited by 3
- 2025FourierSR: A Fourier Token-based Plugin for Efficient Image Super-Resolutioncited by 3
- 2023Incorporating Transformer Designs into Convolutions for Lightweight Image Super-Resolutioncited by 2
- 2023Scene Structure Guidance Network: Unfolding Graph Partitioning into Pixel-Wise Feature Learningcited by 1
- 2023Image Super-Resolution using Efficient Striped Window Transformercited by 1
- 2024Large coordinate kernel attention network for lightweight image super-resolutioncited by 1
- 2025Deep Learning Empowered Super-Resolution: A Comprehensive Survey and Future Prospectscited by 1
- 2025Transformer-Progressive Mamba Network for Lightweight Image Super-Resolutioncited by 1
- 2022Lightweight Spatial-Channel Adaptive Coordination of Multilevel Refinement Enhancement Network for Image Reconstructioncited by 0
- 2024Attention-Guided Multi-scale Interaction Network for Face Super-Resolutioncited by 0
- 2025RepNet-VSR: Reparameterizable Architecture for High-Fidelity Video Super-Resolutioncited by 0
- 2025DiMoSR: Feature Modulation via Multi-Branch Dilated Convolutions for Efficient Image Super-Resolutioncited by 0
- 2025Efficient Star Distillation Attention Network for Lightweight Image Super-Resolutioncited by 0
- 2026ReconMIL: Synergizing Latent Space Reconstruction with Bi-Stream Mamba for Whole Slide Image Analysiscited by 0
- 2026DPAMixerSR: An Efficient Degradation-Pattern-Aware Model for Image Super-Resolutioncited by 0
- 2026DPAMixerSR: An Efficient Degradation-Pattern-Aware Model for Image Super-Resolution26 Sep 2026
- 2026Training-Free Model Ensemble for Single-Image Super-Resolution via Strong-Branch Compensation13 Apr 2026
- 2026ReconMIL: Synergizing Latent Space Reconstruction with Bi-Stream Mamba for Whole Slide Image Analysis20 Mar 2026
- 2025Transformer-Progressive Mamba Network for Lightweight Image Super-Resolution5 Nov 2025
- 2025Deep Learning Empowered Super-Resolution: A Comprehensive Survey and Future Prospects19 Sep 2025
- 2025Efficient Star Distillation Attention Network for Lightweight Image Super-Resolution14 Jun 2025
- 2025DiMoSR: Feature Modulation via Multi-Branch Dilated Convolutions for Efficient Image Super-Resolution27 May 2025
- 2025RepNet-VSR: Reparameterizable Architecture for High-Fidelity Video Super-Resolution22 Apr 2025
- 2025Real-World Remote Sensing Image Dehazing: Benchmark and Baseline23 Mar 2025
- 2025Dual-domain Modulation Network for Lightweight Image Super-Resolution13 Mar 2025
- 2025FourierSR: A Fourier Token-based Plugin for Efficient Image Super-Resolution13 Mar 2025
- 2024Attention-Guided Multi-scale Interaction Network for Face Super-Resolution1 Sep 2024
17 more
- 2024Large coordinate kernel attention network for lightweight image super-resolution15 May 2024
- 2024CAMixerSR: Only Details Need More "Attention"29 Feb 2024
- 2024Transforming Image Super-Resolution: A ConvFormer-based Efficient Approach11 Jan 2024
- 2023Swift Parameter-free Attention Network for Efficient Super-Resolution21 Nov 2023
- 2023Fully 1×1 Convolutional Network for Lightweight Image Super-Resolution30 Jul 2023
- 2023Toward Real-World Light Field Super-Resolution30 May 2023
- 2023Efficient Mixed Transformer for Single Image Super-Resolution19 May 2023
- 2023AsConvSR: Fast and Lightweight Super-Resolution Network with Assembled Convolutions5 May 2023
- 2023Incorporating Transformer Designs into Convolutions for Lightweight Image Super-Resolution25 Mar 2023
- 2023Image Super-Resolution using Efficient Striped Window Transformer24 Jan 2023
- 2023Scene Structure Guidance Network: Unfolding Graph Partitioning into Pixel-Wise Feature Learning2 Jan 2023
- 2022Efficient Image Super-Resolution with Feature Interaction Weighted Hybrid Network29 Dec 2022
- 2022Lightweight Spatial-Channel Adaptive Coordination of Multilevel Refinement Enhancement Network for Image Reconstruction17 Sep 2022
- 2022Cross-receptive Focused Inference Network for Lightweight Image Super-Resolution6 Jul 2022
- 2022Residual Local Feature Network for Efficient Super-Resolution16 May 2022
- 2022Lightweight Bimodal Network for Single-Image Super-Resolution via Symmetric CNN and Recursive Transformer28 Apr 2022
- 2022CTCNet: A CNN-Transformer Cooperation Network for Face Image Super-Resolution19 Apr 2022
- 2022Residual Local Feature Network for Efficient Super-Resolutioncited by 53
- 2024CAMixerSR: Only Details Need More "Attention"cited by 30
- 2023Swift Parameter-free Attention Network for Efficient Super-Resolutioncited by 24
- 2022Lightweight Bimodal Network for Single-Image Super-Resolution via Symmetric CNN and Recursive Transformercited by 22
- 2022CTCNet: A CNN-Transformer Cooperation Network for Face Image Super-Resolutioncited by 19
- 2022Cross-receptive Focused Inference Network for Lightweight Image Super-Resolutioncited by 16
- 2022Efficient Image Super-Resolution with Feature Interaction Weighted Hybrid Networkcited by 13
- 2024Transforming Image Super-Resolution: A ConvFormer-based Efficient Approachcited by 13
- 2025Real-World Remote Sensing Image Dehazing: Benchmark and Baselinecited by 10
- 2023AsConvSR: Fast and Lightweight Super-Resolution Network with Assembled Convolutionscited by 8
- 2025Dual-domain Modulation Network for Lightweight Image Super-Resolutioncited by 8
- 2023Fully 1×1 Convolutional Network for Lightweight Image Super-Resolutioncited by 6
12 most cited of 27 All 27 (JSON)
- 2026DPAMixerSR: An Efficient Degradation-Pattern-Aware Model for Image Super-Resolution26 Sep 2026
- 2026Training-Free Model Ensemble for Single-Image Super-Resolution via Strong-Branch Compensation13 Apr 2026
- 2025Deep Learning Empowered Super-Resolution: A Comprehensive Survey and Future Prospects19 Sep 2025
- 2025Efficient Star Distillation Attention Network for Lightweight Image Super-Resolution14 Jun 2025
- 2025DiMoSR: Feature Modulation via Multi-Branch Dilated Convolutions for Efficient Image Super-Resolution27 May 2025
- 2025RepNet-VSR: Reparameterizable Architecture for High-Fidelity Video Super-Resolution22 Apr 2025
- 2025Real-World Remote Sensing Image Dehazing: Benchmark and Baseline23 Mar 2025
- 2025Dual-domain Modulation Network for Lightweight Image Super-Resolution13 Mar 2025
- 2025FourierSR: A Fourier Token-based Plugin for Efficient Image Super-Resolution13 Mar 2025
- 2024Attention-Guided Multi-scale Interaction Network for Face Super-Resolution1 Sep 2024
- 2024Large coordinate kernel attention network for lightweight image super-resolution15 May 2024
- 2024CAMixerSR: Only Details Need More "Attention"29 Feb 2024
12 newest of 27 All 27 (JSON)
Similar, not cited
Close in wording, no citation either way
- 2023DDistill-SR: Reparameterized Dynamic Distillation Network for Lightweight Image Super-Resolution
- 2022Feature-domain Adaptive Contrastive Distillation for Efficient Single Image Super-Resolution
- 2021Local-Selective Feature Distillation for Single Image Super-Resolution
- 2024HASN: Hybrid Attention Separable Network for Efficient Image Super-resolution
- 2024DVMSR: Distillated Vision Mamba for Efficient Super-Resolution
- 2022Edge-enhanced Feature Distillation Network for Efficient Super-Resolution
- 2021Towards Compact Single Image Super-Resolution via Contrastive Self-distillation
- 2025Distillation-Supervised Convolutional Low-Rank Adaptation for Efficient Image Super-Resolution