mlsanityData to 14 Oct 2026

Feature Distillation Interaction Weighting Network for Lightweight Image Super-Resolution

arXiv 2112.08655 ↗First posted 16 Dec 2021cs.CV eess.IVcited by 29

On the map: Knowledge distillation → General knowledge distillation methods

Abstract (arXiv)

Convolutional neural networks based single-image super-resolution (SISR) has made great progress in recent years. However, it is difficult to apply these methods to real-world scenarios due to the computational and memory cost. Meanwhile, how to take full advantage of the intermediate features under the constraints of limited parameters and calculations is also a huge challenge. To alleviate these issues, we propose a lightweight yet efficient Feature Distillation Interaction Weighted Network (FDIWN). Specifically, FDIWN utilizes a series of specially designed Feature Shuffle Weighted Groups (FSWG) as the backbone, and several novel mutual Wide-residual Distillation Interaction Blocks (WDIB) form an FSWG. In addition, Wide Identical Residual Weighting (WIRW) units and Wide Convolutional Residual Weighting (WCRW) units are introduced into WDIB for better feature distillation. Moreover, a Wide-Residual Distillation Connection (WRDC) framework and a Self-Calibration Fusion (SCF) unit are proposed to interact features with different scales more flexibly and efficiently.Extensive experiments show that our FDIWN is superior to other models to strike a good balance between model performance and efficiency. The code is available at https://github.com/IVIPLab/FDIWN.

Key facts. Cited by 29 papers in the map (data through 14 Oct 2026). Placed in General knowledge distillation methods, one of 12 directions in Knowledge distillation. Builds on 23 of its 39 references that are in the map. First posted on arXiv 16 Dec 2021.

Builds on

23 of 39 references.

References · 23

  1. 2015Deep Compression: Compressing Deep Neural Networks with Pruning, Trained Quantization and Huffman Codingcited by 2,329
  2. 2017Enhanced Deep Residual Networks for Single Image Super-Resolutioncited by 1,552
  3. 2018Image Super-Resolution Using Very Deep Residual Channel Attention Networkscited by 1,264
  4. 2014Image Super-Resolution Using Deep Convolutional Networkscited by 1,224
  5. 2015Accurate Image Super-Resolution Using Very Deep Convolutional Networkscited by 903
  6. 2018Residual Dense Network for Image Super-Resolutioncited by 799
  7. 2017Deep Laplacian Pyramid Networks for Fast and Accurate Super-Resolutioncited by 453
  8. 2016Accelerating the Super-Resolution Convolutional Neural Networkcited by 394
  9. 2015Deeply-Recursive Convolutional Network for Image Super-Resolutioncited by 317
  10. 2018Fast, Accurate, and Lightweight Super-Resolution with Cascading Residual Networkcited by 264
  11. 2021Coordinate Attention for Efficient Mobile Network Designcited by 241
  12. 2019Lightweight Image Super-Resolution with Information Multi-distillation Networkcited by 227
11 more
  1. 2018Deep Back-Projection Networks For Super-Resolutioncited by 225
  2. 2020Residual Feature Distillation Network for Lightweight Image Super-Resolutioncited by 122
  3. 2018Fast and Accurate Single Image Super-Resolution via Information Distillation Networkcited by 121
  4. 2021LAPAR: Linearly-Assembled Pixel-Adaptive Regression Network for Single Image Super-Resolution and Beyondcited by 88
  5. 2018Wide Activation for Efficient and Accurate Image Super-Resolutioncited by 65
  6. 2021SA-Net: Shuffle Attention for Deep Convolutional Neural Networkscited by 54
  7. 2020Multi-Attention Based Ultra Lightweight Image Super-Resolutioncited by 23
  8. 2020MDCN: Multi-scale Dense Cross Network for Image Super-Resolutioncited by 19
  9. 2019Lightweight Image Super-Resolution with Adaptive Weighted Learning Networkcited by 16
  10. 2019s-LWSR: Super Lightweight Super-Resolution Networkcited by 11
  11. 2021Lightweight Image Super-Resolution with Multi-scale Feature Interaction Networkcited by 9

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2022: 6; 2023: 8; 2024: 4; 2025: 8; 2026: 3.

29 papers.

Sort:

By area:

  1. 2022Residual Local Feature Network for Efficient Super-Resolutioncited by 53
  2. 2024CAMixerSR: Only Details Need More "Attention"cited by 30
  3. 2023Swift Parameter-free Attention Network for Efficient Super-Resolutioncited by 24
  4. 2022Lightweight Bimodal Network for Single-Image Super-Resolution via Symmetric CNN and Recursive Transformercited by 22
  5. 2022CTCNet: A CNN-Transformer Cooperation Network for Face Image Super-Resolutioncited by 19
  6. 2022Cross-receptive Focused Inference Network for Lightweight Image Super-Resolutioncited by 16
  7. 2022Efficient Image Super-Resolution with Feature Interaction Weighted Hybrid Networkcited by 13
  8. 2024Transforming Image Super-Resolution: A ConvFormer-based Efficient Approachcited by 13
  9. 2025Real-World Remote Sensing Image Dehazing: Benchmark and Baselinecited by 10
  10. 2023AsConvSR: Fast and Lightweight Super-Resolution Network with Assembled Convolutionscited by 8
  11. 2025Dual-domain Modulation Network for Lightweight Image Super-Resolutioncited by 8
  12. 2023Fully 1×1 Convolutional Network for Lightweight Image Super-Resolutioncited by 6
17 more
  1. 2026Training-Free Model Ensemble for Single-Image Super-Resolution via Strong-Branch Compensationcited by 6
  2. 2023Efficient Mixed Transformer for Single Image Super-Resolutioncited by 4
  3. 2023Toward Real-World Light Field Super-Resolutioncited by 3
  4. 2025FourierSR: A Fourier Token-based Plugin for Efficient Image Super-Resolutioncited by 3
  5. 2023Incorporating Transformer Designs into Convolutions for Lightweight Image Super-Resolutioncited by 2
  6. 2023Scene Structure Guidance Network: Unfolding Graph Partitioning into Pixel-Wise Feature Learningcited by 1
  7. 2023Image Super-Resolution using Efficient Striped Window Transformercited by 1
  8. 2024Large coordinate kernel attention network for lightweight image super-resolutioncited by 1
  9. 2025Deep Learning Empowered Super-Resolution: A Comprehensive Survey and Future Prospectscited by 1
  10. 2025Transformer-Progressive Mamba Network for Lightweight Image Super-Resolutioncited by 1
  11. 2022Lightweight Spatial-Channel Adaptive Coordination of Multilevel Refinement Enhancement Network for Image Reconstructioncited by 0
  12. 2024Attention-Guided Multi-scale Interaction Network for Face Super-Resolutioncited by 0
  13. 2025RepNet-VSR: Reparameterizable Architecture for High-Fidelity Video Super-Resolutioncited by 0
  14. 2025DiMoSR: Feature Modulation via Multi-Branch Dilated Convolutions for Efficient Image Super-Resolutioncited by 0
  15. 2025Efficient Star Distillation Attention Network for Lightweight Image Super-Resolutioncited by 0
  16. 2026ReconMIL: Synergizing Latent Space Reconstruction with Bi-Stream Mamba for Whole Slide Image Analysiscited by 0
  17. 2026DPAMixerSR: An Efficient Degradation-Pattern-Aware Model for Image Super-Resolutioncited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2023DDistill-SR: Reparameterized Dynamic Distillation Network for Lightweight Image Super-Resolution
  2. 2022Feature-domain Adaptive Contrastive Distillation for Efficient Single Image Super-Resolution
  3. 2021Local-Selective Feature Distillation for Single Image Super-Resolution
  4. 2024HASN: Hybrid Attention Separable Network for Efficient Image Super-resolution
  5. 2024DVMSR: Distillated Vision Mamba for Efficient Super-Resolution
  6. 2022Edge-enhanced Feature Distillation Network for Efficient Super-Resolution
  7. 2021Towards Compact Single Image Super-Resolution via Contrastive Self-distillation
  8. 2025Distillation-Supervised Convolutional Low-Rank Adaptation for Efficient Image Super-Resolution