mlsanityData to 7 Oct 2026

Attention-Guided Multi-scale Interaction Network for Face Super-Resolution

arXiv 2409.00591 ↗First posted 1 Sep 2024cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Recently, CNN and Transformer hybrid networks demonstrated excellent performance in face super-resolution (FSR) tasks. Since numerous features at different scales in hybrid networks, how to fuse these multiscale features and promote their complementarity is crucial for enhancing FSR. However, existing hybrid network-based FSR methods ignore this, only simply combining the Transformer and CNN. To address this issue, we propose an attention-guided Multiscale interaction network (AMINet), which incorporates local and global feature interactions, as well as encoder-decoder phase feature interactions. Specifically, we propose a Local and Global Feature Interaction Module (LGFI) to promote the fusion of global features and the local features extracted from different receptive fields by our Residual Depth Feature Extraction Module (RDFE). Additionally, we propose a Selective Kernel Attention Fusion Module (SKAF) to adaptively select fusions of different features within the LGFI and encoder-decoder phases. Our above design allows the free flow of multiscale features from within modules and between the encoder and decoder, which can promote the complementarity of different scale features to enhance FSR. Comprehensive experiments confirm that our method consistently performs well with less computational consumption and faster inference.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 30 of its 58 references that are in the map. First posted on arXiv 1 Sep 2024.

Builds on

30 of 58 references.

References · 30

  1. 2017Attention Is All You Needcited by 59,932
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  3. 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
  4. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  5. 2014Deep Learning Face Attributes in the Wildcited by 3,679
  6. 2016Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Networkcited by 1,898
  7. 2021SwinIR: Image Restoration Using Swin Transformercited by 1,869
  8. 2021Restormer: Efficient Transformer for High-Resolution Image Restorationcited by 1,618
  9. 2018Image Super-Resolution Using Very Deep Residual Channel Attention Networkscited by 1,256
  10. 2018ESRGAN: Enhanced Super-Resolution Generative Adversarial Networkscited by 1,250
  11. 2019Selective Kernel Networkscited by 401
  12. 2020Single Image Super-Resolution via a Holistic Attention Networkcited by 265
18 more
  1. 2017FSRNet: End-to-End Learning Face Super-Resolution with Facial Priorscited by 170
  2. 2023Large Selective Kernel Network for Remote Sensing Object Detectioncited by 98
  3. 2019Progressive Face Super-Resolution via Attention to Facial Landmarkcited by 73
  4. 2020Learning Spatial Attention for Face Super-Resolutioncited by 55
  5. 2020Deep Face Super-Resolution with Iterative Collaboration between Attentive Recovery and Landmark Estimationcited by 53
  6. 2020Face Super-Resolution Guided by 3D Facial Priorscited by 38
  7. 2021Feature Distillation Interaction Weighting Network for Lightweight Image Super-Resolutioncited by 29
  8. 2022Multi-scale Attention Network for Single Image Super-Resolutioncited by 29
  9. 2020Face Hallucination via Split-Attention in Split-Attention Networkcited by 24
  10. 2022Lightweight Bimodal Network for Single-Image Super-Resolution via Symmetric CNN and Recursive Transformercited by 22
  11. 2015When Face Recognition Meets with Deep Learning: an Evaluation of Convolutional Neural Networks for Face Recognitioncited by 20
  12. 2021A Systematic Survey of Deep Learning-based Single-Image Super-Resolutioncited by 19
  13. 2022CTCNet: A CNN-Transformer Cooperation Network for Face Image Super-Resolutioncited by 19
  14. 2023Survey on Deep Face Restoration: From Non-blind to Blind and Beyondcited by 18
  15. 2024Efficient Face Super-Resolution via Wavelet-based Feature Enhancement Networkcited by 18
  16. 2022Cross-receptive Focused Inference Network for Lightweight Image Super-Resolutioncited by 16
  17. 2020Facial Attribute Capsules for Noise Face Super Resolutioncited by 13
  18. 2022Efficient Image Super-Resolution with Feature Interaction Weighted Hybrid Networkcited by 13

Built on by

Not cited yet.