Dual Adversarial Adaptation for Cross-Device Real-World Image Super-Resolution
Not on the map. Why?
Abstract (arXiv)
Due to the sophisticated imaging process, an identical scene captured by different cameras could exhibit distinct imaging patterns, introducing distinct proficiency among the super-resolution (SR) models trained on images from different devices. In this paper, we investigate a novel and practical task coded cross-device SR, which strives to adapt a real-world SR model trained on the paired images captured by one camera to low-resolution (LR) images captured by arbitrary target devices. The proposed task is highly challenging due to the absence of paired data from various imaging devices. To address this issue, we propose an unsupervised domain adaptation mechanism for real-world SR, named Dual ADversarial Adaptation (DADA), which only requires LR images in the target domain with available real paired data from a source camera. DADA employs the Domain-Invariant Attention (DIA) module to establish the basis of target model training even without HR supervision. Furthermore, the dual framework of DADA facilitates an Inter-domain Adversarial Adaptation (InterAA) in one branch for two LR input images from two domains, and an Intra-domain Adversarial Adaptation (IntraAA) in two branches for an LR input image. InterAA and IntraAA together improve the model transferability from the source domain to the target. We empirically conduct experiments under six Real to Real adaptation settings among three different cameras, and achieve superior performance compared with existing state-of-the-art approaches. We also evaluate the proposed DADA to address the adaptation to the video camera, which presents a promising research topic to promote the wide applications of real-world super-resolution. Our source code is publicly available at https://github.com/lonelyhope/DADA.git.
Key facts. Cited by 10 papers in the map (data through 7 Oct 2026). Builds on 20 of its 26 references that are in the map. First posted on arXiv 7 May 2022.
Builds on
20 of 26 references.
References · 20
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 2015Domain-Adversarial Training of Neural Networkscited by 3,023
- 2016Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Networkcited by 1,898
- 2017Enhanced Deep Residual Networks for Single Image Super-Resolutioncited by 1,543
- 2018Image Super-Resolution Using Very Deep Residual Channel Attention Networkscited by 1,256
- 2018ESRGAN: Enhanced Super-Resolution Generative Adversarial Networkscited by 1,250
- 2016Real-Time Single Image and Video Super-Resolution Using an Efficient Sub-Pixel Convolutional Neural Networkcited by 1,199
- 2017Unpaired Image-to-Image Translation using Cycle-Consistent Adversarial Networkscited by 707
- 2017Maximum Classifier Discrepancy for Unsupervised Domain Adaptationcited by 682
- 2018Learning to Adapt Structured Output Space for Semantic Segmentationcited by 584
- 2018Domain Adaptive Faster R-CNN for Object Detection in the Wildcited by 442
8 more
- 2019Toward Real-World Single Image Super-Resolution: A New Benchmark and A New Modelcited by 400
- 2018Taking A Closer Look at Domain Shift: Category-level Adversaries for Semantics Consistent Domain Adaptationcited by 295
- 2020Deep Unfolding Network for Image Super-Resolutioncited by 253
- 2020Component Divide-and-Conquer for Real-World Image Super-Resolutioncited by 243
- 2018Unsupervised Image Super-Resolution using Cycle-in-Cycle Generative Adversarial Networkscited by 133
- 2020Closed-loop Matters: Dual Regression Networks for Single Image Super-Resolutioncited by 90
- 2020Unsupervised Real-world Image Super Resolution via Domain-distance Aware Trainingcited by 83
- 2020Contextual-Relation Consistent Domain Adaptation for Semantic Segmentationcited by 70
Built on by
Citing papers per year: 2022: 1; 2023: 3; 2024: 6.
10 papers.
- 2023Diffusion Models for Image Restoration and Enhancement: A Comprehensive Surveycited by 108
- 2024DreamClear: High-Capacity Real-World Image Restoration with Privacy-Safe Dataset Curationcited by 64
- 2024Efficient Real-world Image Super-Resolution Via Adaptive Directional Gradient Convolutioncited by 36
- 2024SeD: Semantic-Aware Discriminator for Image Super-Resolutioncited by 26
- 2023Uncertainty-Aware Source-Free Adaptive Image Super-Resolution with Wavelet Augmentation Transformercited by 6
- 2024MEIA: Multimodal Embodied Perception and Interaction in Unknown Environmentscited by 4
- 2024OmniLens: Towards Universal Lens Aberration Correction via LensLib-to-Specific Domain Adaptationcited by 4
- 2023SuperInpaint: Learning Detail-Enhanced Attentional Implicit Representation for Super-resolutional Image Inpaintingcited by 3
- 2022Rethinking Blur Synthesis for Deep Real-World Image Deblurringcited by 1
- 2024Adaptive Multi-modal Fusion of Spatially Variant Kernel Refinement with Diffusion Model for Blind Image Super-Resolutioncited by 1
- 2024DreamClear: High-Capacity Real-World Image Restoration with Privacy-Safe Dataset Curation24 Oct 2024
- 2024OmniLens: Towards Universal Lens Aberration Correction via LensLib-to-Specific Domain Adaptation9 Sep 2024
- 2024Efficient Real-world Image Super-Resolution Via Adaptive Directional Gradient Convolution11 May 2024
- 2024Adaptive Multi-modal Fusion of Spatially Variant Kernel Refinement with Diffusion Model for Blind Image Super-Resolution9 Mar 2024
- 2024SeD: Semantic-Aware Discriminator for Image Super-Resolution29 Feb 2024
- 2024MEIA: Multimodal Embodied Perception and Interaction in Unknown Environments1 Feb 2024
- 2023Diffusion Models for Image Restoration and Enhancement: A Comprehensive Survey18 Aug 2023
- 2023SuperInpaint: Learning Detail-Enhanced Attentional Implicit Representation for Super-resolutional Image Inpainting26 Jul 2023
- 2023Uncertainty-Aware Source-Free Adaptive Image Super-Resolution with Wavelet Augmentation Transformer31 Mar 2023
- 2022Rethinking Blur Synthesis for Deep Real-World Image Deblurring28 Sep 2022