# Mutual Learning for Domain Adaptation: Self-distillation Image Dehazing Network with Sample-cycle

arXiv: https://arxiv.org/abs/2203.09430 · HTML: https://mlsanity.com/paper/2203.09430/

## Key facts

- Cited by 4 papers in the map (data through 14 Oct 2026).
- Placed in General knowledge distillation methods, one of 12 directions in Knowledge distillation.
- Builds on 13 of its 30 references that are in the map.
- First posted on arXiv 17 Mar 2022.

## Placed in

- Knowledge distillation / [General knowledge distillation methods](https://mlsanity.com/distill/general-knowledge-distillation-methods/)

## Builds on (most cited first, 13 of 13)

- [Very Deep Convolutional Networks for Large-Scale Image Recognition](https://mlsanity.com/paper/1409.1556/) (2014)
- [Image-to-Image Translation with Conditional Adversarial Networks](https://mlsanity.com/paper/1611.07004/) (2016)
- [Benchmarking Single Image Dehazing and Beyond](https://mlsanity.com/paper/1712.04143/) (2017)
- [DehazeNet: An End-to-End System for Single Image Haze Removal](https://mlsanity.com/paper/1601.07661/) (2016)
- [FFA-Net: Feature Fusion Attention Network for Single Image Dehazing](https://mlsanity.com/paper/1911.07559/) (2019)
- [Multi-Scale Boosted Dehazing Network with Dense Feature Fusion](https://mlsanity.com/paper/2004.13388/) (2020)
- [GridDehazeNet: Attention-Based Multi-Scale Network for Image Dehazing](https://mlsanity.com/paper/1908.03245/) (2019)
- [Contrastive Learning for Compact Single Image Dehazing](https://mlsanity.com/paper/2104.09367/) (2021)
- [Gated Fusion Network for Single Image Dehazing](https://mlsanity.com/paper/1804.00213/) (2018)
- [Domain Adaptation for Image Dehazing](https://mlsanity.com/paper/2005.04668/) (2020)
- [From Synthetic to Real: Image Dehazing Collaborating with Unlabeled Real Data](https://mlsanity.com/paper/2108.02934/) (2021)
- [I-HAZE: a dehazing benchmark with real hazy and haze-free indoor images](https://mlsanity.com/paper/1804.05091/) (2018)
- [Towards Domain Invariant Single Image Dehazing](https://mlsanity.com/paper/2101.10449/) (2021)

## Built on by (most cited first, 4 of 4)

- [MSP-Former: Multi-Scale Projection Transformer for Single Image Desnowing](https://mlsanity.com/paper/2207.05621/) (2022)
- [Source-Free Domain Adaptation for Real-world Image Dehazing](https://mlsanity.com/paper/2207.06644/) (2022)
- [Non-aligned supervision for Real Image Dehazing](https://mlsanity.com/paper/2303.04940/) (2023)
- [DEHRFormer: Real-time Transformer for Depth Estimation and Haze Removal from Varicolored Haze Scenes](https://mlsanity.com/paper/2303.06905/) (2023)

## Abstract (arXiv)

Deep learning-based methods have made significant achievements for image dehazing. However, most of existing dehazing networks are concentrated on training models using simulated hazy images, resulting in generalization performance degradation when applied on real-world hazy images because of domain shift. In this paper, we propose a mutual learning dehazing framework for domain adaption. Specifically, we first devise two siamese networks: a teacher network in the synthetic domain and a student network in the real domain, and then optimize them in a mutual learning manner by leveraging EMA and joint loss. Moreover, we design a sample-cycle strategy based on density augmentation (HDA) module to introduce pseudo real-world image pairs provided by the student network into training for further improving the generalization performance. Extensive experiments on both synthetic and real-world dataset demonstrate that the propose mutual learning framework outperforms state-of-the-art dehazing techniques in terms of subjective and objective evaluation.