mlsanityData to 14 Oct 2026

HINet: Half Instance Normalization Network for Image Restoration

arXiv 2105.06086 ↗First posted 13 May 2021eess.IV cs.CVcited by 237

Not on the map. Why?

Abstract (arXiv)

In this paper, we explore the role of Instance Normalization in low-level vision tasks. Specifically, we present a novel block: Half Instance Normalization Block (HIN Block), to boost the performance of image restoration networks. Based on HIN Block, we design a simple and powerful multi-stage network named HINet, which consists of two subnetworks. With the help of HIN Block, HINet surpasses the state-of-the-art (SOTA) on various image restoration tasks. For image denoising, we exceed it 0.11dB and 0.28 dB in PSNR on SIDD dataset, with only 7.5% and 30% of its multiplier-accumulator operations (MACs), 6.8 times and 2.9 times speedup respectively. For image deblurring, we get comparable performance with 22.5% of its MACs and 3.3 times speedup on REDS and GoPro datasets. For image deraining, we exceed it by 0.3 dB in PSNR on the average result of multiple datasets with 1.4 times speedup. With HINet, we won 1st place on the NTIRE 2021 Image Deblurring Challenge - Track2. JPEG Artifacts, with a PSNR of 29.70. The code is available at https://github.com/megvii-model/HINet.

Key facts. Cited by 237 papers in the map (data through 14 Oct 2026). Builds on 50 of its 63 references that are in the map. First posted on arXiv 13 May 2021.

Builds on

50 of 63 references.

References · 50

  1. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  2. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
  3. 2020End-to-End Object Detection with Transformerscited by 7,414
  4. 2015Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shiftcited by 7,005
  5. 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,442
  6. 2016Layer Normalizationcited by 5,669
  7. 2016SGDR: Stochastic Gradient Descent with Warm Restartscited by 5,045
  8. 2017Arbitrary Style Transfer in Real-time with Adaptive Instance Normalizationcited by 2,010
  9. 2016Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Networkcited by 1,908
  10. 2019FCOS: Fully Convolutional One-Stage Object Detectioncited by 1,577
  11. 2017Enhanced Deep Residual Networks for Single Image Super-Resolutioncited by 1,552
  12. 2018Group Normalizationcited by 1,524
38 more
  1. 2016Beyond a Gaussian Denoiser: Residual Learning of Deep CNN for Image Denoisingcited by 1,358
  2. 2017ShuffleNet: An Extremely Efficient Convolutional Neural Network for Mobile Devicescited by 1,200
  3. 2016Instance Normalization: The Missing Ingredient for Fast Stylizationcited by 1,198
  4. 2018ShuffleNet V2: Practical Guidelines for Efficient CNN Architecture Designcited by 1,136
  5. 2021Multi-Stage Progressive Image Restorationcited by 816
  6. 2016Deep Multi-scale Convolutional Neural Network for Dynamic Scene Deblurringcited by 727
  7. 2017DeblurGAN: Blind Motion Deblurring Using Conditional Adversarial Networkscited by 367
  8. 2018Two at Once: Enhancing Learning and Generalization Capacities via IBN-Netcited by 364
  9. 2019DeblurGAN-v2: Deblurring (Orders-of-Magnitude) Faster and Bettercited by 362
  10. 2016Deep Joint Rain Detection and Removal from a Single Imagecited by 352
  11. 2018Scale-recurrent Network for Deep Image Deblurringcited by 333
  12. 2018Context Encoding for Semantic Segmentationcited by 290
  13. 2018Toward Convolutional Blind Denoising of Real Photographscited by 274
  14. 2019Progressive Image Deraining Networks: A Better and Simpler Baselinecited by 272
  15. 2020Multi-Scale Progressive Fusion Network for Single Image Derainingcited by 260
  16. 2018Density-aware Single Image De-raining using a Multi-stream Dense Networkcited by 248
  17. 2017Improved Texture Networks: Maximizing Quality and Diversity in Feed-forward Stylization and Texture Synthesiscited by 215
  18. 2020CycleISP: Real Image Restoration via Improved Data Synthesiscited by 213
  19. 2019Deep Stacked Hierarchical Multi-patch Network for Image Deblurringcited by 206
  20. 2018Recurrent Squeeze-and-Excitation Context Aggregation Net for Single Image Derainingcited by 205
  21. 2017Image De-raining Using a Conditional Generative Adversarial Networkcited by 197
  22. 2020Deblurring by Realistic Blurringcited by 188
  23. 2019Real Image Denoising with Feature Attentioncited by 176
  24. 2016Texture Networks: Feed-forward Synthesis of Textures and Stylized Imagescited by 174
  25. 2016Clearing the Skies: A deep network architecture for single-image rain removalcited by 136
  26. 2020Spatially-Attentive Patch-Hierarchical Network for Adaptive Motion Deblurringcited by 119
  27. 2019Uncertainty Guided Multi-Scale Residual Learning-using a Cycle Spinning CNN for Single Image De-Rainingcited by 117
  28. 2019Variational Denoising Network: Toward Blind Noise Modeling and Removalcited by 117
  29. 2019Multi-Temporal Recurrent Neural Networks For Progressive Non-Uniform Single Image Deblurring With Incremental Temporal Trainingcited by 112
  30. 2020Dual Adversarial Network: Toward Real-world Noise Removal and Noise Generationcited by 101
  31. 2020Transfer Learning from Synthetic to Real-Noise Denoising with Adaptive Instance Normalizationcited by 92
  32. 2016From Motion Blur to Motion Flow: a Deep Learning Solution for Removing Heterogeneous Motion Blurcited by 81
  33. 2020Practical Deep Raw Image Denoising on Mobile Devicescited by 76
  34. 2018Wide Activation for Efficient and Accurate Image Super-Resolutioncited by 65
  35. 2018Lightweight Pyramid Networks for Image Derainingcited by 64
  36. 2020Spatial-Adaptive Network for Single Image Denoisingcited by 64
  37. 2019Densely Residual Laplacian Super-Resolutioncited by 57
  38. 2021NTIRE 2021 Challenge on Image Deblurringcited by 50

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2021: 9; 2022: 42; 2023: 60; 2024: 66; 2025: 34; 2026: 26.

237 papers.

Sort:

By area:

  1. 2022Simple Baselines for Image Restorationcited by 708
  2. 2022MAXIM: Multi-Axis MLP for Image Processingcited by 302
  3. 2021Deblurring via Stochastic Refinementcited by 249
  4. 2023Inversion by Direct Iteration: An Alternative to Denoising Diffusion for Image Restorationcited by 165
  5. 2024InstructIR: High-Quality Image Restoration Following Human Instructionscited by 140
  6. 2021Event-Based Fusion for Motion Deblurring with Cross-modal Attentioncited by 113
  7. 2024AdaIR: Adaptive All-in-One Image Restoration via Frequency Mining and Modulationcited by 111
  8. 2024VmambaIR: Visual State Space Model for Image Restorationcited by 90
  9. 2023Hierarchical Integration Diffusion Model for Realistic Image Deblurringcited by 88
  10. 2023Embedding Fourier for Ultra-High-Definition Low-Light Image Enhancementcited by 86
  11. 2023Refusion: Enabling Large-Size Realistic Image Restoration with Latent-Space Diffusion Modelscited by 86
  12. 2021Intriguing Findings of Frequency Selection for Image Deblurringcited by 81
38 more
  1. 2022Multiscale Structure Guided Diffusion for Image Deblurringcited by 77
  2. 2024Pan-Mamba: Effective pan-sharpening with State Space Modelcited by 73
  3. 2024Selective Hourglass Mapping for Universal Image Restoration Based on Diffusion Modelcited by 73
  4. 2022MST++: Multi-stage Spectral-wise Transformer for Efficient Spectral Reconstructioncited by 72
  5. 2021Improving Image Restoration by Revisiting Global Information Aggregationcited by 61
  6. 2023A Comparative Study of Image Restoration Networks for General Backbone Network Designcited by 57
  7. 2022Flare7K: A Phenomenological Nighttime Flare Removal Datasetcited by 49
  8. 2023Sparse Sampling Transformer with Uncertainty-Driven Ranking for Unified Removal of Raindrops and Rain Streakscited by 45
  9. 2023Prompt-In-Prompt Learning for Universal Image Restorationcited by 43
  10. 2022Toward Real-world Single Image Deraining: A New Benchmark and Beyondcited by 40
  11. 2024U-shaped Vision Mamba for Single Image Dehazingcited by 40
  12. 2023DocDiff: Document Enhancement via Residual Diffusion Modelscited by 37
  13. 2023Language-driven All-in-one Adverse Weather Removalcited by 36
  14. 2023Improving Image Restoration through Removing Degradations in Textual Representationscited by 36
  15. 2024RobustSAM: Segment Anything Robustly on Degraded Imagescited by 36
  16. 2022Learning Degradation Representations for Image Deblurringcited by 35
  17. 2023Towards Unified Deep Image Deraining: A Survey and A New Benchmarkcited by 34
  18. 2024FourierMamba: Fourier Learning Integration with State Space Models for Image Derainingcited by 33
  19. 2022MSSNet: Multi-Scale-Stage Network for Single Image Deblurringcited by 31
  20. 2023Flare7K++: Mixing Synthetic and Real Datasets for Nighttime Flare Removal and Beyondcited by 31
  21. 2023A Unified Framework for Event-based Frame Interpolation with Ad-hoc Deblurring in the Wildcited by 27
  22. 2021Event-guided Deblurring of Unknown Exposure Time Videoscited by 26
  23. 2022DRT: A Lightweight Single Image Deraining Recursive Transformercited by 26
  24. 2021Deep Recurrent Neural Network with Multi-scale Bi-directional Propagation for Video Deblurringcited by 25
  25. 2022DeScoD-ECG: Deep Score-Based Diffusion Model for ECG Baseline Wander and Noise Removalcited by 25
  26. 2023Nighttime Smartphone Reflective Flare Removal Using Optical Center Symmetry Priorcited by 25
  27. 2023ScaleLong: Towards More Stable Training of Diffusion Model via Scaling Network Long Skip Connectioncited by 25
  28. 2024Learning Enriched Features via Selective State Spaces Model for Efficient Image Deblurringcited by 25
  29. 2024AdaRevD: Adaptive Patch Exiting Reversible Decoder Pushes the Limit of Image Deblurringcited by 25
  30. 2022RFormer: Transformer-based Generative Adversarial Network for Real Fundus Image Restoration on A New Clinical Benchmarkcited by 24
  31. 2024CU-Mamba: Selective State Space Models with Channel Learning for Image Restorationcited by 24
  32. 2024Teaching Tailored to Talent: Adverse Weather Restoration via Prompt Pool and Depth-Anything Constraintcited by 24
  33. 2024MWFormer: Multi-Weather Image Restoration Using Degradation-Aware Transformerscited by 24
  34. 2022DynamicISP: Dynamically Controlled Image Signal Processor for Image Recognitioncited by 23
  35. 2023A Unified Conditional Framework for Diffusion-based Image Restorationcited by 22
  36. 2023Prompt-based Ingredient-Oriented All-in-One Image Restorationcited by 22
  37. 2024UniProcessor: A Text-induced Unified Low-level Image Processorcited by 22
  38. 2022Real-World Deep Local Motion Deblurringcited by 21

50 most cited of 237 All 237 (JSON)