mlsanityData to 7 Oct 2026

Strong and Controllable Blind Image Decomposition

arXiv 2403.10520 ↗First posted 15 Mar 2024cs.CV cs.LG eess.IVcited by 2

Not on the map. Why?

Abstract (arXiv)

Blind image decomposition aims to decompose all components present in an image, typically used to restore a multi-degraded input image. While fully recovering the clean image is appealing, in some scenarios, users might want to retain certain degradations, such as watermarks, for copyright protection. To address this need, we add controllability to the blind image decomposition process, allowing users to enter which types of degradation to remove or retain. We design an architecture named controllable blind image decomposition network. Inserted in the middle of U-Net structure, our method first decomposes the input feature maps and then recombines them according to user instructions. Advantageously, this functionality is implemented at minimal computational cost: decomposition and recombination are all parameter-free. Experimentally, our system excels in blind image decomposition tasks and can outputs partially or fully restored images that well reflect user intentions. Furthermore, we evaluate and configure different options for the network structure and loss functions. This, combined with the proposed decomposition-and-recombination method, yields an efficient and competitive system for blind image decomposition, compared with current state-of-the-art methods.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 57 of its 84 references that are in the map. First posted on arXiv 15 Mar 2024.

Builds on

57 of 84 references.

References · 57

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
  3. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  4. 2014ImageNet Large Scale Visual Recognition Challengecited by 8,441
  5. 2023Segment Anythingcited by 8,158
  6. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,539
  7. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
  8. 2016The Cityscapes Dataset for Semantic Urban Scene Understandingcited by 4,427
  9. 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,591
  10. 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,409
  11. 2021SwinIR: Image Restoration Using Swin Transformercited by 1,869
  12. 2021Restormer: Efficient Transformer for High-Resolution Image Restorationcited by 1,618
38 more
  1. 2018ESRGAN: Enhanced Super-Resolution Generative Adversarial Networkscited by 1,250
  2. 2014Image Super-Resolution Using Deep Convolutional Networkscited by 1,218
  3. 2022Imagic: Text-Based Real Image Editing with Diffusion Modelscited by 1,172
  4. 2021Blended Diffusion for Text-driven Editing of Natural Imagescited by 924
  5. 2021Uformer: A General U-Shaped Transformer for Image Restorationcited by 864
  6. 2021Multi-Stage Progressive Image Restorationcited by 813
  7. 2018Residual Dense Network for Image Super-Resolutioncited by 796
  8. 2022Zero-Shot Image Restoration Using Denoising Diffusion Null-Space Modelcited by 574
  9. 2023Segment Everything Everywhere All at Oncecited by 546
  10. 2022Make-A-Scene: Scene-Based Text-to-Image Generation with Human Priorscited by 487
  11. 2017Semantic Foggy Scene Understanding with Synthetic Datacited by 401
  12. 2019DeblurGAN-v2: Deblurring (Orders-of-Magnitude) Faster and Bettercited by 361
  13. 2016Deep Joint Rain Detection and Removal from a Single Imagecited by 351
  14. 2016DehazeNet: An End-to-End System for Single Image Haze Removalcited by 313
  15. 2020Single Image Super-Resolution via a Holistic Attention Networkcited by 265
  16. 2021TransWeather: Transformer-based Restoration of Images Degraded by Adverse Weather Conditionscited by 243
  17. 2018Recurrent Squeeze-and-Excitation Context Aggregation Net for Single Image Derainingcited by 205
  18. 2017Attentive Generative Adversarial Network for Raindrop Removal from a Single Imagecited by 204
  19. 2017DesnowNet: Context-Aware Deep Network for Snow Removalcited by 200
  20. 2017Image De-raining Using a Conditional Generative Adversarial Networkcited by 197
  21. 2017Stacked Conditional Generative Adversarial Networks for Jointly Learning Shadow Detection and Shadow Removalcited by 160
  22. 2019Heavy Rain Image Restoration: Integrating Physics Model and Conditional Adversarial Learningcited by 157
  23. 2018Densely Connected Pyramid Dehazing Networkcited by 145
  24. 2018Gated Fusion Network for Single Image Dehazingcited by 133
  25. 2023PromptIR: Prompting for All-in-One Blind Image Restorationcited by 113
  26. 2019Towards Ghost-free Shadow Removal via Dual Hierarchical Aggregation Network and Shadow Matting GANcited by 102
  27. 2018Single Image Reflection Separation with Perceptual Lossescited by 98
  28. 2019Shadow Removal via Shadow Image Decompositioncited by 96
  29. 2019Single Image Deraining: A Comprehensive Benchmark Analysiscited by 84
  30. 2021Deep Dense Multi-scale Network for Snow Removal Using Semantic and Geometric Priorscited by 82
  31. 2023ProRes: Exploring Degradation-aware Visual Prompt for Universal Image Restorationcited by 77
  32. 2022DC-ShadowNet: Single-Image Hard and Soft Shadow Removal Using Unsupervised Domain-Classifier Guided Networkcited by 68
  33. 2020Syn2Real Transfer Learning for Image Deraining using Gaussian Processescited by 62
  34. 2019ARGAN: Attentive Recurrent Generative Adversarial Network for Shadow Detection and Removalcited by 51
  35. 2020How to Train Neural Networks for Flare Removalcited by 50
  36. 2021CANet: A Context-Aware Network for Shadow Removalcited by 47
  37. 2023Prompt-In-Prompt Learning for Universal Image Restorationcited by 43
  38. 2020MPRNet: Multi-Path Residual Network for Lightweight Image Super Resolutioncited by 38

50 most cited of 57 All 57 (JSON)

Built on by

Cited by year

Citing papers per year: 2024: 1; 2025: 1.

2 papers.