mlsanityData to 13 Oct 2026

ISP meets Deep Learning: A Survey on Deep Learning Methods for Image Signal Processing

arXiv 2305.11994 ↗First posted 19 May 2023cs.LG eess.IVcited by 1

Not on the map. Why?

Abstract (arXiv)

The entire Image Signal Processor (ISP) of a camera relies on several processes to transform the data from the Color Filter Array (CFA) sensor, such as demosaicing, denoising, and enhancement. These processes can be executed either by some hardware or via software. In recent years, Deep Learning has emerged as one solution for some of them or even to replace the entire ISP using a single neural network for the task. In this work, we investigated several recent pieces of research in this area and provide deeper analysis and comparison among them, including results and possible points of improvement for future researchers.

Key facts. Cited by 1 paper in the map (data through 13 Oct 2026). Builds on 75 of its 148 references that are in the map. First posted on arXiv 19 May 2023.

Builds on

75 of 148 references.

References · 75

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,950
  2. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,656
  3. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,082
  4. 2015Distilling the Knowledge in a Neural Networkcited by 10,180
  5. 2014ImageNet Large Scale Visual Recognition Challengecited by 8,476
  6. 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,713
  7. 2016Densely Connected Convolutional Networkscited by 6,707
  8. 2018MobileNetV2: Inverted Residuals and Linear Bottleneckscited by 4,786
  9. 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,516
  10. 2016DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFscited by 3,240
  11. 2016Perceptual Losses for Real-Time Style Transfer and Super-Resolutioncited by 2,687
  12. 2018CBAM: Convolutional Block Attention Modulecited by 2,469
38 more
  1. 2016Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Networkcited by 1,906
  2. 2017Deformable Convolutional Networkscited by 1,486
  3. 2016Beyond a Gaussian Denoiser: Residual Learning of Deep CNN for Image Denoisingcited by 1,354
  4. 2019Semantic Image Synthesis with Spatially-Adaptive Normalizationcited by 1,296
  5. 2018Image Super-Resolution Using Very Deep Residual Channel Attention Networkscited by 1,259
  6. 2018ESRGAN: Enhanced Super-Resolution Generative Adversarial Networkscited by 1,252
  7. 2014Image Super-Resolution Using Deep Convolutional Networkscited by 1,221
  8. 2017A Survey on Deep Learning in Medical Image Analysiscited by 1,183
  9. 2017PWC-Net: CNNs for Optical Flow Using Pyramid, Warping, and Cost Volumecited by 967
  10. 2015Accurate Image Super-Resolution Using Very Deep Convolutional Networkscited by 902
  11. 2017Video Enhancement with Task-Oriented Flowcited by 617
  12. 2019Score-CAM: Score-Weighted Visual Explanations for Convolutional Neural Networkscited by 578
  13. 2015Empirical Evaluation of Rectified Activations in Convolutional Networkcited by 517
  14. 2019EDVR: Video Restoration with Enhanced Deformable Convolutional Networkscited by 492
  15. 2018Learning to See in the Darkcited by 459
  16. 2019A Survey of Deep Learning Techniques for Autonomous Drivingcited by 402
  17. 2020A Survey of Convolutional Neural Networks: Analysis, Applications, and Prospectscited by 396
  18. 2020Learning Enriched Features for Real Image Restoration and Enhancementcited by 311
  19. 2018Unprocessing Images for Learned Raw Denoisingcited by 250
  20. 2020CycleISP: Real Image Restoration via Improved Data Synthesiscited by 213
  21. 2017Benchmarking Denoising Algorithms with Real Photographscited by 209
  22. 2017Deep Bilateral Learning for Real-Time Image Enhancementcited by 200
  23. 2019Real Image Denoising with Feature Attentioncited by 176
  24. 2018Deep learning in agriculture: A surveycited by 160
  25. 2017Burst Denoising with Kernel Prediction Networkscited by 157
  26. 2017DSLR-Quality Photos on Mobile Devices with Deep Convolutional Networkscited by 156
  27. 2019Deep Learning on Image Denoising: An overviewcited by 128
  28. 2020Structure-Preserving Super Resolution with Gradient Guidancecited by 116
  29. 2019Zoom To Learn, Learn To Zoomcited by 115
  30. 2020Replacing Mobile Camera ISP with a Single Deep Learning Modelcited by 108
  31. 2021Invertible Image Signal Processingcited by 94
  32. 2018DeepISP: Towards Learning an End-to-End Image Processing Pipelinecited by 88
  33. 2020Supervised Raw Video Denoising with a Benchmark Dataset on Dynamic Scenescited by 77
  34. 2016SqueezeDet: Unified, Small, Low Power Fully Convolutional Neural Networks for Real-Time Object Detection for Autonomous Drivingcited by 55
  35. 2022Avoiding Overfitting: A Survey on Regularization Methods for Convolutional Neural Networkscited by 55
  36. 2018Distort-and-Recover: Color Enhancement using Deep Reinforcement Learningcited by 52
  37. 2020AIM 2020 Challenge on Learned Image Signal Processing Pipelinecited by 44
  38. 2021Learning RAW-to-sRGB Mappings with Inaccurately Aligned Supervisioncited by 43

50 most cited of 75 All 75 (JSON)

Built on by

Cited by year (2026 to 13 Oct)

Citing papers per year: 2026: 1.

1 paper.

  1. 2026An Extensible and Lightweight Unified Architecture for Demosaicing Pixel-bin Image Sensorscited by 2