mlsanityData to 7 Oct 2026

A Preliminary Study on GPT-Image Generation Model for Image Restoration

arXiv 2505.05621 ↗First posted 8 May 2025cs.CVcited by 1

Not on the map. Why?

Abstract (arXiv)

Recent advances in OpenAI's GPT-series multimodal generation models have shown remarkable capabilities in producing visually compelling images. In this work, we investigate its potential impact on the image restoration community. We provide, to the best of our knowledge, the first systematic benchmark across diverse restoration scenarios. Our evaluation shows that, while the restoration results generated by GPT-Image models are often perceptually pleasant, they tend to lack pixel-level structural fidelity compared with ground-truth references. Typical deviations include changes in image geometry, object positions or counts, and even modifications in perspective. Beyond empirical observations, we further demonstrate that outputs from GPT-Image models can act as strong visual priors, offering notable performance improvements for existing restoration networks. Using dehazing, deraining, and low-light enhancement as representative case studies, we show that integrating GPT-generated priors significantly boosts restoration quality. This study not only provides practical insights and a baseline framework for incorporating GPT-based generative priors into restoration pipelines, but also highlights new opportunities for bridging image generation models and restoration tasks. To support future research, we will release GPT-restored results.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 31 of its 47 references that are in the map. First posted on arXiv 8 May 2025.

Builds on

31 of 47 references.

References · 31

  1. 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,591
  2. 2021Restormer: Efficient Transformer for High-Resolution Image Restorationcited by 1,618
  3. 2016Beyond a Gaussian Denoiser: Residual Learning of Deep CNN for Image Denoisingcited by 1,352
  4. 2022Null-text Inversion for Editing Real Images using Guided Diffusion Modelscited by 1,168
  5. 2022Diffusion Models in Vision: A Surveycited by 1,008
  6. 2022Exploring CLIP for Assessing the Look and Feel of Imagescited by 974
  7. 2018Deep Retinex Decomposition for Low-Light Enhancementcited by 720
  8. 2018Deformable ConvNets v2: More Deformable, Better Resultscited by 666
  9. 2021DiffusionCLIP: Text-Guided Diffusion Models for Robust Image Manipulationcited by 640
  10. 2019EnlightenGAN: Deep Light Enhancement without Paired Supervisioncited by 466
  11. 2023DragDiffusion: Harnessing Diffusion Models for Interactive Point-based Image Editingcited by 293
  12. 2020Multi-Scale Progressive Fusion Network for Single Image Derainingcited by 259
19 more
  1. 2022Vision Transformers for Single Image Dehazingcited by 255
  2. 2019An Underwater Image Enhancement Benchmark Dataset and Beyondcited by 250
  3. 2022Restoring Vision in Adverse Weather Conditions with Patch-Based Denoising Diffusion Modelscited by 215
  4. 2017Attentive Generative Adversarial Network for Raindrop Removal from a Single Imagecited by 204
  5. 2017DesnowNet: Context-Aware Deep Network for Snow Removalcited by 200
  6. 2017Image De-raining Using a Conditional Generative Adversarial Networkcited by 197
  7. 2020Defocus Deblurring Using Dual-Pixel Datacited by 138
  8. 2018O-HAZE: a dehazing benchmark with real hazy and haze-free outdoor imagescited by 95
  9. 2024MambaIRv2: Attentive State Space Restorationcited by 90
  10. 2023Residual Denoising Diffusion Modelscited by 68
  11. 2018Lightweight Pyramid Networks for Image Derainingcited by 64
  12. 2019Single Image Reflection Removal through Cascaded Refinementcited by 58
  13. 2024A Survey on All-in-One Image Restoration: Taxonomy, Evaluation and Future Trendscited by 58
  14. 2025GPT-ImgEval: A Comprehensive Benchmark for Diagnosing GPT4o in Image Generationcited by 57
  15. 2023A Comparative Study of Image Restoration Networks for General Backbone Network Designcited by 56
  16. 2024Vitron: A Unified Pixel-level Vision LLM for Understanding, Generating, Segmenting, Editingcited by 49
  17. 2023Language-driven All-in-one Adverse Weather Removalcited by 36
  18. 2024NTIRE 2024 Challenge on Low Light Image Enhancement: Methods and Resultscited by 26
  19. 2023LDP: Language-driven Dual-Pixel Image Defocus Deblurring Networkcited by 11

Built on by

Cited by year

Citing papers per year: 2025: 1.

1 paper.