mlsanityData to 7 Oct 2026

Exploring Scalable Unified Modeling for General Low-Level Vision

arXiv 2507.14801 ↗First posted 20 Jul 2025cs.CVcited by 4

Not on the map. Why?

Abstract (arXiv)

Low-level vision involves a wide spectrum of tasks, including image restoration, enhancement, stylization, and feature extraction, which differ significantly in both task formulation and output domains. To address the challenge of unified modeling across such diverse tasks, we propose a Visual task Prompt-based Image Processing (VPIP) framework that leverages input-target image pairs as visual prompts to guide the model in performing a variety of low-level vision tasks. The framework comprises an end-to-end image processing backbone, a prompt encoder, and a prompt interaction module, enabling flexible integration with various architectures and effective utilization of task-specific visual representations. Based on this design, we develop a unified low-level vision model, GenLV, and evaluate its performance across multiple representative tasks. To explore the scalability of this approach, we extend the framework along two dimensions: model capacity and task diversity. We construct a large-scale benchmark consisting of over 100 low-level vision tasks and train multiple versions of the model with varying scales. Experimental results show that the proposed method achieves considerable performance across a wide range of tasks. Notably, increasing the number of training tasks enhances generalization, particularly for tasks with limited data, indicating the model's ability to learn transferable representations through joint training. Further evaluations in zero-shot generalization, few-shot transfer, and task-specific fine-tuning scenarios demonstrate the model's strong adaptability, confirming the effectiveness, scalability, and potential of the proposed framework as a unified foundation for general low-level vision modeling.

Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 46 of its 65 references that are in the map. First posted on arXiv 20 Jul 2025.

Builds on

46 of 65 references.

References · 46

  1. 2020Language Models are Few-Shot Learnerscited by 32,199
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  3. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  4. 2021The Power of Scale for Parameter-Efficient Prompt Tuningcited by 3,769
  5. 2016Perceptual Losses for Real-Time Style Transfer and Super-Resolutioncited by 2,678
  6. 2021Learning to Prompt for Vision-Language Modelscited by 2,269
  7. 2022Visual Prompt Tuningcited by 1,674
  8. 2021Restormer: Efficient Transformer for High-Resolution Image Restorationcited by 1,618
  9. 2016Beyond a Gaussian Denoiser: Residual Learning of Deep CNN for Image Denoisingcited by 1,352
  10. 2021Real-ESRGAN: Training Real-World Blind Super-Resolution with Pure Synthetic Datacited by 961
  11. 2021Multi-Stage Progressive Image Restorationcited by 813
  12. 2018Deep Retinex Decomposition for Low-Light Enhancementcited by 720
34 more
  1. 2021Designing a Practical Degradation Model for Deep Blind Image Super-Resolutioncited by 524
  2. 2018Learning to See in the Darkcited by 459
  3. 2017Benchmarking Single Image Dehazing and Beyondcited by 445
  4. 2022Activating More Pixels in Image Super-Resolution Transformercited by 433
  5. 2016Deep Joint Rain Detection and Removal from a Single Imagecited by 351
  6. 2016AID: A Benchmark Dataset for Performance Evaluation of Aerial Scene Classificationcited by 343
  7. 2022Images Speak in Images: A Generalist Painter for In-Context Visual Learningcited by 317
  8. 2018Toward Convolutional Blind Denoising of Real Photographscited by 274
  9. 2020Multi-Scale Progressive Fusion Network for Single Image Derainingcited by 259
  10. 2019An Underwater Image Enhancement Benchmark Dataset and Beyondcited by 250
  11. 2022Visual Prompting via Image Inpaintingcited by 248
  12. 2023Sequential Modeling Enables Scalable Learning for Large Vision Modelscited by 212
  13. 2017Deep Bilateral Learning for Real-Time Image Enhancementcited by 200
  14. 2021AdaAttN: Revisit Attention Mechanism in Arbitrary Neural Style Transfercited by 178
  15. 2021Unsupervised Degradation Representation Learning for Blind Super-Resolutioncited by 177
  16. 2020Defocus Deblurring Using Dual-Pixel Datacited by 138
  17. 2015Compression Artifacts Reduction by a Deep Convolutional Networkcited by 136
  18. 2019Dense Extreme Inception Network: Towards a Robust CNN Model for Edge Detectioncited by 104
  19. 2023ProRes: Exploring Degradation-aware Visual Prompt for Universal Image Restorationcited by 77
  20. 2021HDRUNet: Single Image HDR Reconstruction with Denoising and Dequantizationcited by 58
  21. 2023A Comparative Study of Image Restoration Networks for General Backbone Network Designcited by 56
  22. 2024RestoreAgent: Autonomous Image Restoration Agent via Multimodal Large Language Modelscited by 41
  23. 2024PromptFix: You Prompt and We Fix the Photocited by 40
  24. 2024PixWizard: Versatile Image-to-Image Visual Assistant with Open-Language Instructionscited by 31
  25. 2017SAR image despeckling through convolutional neural networkscited by 30
  26. 2021A New Journey from SDRTV to HDRTVcited by 30
  27. 2023Unifying Image Processing as Visual Prompting Question Answeringcited by 29
  28. 2021Discovering Distinctive "Semantics" in Super-Resolution Networkscited by 20
  29. 2023SuperBench: A Super-Resolution Benchmark Dataset for Scientific Machine Learningcited by 18
  30. 2024Learning A Low-Level Vision Generalist via Visual Task Promptcited by 18
  31. 2023Continuous Remote Sensing Image Super-Resolution based on Context Interaction in Implicit Function Spacecited by 17
  32. 2023SEAL: A Framework for Systematic Evaluation of Real-World Super-Resolutioncited by 12
  33. 2024A Preliminary Exploration Towards General Image Restorationcited by 6
  34. 2025Revisiting the Generalization Problem of Low-level Vision Models Through the Lens of Image Derainingcited by 4

Built on by

Cited by year

Citing papers per year: 2025: 4.

4 papers.