Exploring Scalable Unified Modeling for General Low-Level Vision
Not on the map. Why?
Abstract (arXiv)
Low-level vision involves a wide spectrum of tasks, including image restoration, enhancement, stylization, and feature extraction, which differ significantly in both task formulation and output domains. To address the challenge of unified modeling across such diverse tasks, we propose a Visual task Prompt-based Image Processing (VPIP) framework that leverages input-target image pairs as visual prompts to guide the model in performing a variety of low-level vision tasks. The framework comprises an end-to-end image processing backbone, a prompt encoder, and a prompt interaction module, enabling flexible integration with various architectures and effective utilization of task-specific visual representations. Based on this design, we develop a unified low-level vision model, GenLV, and evaluate its performance across multiple representative tasks. To explore the scalability of this approach, we extend the framework along two dimensions: model capacity and task diversity. We construct a large-scale benchmark consisting of over 100 low-level vision tasks and train multiple versions of the model with varying scales. Experimental results show that the proposed method achieves considerable performance across a wide range of tasks. Notably, increasing the number of training tasks enhances generalization, particularly for tasks with limited data, indicating the model's ability to learn transferable representations through joint training. Further evaluations in zero-shot generalization, few-shot transfer, and task-specific fine-tuning scenarios demonstrate the model's strong adaptability, confirming the effectiveness, scalability, and potential of the proposed framework as a unified foundation for general low-level vision modeling.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 46 of its 65 references that are in the map. First posted on arXiv 20 Jul 2025.
Builds on
46 of 65 references.
References · 46
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
- 2021The Power of Scale for Parameter-Efficient Prompt Tuningcited by 3,769
- 2016Perceptual Losses for Real-Time Style Transfer and Super-Resolutioncited by 2,678
- 2021Learning to Prompt for Vision-Language Modelscited by 2,269
- 2022Visual Prompt Tuningcited by 1,674
- 2021Restormer: Efficient Transformer for High-Resolution Image Restorationcited by 1,618
- 2016Beyond a Gaussian Denoiser: Residual Learning of Deep CNN for Image Denoisingcited by 1,352
- 2021Real-ESRGAN: Training Real-World Blind Super-Resolution with Pure Synthetic Datacited by 961
- 2021Multi-Stage Progressive Image Restorationcited by 813
- 2018Deep Retinex Decomposition for Low-Light Enhancementcited by 720
34 more
- 2021Designing a Practical Degradation Model for Deep Blind Image Super-Resolutioncited by 524
- 2018Learning to See in the Darkcited by 459
- 2017Benchmarking Single Image Dehazing and Beyondcited by 445
- 2022Activating More Pixels in Image Super-Resolution Transformercited by 433
- 2016Deep Joint Rain Detection and Removal from a Single Imagecited by 351
- 2016AID: A Benchmark Dataset for Performance Evaluation of Aerial Scene Classificationcited by 343
- 2022Images Speak in Images: A Generalist Painter for In-Context Visual Learningcited by 317
- 2018Toward Convolutional Blind Denoising of Real Photographscited by 274
- 2020Multi-Scale Progressive Fusion Network for Single Image Derainingcited by 259
- 2019An Underwater Image Enhancement Benchmark Dataset and Beyondcited by 250
- 2022Visual Prompting via Image Inpaintingcited by 248
- 2023Sequential Modeling Enables Scalable Learning for Large Vision Modelscited by 212
- 2017Deep Bilateral Learning for Real-Time Image Enhancementcited by 200
- 2021AdaAttN: Revisit Attention Mechanism in Arbitrary Neural Style Transfercited by 178
- 2021Unsupervised Degradation Representation Learning for Blind Super-Resolutioncited by 177
- 2020Defocus Deblurring Using Dual-Pixel Datacited by 138
- 2015Compression Artifacts Reduction by a Deep Convolutional Networkcited by 136
- 2019Dense Extreme Inception Network: Towards a Robust CNN Model for Edge Detectioncited by 104
- 2023ProRes: Exploring Degradation-aware Visual Prompt for Universal Image Restorationcited by 77
- 2021HDRUNet: Single Image HDR Reconstruction with Denoising and Dequantizationcited by 58
- 2023A Comparative Study of Image Restoration Networks for General Backbone Network Designcited by 56
- 2024RestoreAgent: Autonomous Image Restoration Agent via Multimodal Large Language Modelscited by 41
- 2024PromptFix: You Prompt and We Fix the Photocited by 40
- 2024PixWizard: Versatile Image-to-Image Visual Assistant with Open-Language Instructionscited by 31
- 2017SAR image despeckling through convolutional neural networkscited by 30
- 2021A New Journey from SDRTV to HDRTVcited by 30
- 2023Unifying Image Processing as Visual Prompting Question Answeringcited by 29
- 2021Discovering Distinctive "Semantics" in Super-Resolution Networkscited by 20
- 2023SuperBench: A Super-Resolution Benchmark Dataset for Scientific Machine Learningcited by 18
- 2024Learning A Low-Level Vision Generalist via Visual Task Promptcited by 18
- 2023Continuous Remote Sensing Image Super-Resolution based on Context Interaction in Implicit Function Spacecited by 17
- 2023SEAL: A Framework for Systematic Evaluation of Real-World Super-Resolutioncited by 12
- 2024A Preliminary Exploration Towards General Image Restorationcited by 6
- 2025Revisiting the Generalization Problem of Low-level Vision Models Through the Lens of Image Derainingcited by 4
Built on by
Citing papers per year: 2025: 4.
4 papers.
- 2025FAPE-IR: Frequency-Aware Planning and Execution Framework for All-in-One Image Restorationcited by 3
- 2025Omni-Weather: A Unified Multimodal Model for Weather Radar Understanding and Generationcited by 2
- 2025LinearSR: Unlocking Linear Attention for Stable and Efficient Image Super-Resolutioncited by 0
- 2025SynWeather: Weather Observation Data Synthesis across Multiple Regions and Variables via a General Diffusion Transformercited by 0
- 2025Omni-Weather: A Unified Multimodal Model for Weather Radar Understanding and Generation25 Dec 2025
- 2025FAPE-IR: Frequency-Aware Planning and Execution Framework for All-in-One Image Restoration18 Nov 2025
- 2025SynWeather: Weather Observation Data Synthesis across Multiple Regions and Variables via a General Diffusion Transformer11 Nov 2025
- 2025LinearSR: Unlocking Linear Attention for Stable and Efficient Image Super-Resolution9 Oct 2025