# Review Learning: Advancing All-in-One Ultra-High-Definition Image Restoration Training Method

arXiv: https://arxiv.org/abs/2408.06709 · HTML: https://mlsanity.com/paper/2408.06709/

## Key facts

- Cited by 3 papers in the map (data through 14 Oct 2026).
- Builds on 8 of its 41 references that are in the map.
- First posted on arXiv 13 Aug 2024.

## Builds on (most cited first, 8 of 8)

- [Simple Baselines for Image Restoration](https://mlsanity.com/paper/2204.04676/) (2022)
- [An Empirical Study of Catastrophic Forgetting in Large Language Models During Continual Fine-tuning](https://mlsanity.com/paper/2308.08747/) (2023)
- [MEDITRON-70B: Scaling Medical Pretraining for Large Language Models](https://mlsanity.com/paper/2311.16079/) (2023)
- [SaulLM-7B: A pioneering Large Language Model for Law](https://mlsanity.com/paper/2403.03883/) (2024)
- [Controlling Vision-Language Models for Multi-Task Image Restoration](https://mlsanity.com/paper/2310.01018/) (2023)
- [Embedding Fourier for Ultra-High-Definition Low-Light Image Enhancement](https://mlsanity.com/paper/2302.11831/) (2023)
- [Investigating Continual Pretraining in Large Language Models: Insights and Implications](https://mlsanity.com/paper/2402.17400/) (2024)
- [Ultra-High-Definition Image Restoration: New Benchmarks and A Dual Interaction Prior-Driven Solution](https://mlsanity.com/paper/2406.13607/) (2024)

## Built on by (most cited first, 3 of 3)

- [A Survey on All-in-One Image Restoration: Taxonomy, Evaluation and Future Trends](https://mlsanity.com/paper/2410.15067/) (2024)
- [Deep Learning-Driven Ultra-High-Definition Image Restoration: A Survey](https://mlsanity.com/paper/2505.16161/) (2025)
- [UniFlowRestore: A General Video Restoration Framework via Flow Matching and Prompt Guidance](https://mlsanity.com/paper/2504.09069/) (2025)

## Abstract (arXiv)

All-in-one image restoration tasks are becoming increasingly important, especially for ultra-high-definition (UHD) images. Existing all-in-one UHD image restoration methods usually boost the model's performance by introducing prompt or customized dynamized networks for different degradation types. For the inference stage, it might be friendly, but in the training stage, since the model encounters multiple degraded images of different quality in an epoch, these cluttered learning objectives might be information pollution for the model. To address this problem, we propose a new training paradigm for general image restoration models, which we name Review Learning, which enables image restoration models to be capable enough to handle multiple types of degradation without prior knowledge and prompts. This approach begins with sequential training of an image restoration model on several degraded datasets, combined with a review mechanism that enhances the image restoration model's memory for several previous classes of degraded datasets. In addition, we design a lightweight all-purpose image restoration network that can efficiently reason about degraded images with 4K (3840 × 2160) resolution on a single consumer-grade GPU.