FoundIR-v2: Optimizing Pre-Training Data Mixtures for Image Restoration Foundation Model
On the map: Diffusion models → Inverse problems and image restoration
also in 1 more
Abstract (arXiv)
Recent studies have witnessed significant advances in image restoration foundation models driven by improvements in the scale and quality of pre-training data. In this work, we find that the data mixture proportions from different restoration tasks are also a critical factor directly determining the overall performance of all-in-one image restoration models. To this end, we propose a high-capacity diffusion-based image restoration foundation model, FoundIR-v2, which adopts a data equilibrium scheduling paradigm to dynamically optimize the proportions of mixed training datasets from different tasks. By leveraging the data mixing law, our method ensures a balanced dataset composition, enabling the model to achieve consistent generalization and comprehensive performance across diverse tasks. Furthermore, we introduce an effective Mixture-of-Experts (MoE)-driven scheduler into generative pre-training to flexibly allocate task-adaptive diffusion priors for each restoration task, accounting for the distinct degradation forms and levels exhibited by different tasks. Extensive experiments demonstrate that our method can address over 50 sub-tasks across a broader scope of real-world scenarios and achieves favorable performance against state-of-the-art approaches.
Key facts. Cited by 9 papers in the map (data through 7 Oct 2026). Placed in Inverse problems and image restoration, one of 14 directions in Diffusion models. Builds on 52 of its 64 references that are in the map. First posted on arXiv 10 Dec 2025.
Builds on
52 of 64 references.
Closest ancestors · 10
Same direction, newest first
- 2025Harnessing Diffusion-Yielded Score Priors for Image Restoration28 Jul
- 2025Elucidating and Endowing the Diffusion Training Paradigm for General Image Restoration26 Jun
- 2024GenDeg: Diffusion-based Degradation Synthesis for Generalizable All-In-One Image Restoration26 Nov
- 2024DreamClear: High-Capacity Real-World Image Restoration with Privacy-Safe Dataset Curation24 Oct
- 2024One-Step Effective Diffusion Network for Real-World Image Super-Resolution12 Jun
- 2024Selective Hourglass Mapping for Universal Image Restoration Based on Diffusion Model17 Mar
- 2023SeeSR: Towards Semantics-Aware Real-World Image Super-Resolution27 Nov
- 2023AutoDIR: Automatic All-in-One Image Restoration with Latent Diffusion16 Oct
- 2023Pixel-Aware Stable Diffusion for Realistic Image Super-resolution and Personalized Stylization28 Aug
- 2023Exploiting Diffusion Prior for Real-World Image Super-Resolution11 May
Other references · 42
- 2017Attention Is All You Needcited by 59,932
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 2023Visual Instruction Tuningcited by 7,792
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
- 2022Classifier-Free Diffusion Guidancecited by 5,717
- 2016SGDR: Stochastic Gradient Descent with Warm Restartscited by 4,993
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,290
- 2022Elucidating the Design Space of Diffusion-Based Generative Modelscited by 2,994
- 2021Restormer: Efficient Transformer for High-Resolution Image Restorationcited by 1,618
- 2017Enhanced Deep Residual Networks for Single Image Super-Resolutioncited by 1,543
- 2024Depth Anything: Unleashing the Power of Large-Scale Unlabeled Datacited by 1,346
- 2021MUSIQ: Multi-scale Image Quality Transformercited by 1,058
30 more
- 2022Exploring CLIP for Assessing the Look and Feel of Imagescited by 974
- 2021Real-ESRGAN: Training Real-World Blind Super-Resolution with Pure Synthetic Datacited by 961
- 2020Pre-Trained Image Processing Transformercited by 891
- 2021Designing a Practical Degradation Model for Deep Blind Image Super-Resolutioncited by 524
- 2022MANIQA: Multi-dimension Attention Network for No-Reference Image Quality Assessmentcited by 514
- 2024Scaling Up to Excellence: Practicing Model Scaling for Photo-Realistic Image Restoration In the Wildcited by 281
- 2021TransWeather: Transformer-based Restoration of Images Degraded by Adverse Weather Conditionscited by 243
- 2019From Patches to Pictures (PaQ-2-PiQ): Mapping the Perceptual Space of Picture Qualitycited by 221
- 2023Learning A Sparse Transformer Network for Effective Image Derainingcited by 204
- 2023Image Restoration with Mean-Reverting Stochastic Differential Equationscited by 182
- 2024InstructIR: High-Quality Image Restoration Following Human Instructionscited by 139
- 2020NH-HAZE: An Image Dehazing Benchmark with Non-Homogeneous Hazy and Haze-Free Imagescited by 108
- 2019Dense Haze: A benchmark for image dehazing with dense-haze and haze-free imagescited by 107
- 2023Depicting Beyond Scores: Advancing Image Quality Assessment through Multi-modal Language Modelscited by 104
- 2023Embedding Fourier for Ultra-High-Definition Low-Light Image Enhancementcited by 86
- 2018Real-world Noisy Image Denoising: A New Benchmarkcited by 74
- 2024Complexity Experts are Task-Discriminative Learners for Any Image Restorationcited by 72
- 2023A Comparative Study of Image Restoration Networks for General Backbone Network Designcited by 56
- 2024Towards Effective Multiple-in-One Image Restoration: A Sequential and Prompt Learning Strategycited by 48
- 2024An Intelligent Agentic System for Complex Image Restoration Problemscited by 41
- 2024FoundIR: Unleashing Million-scale Training Data to Advance Foundation Models for Image Restorationcited by 37
- 2023Towards Unified Deep Image Deraining: A Survey and A New Benchmarkcited by 34
- 2021MC-Blur: A Comprehensive Benchmark for Image Deblurringcited by 27
- 2025WeatherBench: A Real-World Benchmark Dataset for All-in-One Adverse Weather Image Restorationcited by 20
- 2024Learning A Low-Level Vision Generalist via Visual Task Promptcited by 18
- 2024UAV-Rain1k: A Benchmark for Raindrop Removal from UAV Aerial Imagerycited by 15
- 2025Lumina-OmniLV: A Unified Multimodal Framework for General Low-Level Visioncited by 14
- 2024GRIDS: Grouped Multiple-Degradation Restoration with Image Degradation Similaritycited by 12
- 2025IDEAL: Data Equilibrium Adaptation for Multi-Capability Language Model Alignmentcited by 8
- 2025Rethinking Nighttime Image Deraining via Learnable Color Space Transformationcited by 5
Built on by
Citing papers per year: 2026: 9.
9 papers.
- 2026LoViF 2026 Challenge on Real-World All-in-One Image Restoration: Methods and Resultscited by 5
- 2026TPGDiff: Hierarchical Triple-Prior Guided Diffusion for Image Restorationcited by 3
- 2026TIR-Agent: Training an Explorative and Efficient Agent for Image Restorationcited by 3
- 2026PixRestore: Unified Image Restoration via Pixel Diffusion Transformercited by 2
- 2026Position: Evaluation of Visual Processing Should Be Human-Centered, Not Metric-Centeredcited by 1
- 2026The Second LoViF 2026 Challenge on Real-World All-in-One Image Restoration: Methods and Resultscited by 1
- 2026DVANet: Degradation-aware Visual-prior Alignment Network for Image Restorationcited by 0
- 2026Learning Polarization Image Restoration with General Restoration Priorscited by 0
- 2026LensBridge: Frequency-Guided Compound Degradation Adaptation for Lens Aberration Correction and Veiling Glare Removalcited by 0
- 2026LensBridge: Frequency-Guided Compound Degradation Adaptation for Lens Aberration Correction and Veiling Glare Removal29 Sep 2026
- 2026Learning Polarization Image Restoration with General Restoration Priors25 Sep 2026
- 2026PixRestore: Unified Image Restoration via Pixel Diffusion Transformer17 Aug 2026
- 2026The Second LoViF 2026 Challenge on Real-World All-in-One Image Restoration: Methods and Results23 Jul 2026
- 2026DVANet: Degradation-aware Visual-prior Alignment Network for Image Restoration17 Jun 2026
- 2026LoViF 2026 Challenge on Real-World All-in-One Image Restoration: Methods and Results21 Apr 2026
- 2026TIR-Agent: Training an Explorative and Efficient Agent for Image Restoration29 Mar 2026
- 2026Position: Evaluation of Visual Processing Should Be Human-Centered, Not Metric-Centered28 Feb 2026
- 2026TPGDiff: Hierarchical Triple-Prior Guided Diffusion for Image Restoration28 Jan 2026
Similar, not cited
Close in wording, no citation either way
- 2023Parameter Efficient Adaptation for Image Restoration with Heterogeneous Mixture-of-Experts
- 2024Training-Free Large Model Priors for Multiple-in-One Image Restoration
- 2024Decoupled Data Consistency with Diffusion Purification for Image Restoration
- 2023HQ-50K: A Large-scale, High-quality Dataset for Image Restoration
- 2024ReFIR: Grounding Large Restoration Models with Retrieval Augmentation
- 2026Noise-Free One-Step LoRA for Task-Driven Image Restoration with Diffusion Priors
- 2025UniRes: Universal Image Restoration for Complex Degradations
- 2024Consistent Diffusion: Denoising Diffusion Model with Data-Consistent Training for Image Restoration