mlsanityData to 7 Oct 2026

FoundIR-v2: Optimizing Pre-Training Data Mixtures for Image Restoration Foundation Model

arXiv 2512.09282 ↗First posted 10 Dec 2025cs.CVcited by 9

On the map: Diffusion models → Inverse problems and image restoration

also in 1 more
Abstract (arXiv)

Recent studies have witnessed significant advances in image restoration foundation models driven by improvements in the scale and quality of pre-training data. In this work, we find that the data mixture proportions from different restoration tasks are also a critical factor directly determining the overall performance of all-in-one image restoration models. To this end, we propose a high-capacity diffusion-based image restoration foundation model, FoundIR-v2, which adopts a data equilibrium scheduling paradigm to dynamically optimize the proportions of mixed training datasets from different tasks. By leveraging the data mixing law, our method ensures a balanced dataset composition, enabling the model to achieve consistent generalization and comprehensive performance across diverse tasks. Furthermore, we introduce an effective Mixture-of-Experts (MoE)-driven scheduler into generative pre-training to flexibly allocate task-adaptive diffusion priors for each restoration task, accounting for the distinct degradation forms and levels exhibited by different tasks. Extensive experiments demonstrate that our method can address over 50 sub-tasks across a broader scope of real-world scenarios and achieves favorable performance against state-of-the-art approaches.

Key facts. Cited by 9 papers in the map (data through 7 Oct 2026). Placed in Inverse problems and image restoration, one of 14 directions in Diffusion models. Builds on 52 of its 64 references that are in the map. First posted on arXiv 10 Dec 2025.

Builds on

52 of 64 references.

Closest ancestors · 10

Same direction, newest first

  1. 2025Harnessing Diffusion-Yielded Score Priors for Image Restoration28 Jul
  2. 2025Elucidating and Endowing the Diffusion Training Paradigm for General Image Restoration26 Jun
  3. 2024GenDeg: Diffusion-based Degradation Synthesis for Generalizable All-In-One Image Restoration26 Nov
  4. 2024DreamClear: High-Capacity Real-World Image Restoration with Privacy-Safe Dataset Curation24 Oct
  5. 2024One-Step Effective Diffusion Network for Real-World Image Super-Resolution12 Jun
  6. 2024Selective Hourglass Mapping for Universal Image Restoration Based on Diffusion Model17 Mar
  7. 2023SeeSR: Towards Semantics-Aware Real-World Image Super-Resolution27 Nov
  8. 2023AutoDIR: Automatic All-in-One Image Restoration with Latent Diffusion16 Oct
  9. 2023Pixel-Aware Stable Diffusion for Realistic Image Super-resolution and Personalized Stylization28 Aug
  10. 2023Exploiting Diffusion Prior for Real-World Image Super-Resolution11 May

Other references · 42

  1. 2017Attention Is All You Needcited by 59,932
  2. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  3. 2023Visual Instruction Tuningcited by 7,792
  4. 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
  5. 2022Classifier-Free Diffusion Guidancecited by 5,717
  6. 2016SGDR: Stochastic Gradient Descent with Warm Restartscited by 4,993
  7. 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,290
  8. 2022Elucidating the Design Space of Diffusion-Based Generative Modelscited by 2,994
  9. 2021Restormer: Efficient Transformer for High-Resolution Image Restorationcited by 1,618
  10. 2017Enhanced Deep Residual Networks for Single Image Super-Resolutioncited by 1,543
  11. 2024Depth Anything: Unleashing the Power of Large-Scale Unlabeled Datacited by 1,346
  12. 2021MUSIQ: Multi-scale Image Quality Transformercited by 1,058
30 more
  1. 2022Exploring CLIP for Assessing the Look and Feel of Imagescited by 974
  2. 2021Real-ESRGAN: Training Real-World Blind Super-Resolution with Pure Synthetic Datacited by 961
  3. 2020Pre-Trained Image Processing Transformercited by 891
  4. 2021Designing a Practical Degradation Model for Deep Blind Image Super-Resolutioncited by 524
  5. 2022MANIQA: Multi-dimension Attention Network for No-Reference Image Quality Assessmentcited by 514
  6. 2024Scaling Up to Excellence: Practicing Model Scaling for Photo-Realistic Image Restoration In the Wildcited by 281
  7. 2021TransWeather: Transformer-based Restoration of Images Degraded by Adverse Weather Conditionscited by 243
  8. 2019From Patches to Pictures (PaQ-2-PiQ): Mapping the Perceptual Space of Picture Qualitycited by 221
  9. 2023Learning A Sparse Transformer Network for Effective Image Derainingcited by 204
  10. 2023Image Restoration with Mean-Reverting Stochastic Differential Equationscited by 182
  11. 2024InstructIR: High-Quality Image Restoration Following Human Instructionscited by 139
  12. 2020NH-HAZE: An Image Dehazing Benchmark with Non-Homogeneous Hazy and Haze-Free Imagescited by 108
  13. 2019Dense Haze: A benchmark for image dehazing with dense-haze and haze-free imagescited by 107
  14. 2023Depicting Beyond Scores: Advancing Image Quality Assessment through Multi-modal Language Modelscited by 104
  15. 2023Embedding Fourier for Ultra-High-Definition Low-Light Image Enhancementcited by 86
  16. 2018Real-world Noisy Image Denoising: A New Benchmarkcited by 74
  17. 2024Complexity Experts are Task-Discriminative Learners for Any Image Restorationcited by 72
  18. 2023A Comparative Study of Image Restoration Networks for General Backbone Network Designcited by 56
  19. 2024Towards Effective Multiple-in-One Image Restoration: A Sequential and Prompt Learning Strategycited by 48
  20. 2024An Intelligent Agentic System for Complex Image Restoration Problemscited by 41
  21. 2024FoundIR: Unleashing Million-scale Training Data to Advance Foundation Models for Image Restorationcited by 37
  22. 2023Towards Unified Deep Image Deraining: A Survey and A New Benchmarkcited by 34
  23. 2021MC-Blur: A Comprehensive Benchmark for Image Deblurringcited by 27
  24. 2025WeatherBench: A Real-World Benchmark Dataset for All-in-One Adverse Weather Image Restorationcited by 20
  25. 2024Learning A Low-Level Vision Generalist via Visual Task Promptcited by 18
  26. 2024UAV-Rain1k: A Benchmark for Raindrop Removal from UAV Aerial Imagerycited by 15
  27. 2025Lumina-OmniLV: A Unified Multimodal Framework for General Low-Level Visioncited by 14
  28. 2024GRIDS: Grouped Multiple-Degradation Restoration with Image Degradation Similaritycited by 12
  29. 2025IDEAL: Data Equilibrium Adaptation for Multi-Capability Language Model Alignmentcited by 8
  30. 2025Rethinking Nighttime Image Deraining via Learnable Color Space Transformationcited by 5

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 9.

9 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2023Parameter Efficient Adaptation for Image Restoration with Heterogeneous Mixture-of-Experts
  2. 2024Training-Free Large Model Priors for Multiple-in-One Image Restoration
  3. 2024Decoupled Data Consistency with Diffusion Purification for Image Restoration
  4. 2023HQ-50K: A Large-scale, High-quality Dataset for Image Restoration
  5. 2024ReFIR: Grounding Large Restoration Models with Retrieval Augmentation
  6. 2026Noise-Free One-Step LoRA for Task-Driven Image Restoration with Diffusion Priors
  7. 2025UniRes: Universal Image Restoration for Complex Degradations
  8. 2024Consistent Diffusion: Denoising Diffusion Model with Data-Consistent Training for Image Restoration