MOSAIC: Multi-Scale Object-Centric Slot Adaptation with Image-Guided Prototype Conditioning for Remote Sensing Image Super-Resolution
On the map: Diffusion models → Inverse problems and image restoration
Abstract (arXiv)
Pretrained diffusion Transformers provide powerful generative priors for image restoration, yet adapting them to structure-sensitive tasks remains challenging. Existing methods mainly rely on dense low-resolution features as conditions, which often entangle salient objects with dominant backgrounds and provide limited abstraction for recurring structures across scales and samples. We propose MOSAIC, an object-centric representation learning framework that learns compact structural conditions for generative model adaptation. MOSAIC organizes degraded observations into structural slots that capture complementary object-level and layout-level evidence, integrates them across resolutions, and retrieves recurring priors from a shared prototype memory to complement incomplete image-specific information. The resulting representations are injected into selected layers of a frozen diffusion Transformer through lightweight residual modulation, preserving its pretrained generative prior. We instantiate MOSAIC for remote sensing image super-resolution, where small objects, repetitive structures, and large-scale variation provide a challenging testbed. Experiments on UCMerced, AID, and RSSCN7 show consistent PSNR improvements across × 2 and × 4 settings and favorable LPIPS results at × 4. Qualitative results further demonstrate improved preservation of small objects, structural boundaries, and repetitive spatial patterns.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Inverse problems and image restoration, one of 14 directions in Diffusion models. Builds on 30 of its 37 references that are in the map. First posted on arXiv 9 Oct 2026.
Builds on
30 of 37 references.
Closest ancestors · 6
Same direction, newest first
- 2026DNF-SR: Dual-Input and Negative-Aware Feature Fine-Tuning for Real-World Image Super-Resolution14 Sep
- 2026VOSR: A Vision-Only Generative Model for Image Super-Resolution3 Apr
- 2026Continuous Degradation Modeling via Latent Flow Matching for Real-World Super-Resolution4 Feb
- 2025DiT4SR: Taming Diffusion Transformer for Real-World Image Super-Resolution30 Mar
- 2024TSD-SR: One-Step Diffusion with Target Score Distillation for Real-World Image Super-Resolution27 Nov
- 2023SinSR: Diffusion-Based Image Super-Resolution in a Single Step23 Nov
Other references · 24
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 2020Denoising Diffusion Implicit Modelscited by 9,781
- 2022Scalable Diffusion Models with Transformerscited by 6,054
- 2017Neural Discrete Representation Learningcited by 4,712
- 2020Taming Transformers for High-Resolution Image Synthesiscited by 3,253
- 2021SwinIR: Image Restoration Using Swin Transformercited by 1,887
- 2017Enhanced Deep Residual Networks for Single Image Super-Resolutioncited by 1,552
- 2021Image Super-Resolution via Iterative Refinementcited by 1,511
- 2019Generating Diverse High-Fidelity Images with VQ-VAE-2cited by 1,387
- 2018Image Super-Resolution Using Very Deep Residual Channel Attention Networkscited by 1,264
12 more
- 2022Exploring CLIP for Assessing the Look and Feel of Imagescited by 991
- 2020Pre-Trained Image Processing Transformercited by 893
- 2020Object-Centric Learning with Slot Attentioncited by 876
- 2022MANIQA: Multi-dimension Attention Network for No-Reference Image Quality Assessmentcited by 522
- 2022Activating More Pixels in Image Super-Resolution Transformercited by 438
- 2019MONet: Unsupervised Scene Decomposition and Representationcited by 392
- 2019Multi-Object Representation Learning with Iterative Variational Inferencecited by 360
- 2016AID: A Benchmark Dataset for Performance Evaluation of Aerial Scene Classificationcited by 347
- 2022Hitchhiker's Guide to Super-Resolution: Introduction and Recent Advancescited by 22
- 2023Learning Many-to-Many Mapping for Unpaired Real-World Image Super-resolution and Downscalingcited by 7
- 2024Multi-Scale Fusion for Object Representationcited by 7
- 2025Smoothing Slot Attention Iterations and Recurrencescited by 6
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026InfScene-SR: Seamless Super-Resolution of Arbitrarily Large Remote-Sensing Scenes via Variance-Preserving Joint Denoising
- 2026Learning to Balance: Decoupled Siamese Diffusion Transformer for Reference-Based Remote Sensing Image Super-Resolution
- 2026SHARP: Spectrum-aware Highly-dynamic Adaptation for Resolution Promotion in Remote Sensing Synthesis
- 2026SlimDiffSR: Toward Lightweight and Efficient Remote Sensing Image Super-Resolution via Diffusion Model Distillation
- 2024Semantic Guided Large Scale Factor Remote Sensing Image Super-resolution with Generative Diffusion Prior
- 2023EDiffSR: An Efficient Diffusion Probabilistic Model for Remote Sensing Image Super-Resolution
- 2024Building Bridges across Spatial and Temporal Resolutions: Reference-Based Super-Resolution via Change Priors and Conditional Diffusion Model
- 2025COP-GEN-Beta: Unified Generative Modelling of COPernicus Imagery Thumbnails