mlsanityData to 14 Oct 2026

RefGC-SR2: Reference-guided Super-Resolution and Refinement of AI Generated Content

arXiv 2606.15158 ↗First posted 13 Jun 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Reference-guided generation (e.g., object compositing, customization) has progressed rapidly, yet current pipelines share a fundamental limitation: the object-centric high-resolution reference image (HRRI) provided by users is downsampled to a fixed low-resolution (LR) before being fed into the model, so the fine-grained details are discarded before the output is even produced. In addition, the generation step then introduces its own artifacts (e.g., identity distortion) on top of this loss. Existing reference-guided generated content refinement (RefGCR) methods can correct some of these artifacts but still operate in the LR domain; reference-guided super-resolution (RefSR) methods recover resolution but assume natural-image degradations and ignore the artifact distribution of generative pipelines. To address both gaps in a single formulation, we introduce a new task: reference-guided generated content super-resolution-refinement (RefGC-SR2), where the original HRRI is reused at the post-processing stage to recover lost details, refine generative artifacts, and upscale the output simultaneously. We construct the first real-world triplet data generation pipeline for this RefGC-SR2 task, training a diptych-conditioned generator to synthesize paired low-quality anchors that public pretrained models cannot provide. We further present a frequency-aware diffusion transformer model for RefGC-SR2 that selectively injects fine details from the HRRI while removing generative artifacts. Extensive experiments demonstrate that our RefGC-SR2 model successfully (i) refines the object identity faithfully with respect to the reference, and (ii) recovers high-resolution details, so that the final result is significantly higher quality and practically more usable compared to existing RefGCR and RefSR baselines.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 46 of its 63 references that are in the map. First posted on arXiv 13 Jun 2026.

Builds on

46 of 63 references.

References · 46

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  3. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
  4. 2022Flow Matching for Generative Modelingcited by 5,702
  5. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
  6. 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,300
  7. 2025Qwen3-VL Technical Reportcited by 2,793
  8. 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,611
  9. 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Modelscited by 1,464
  10. 2025Qwen-Image Technical Reportcited by 1,044
  11. 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Spacecited by 1,006
  12. 2024Grounding Image Matching in 3D with MASt3Rcited by 983
34 more
  1. 2025SAM 3: Segment Anything with Conceptscited by 906
  2. 2022Paint by Example: Exemplar-based Image Editing with Diffusion Modelscited by 489
  3. 2023AnyDoor: Zero-shot Object-level Image Customizationcited by 412
  4. 2021ABO: Dataset and Benchmarks for Real-World 3D Object Understandingcited by 366
  5. 2024OminiControl: Minimal and Universal Control for Diffusion Transformercited by 340
  6. 2015On Wasserstein Two Sample Testing and Related Families of Nonparametric Testscited by 166
  7. 2025Less-to-More Generalization: Unlocking More Controllability by In-Context Generationcited by 154
  8. 2017Demystifying Neural Style Transfercited by 152
  9. 2024DreamBench++: A Human-Aligned Benchmark for Personalized Image Generationcited by 131
  10. 2023DemoFusion: Democratising High-Resolution Image Generation With No cited by 107
  11. 2022High-Quality Entity Segmentationcited by 93
  12. 2024TSD-SR: One-Step Diffusion with Target Score Distillation for Real-World Image Super-Resolutioncited by 87
  13. 2024Zero-shot Image Editing with Reference Imitationcited by 65
  14. 2025Insert Anything: Image Insertion via In-Context Editing in DiTcited by 61
  15. 2025UltraVideo: High-Quality UHD Video Dataset with Comprehensive Captionscited by 57
  16. 2024Large-Scale Text-to-Image Model with Inpainting is a Zero-Shot Subject-Driven Image Generatorcited by 48
  17. 2025OmniPaint: Mastering Object-Oriented Editing via Disentangled Insertion-Removal Inpaintingcited by 39
  18. 2024MagicQuill: An Intelligent Interactive Image Editing Systemcited by 30
  19. 2025Latent Space Super-Resolution for Higher-Resolution Image Generation with Diffusion Modelscited by 25
  20. 2025Personalize Anything for Free with Diffusion Transformercited by 23
  21. 2025UnCommon Objects in 3Dcited by 17
  22. 2024ReFIR: Grounding Large Restoration Models with Retrieval Augmentationcited by 15
  23. 2024Is One GPU Enough? Pushing Image Generation at Higher-Resolutions with Foundation Modelscited by 14
  24. 2025DreamFuse: Adaptive Image Fusion with Diffusion Transformercited by 13
  25. 2025ORIDa: Object-centric Real-world Image Composition Datasetcited by 11
  26. 2025Multitwine: Multi-Object Compositing with Text and Layout Controlcited by 9
  27. 2024RefQSR: Reference-based Quantization for Image Super-Resolution Networkscited by 8
  28. 2024Refine-by-Align: Reference-Guided Artifacts Refinement through Semantic Alignmentcited by 5
  29. 2025The Consistency Critic: Correcting Inconsistencies in Generated Images via Reference-Guided Attentive Alignmentcited by 5
  30. 2026Trust but Verify: Adaptive Conditioning for Reference-Based Diffusion Super-Resolution via Implicit Reference Correlation Modelingcited by 5
  31. 2026RefineAnything: Multimodal Region-Specific Refinement for Perfect Local Detailscited by 5
  32. 2025AIComposer: Any Style and Content Image Composition via Feature Integrationcited by 4
  33. 2025FreeCus: Free Lunch Subject-driven Customization in Diffusion Transformerscited by 3
  34. 2025FRAMER: Frequency-Aligned Self-Distillation with Adaptive Modulation Leveraging Diffusion Priors for Real-World Image Super-Resolutioncited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2021Robust Reference-based Super-Resolution via C2-Matching
  2. 2022Reference-based Image and Video Super-Resolution via C2-Matching
  3. 2025Ultra-High-Definition Reference-Based Landmark Image Super-Resolution with Generative Diffusion Prior
  4. 2024Detail-Enhancing Framework for Reference-Based Image Super-Resolution
  5. 2026RefSR-Adv: Adversarial Attack on Reference-based Image Super-Resolution Models
  6. 2026RefDiT: Local Attribute Guidance in Reference-Based Image Generation
  7. 2024ResMaster: Mastering High-Resolution Image Generation via Structural and Fine-Grained Guidance
  8. 2025OmniRefiner: Reinforcement-Guided Local Diffusion Refinement