mlsanityData to 14 Oct 2026

RAGDiffusion++: From Macro-Retrieval to Micro-Fidelity Alignment for Garment Generation

arXiv 2608.29280 ↗First posted 29 Aug 2026cs.CV cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Standard clothing asset generation---restoring forward-facing flat-lay garment images from diverse real-world contexts---holds immense commercial value yet demands both macroscopic topological accuracy and microscopic physical fidelity. Although our previous work RAGDiffusion effectively eradicated large-scale structural hallucinations via retrieval-augmented macro-constraints, achieving industrial-grade micro-texture realism remains an unsolved bottleneck. We formally identify this limitation as High-Frequency Trajectory Collapse: supervised fine-tuning (SFT) converges to the conditional mean of the training distribution, which is dominated by smooth, low-frequency textures, causing high-frequency patterns (e.g., fabric weaves, intricate logos) to become nearly un-sampleable. Naively applying Reinforcement Learning (RL) post-training further triggers Artifact Hacking, where models exploit semantic biases in generic reward models by generating deceptive checkerboard noise. Our key insight is that RL can fundamentally reshape the sampling distribution of flow models---elevating the probability of high-fidelity trajectories under accurate reward guidance---while adversarial regularization prevents exploitation of reward blind spots. Realizing this principle requires three prerequisites: (i)inherent capacity, established through a 27,725-pair high-complexity garment dataset (STGarment-Plus) and a Dual-Image-Stream FLUX architecture upgrade; (ii)perceptive reward, provided by a novel attribute-aware reward model (Garment-RM) trained on 500K images via fine-grained contrastive learning, achieving 84.67% human preference accuracy; and (iii)hacking prevention, enforced by our Adversarial-Regularized GRPO (AR-GRPO) strategy that integrates a dynamic discriminator into the RL sampling trajectory to penalize artifacts while enriching authentic high-frequency details.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 57 of its 70 references that are in the map. First posted on arXiv 29 Aug 2026.

Builds on

57 of 70 references.

References · 57

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  4. 2023GPT-4 Technical Reportcited by 18,396
  5. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 12,049
  6. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
  7. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
  8. 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,442
  9. 2022Flow Matching for Generative Modelingcited by 5,702
  10. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
  11. 2017Squeeze-and-Excitation Networkscited by 4,789
  12. 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,356
38 more
  1. 2016Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Networkcited by 1,908
  2. 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Modelscited by 1,464
  3. 2025DINOv3cited by 1,414
  4. 2023T2I-Adapter: Learning Adapters to Dig out More Controllable Ability for Text-to-Image Diffusion Modelscited by 1,351
  5. 2018Demystifying MMD GANscited by 1,293
  6. 2023ImageReward: Learning and Evaluating Human Preferences for Text-to-Image Generationcited by 1,045
  7. 2025Qwen-Image Technical Reportcited by 1,044
  8. 2023Training Diffusion Models with Reinforcement Learningcited by 982
  9. 2023Pick-a-Pic: An Open Dataset of User Preferences for Text-to-Image Generationcited by 977
  10. 2023Human Preference Score v2: A Solid Benchmark for Evaluating Human Preferences of Text-to-Image Synthesiscited by 890
  11. 2020Image Quality Assessment: Unifying Structure and Texture Similaritycited by 811
  12. 2023GLIGEN: Open-Set Grounded Text-to-Image Generationcited by 781
  13. 2023In-Context Retrieval-Augmented Language Modelscited by 702
  14. 2023Animate Anyone: Consistent and Controllable Image-to-Video Synthesis for Character Animationcited by 688
  15. 2025Flow-GRPO: Training Flow Matching Models via Online RLcited by 661
  16. 2017The Perception-Distortion Tradeoffcited by 587
  17. 2022Paint by Example: Exemplar-based Image Editing with Diffusion Modelscited by 489
  18. 2023DPOK: Reinforcement Learning for Fine-tuning Text-to-Image Diffusion Modelscited by 450
  19. 2025Step1X-Edit: A Practical Framework for General Image Editingcited by 429
  20. 2025DanceGRPO: Unleashing GRPO on Visual Generationcited by 413
  21. 2024OminiControl: Minimal and Universal Control for Diffusion Transformercited by 340
  22. 2023Training-Free Layout Control with Cross-Attention Guidancecited by 313
  23. 2021VITON-HD: High-Resolution Virtual Try-On via Misalignment-Aware Normalizationcited by 287
  24. 2023BoxDiff: Text-to-Image Synthesis with Training-Free Box-Constrained Diffusioncited by 282
  25. 2018Additive Margin Softmax for Face Verificationcited by 278
  26. 2022ReCo: Region-Controlled Text-to-Image Generationcited by 179
  27. 2025MixGRPO: Unlocking Flow-based GRPO Efficiency with Mixed ODE-SDEcited by 178
  28. 2024OOTDiffusion: Outfitting Fusion based Latent Diffusion for Controllable Virtual Try-oncited by 151
  29. 2023HumanSD: A Native Skeleton-Guided Diffusion Model for Human Image Generationcited by 105
  30. 2024CatVTON: Concatenation Is All You Need for Virtual Try-On with Diffusion Modelscited by 102
  31. 2025Reward Shaping to Mitigate Reward Hacking in RLHFcited by 88
  32. 2023Controllable Text-to-Image Generation with GPT-4cited by 59
  33. 2024DressCode: Autoregressively Sewing and Generating Garments from Text Guidancecited by 44
  34. 2024BooW-VTON: Boosting In-the-Wild Virtual Try-On via Mask-Free Pseudo Data Trainingcited by 37
  35. 2023Qualitative Failures of Image Generation Models and Their Application in Detecting Deepfakescited by 31
  36. 2025Directly Aligning the Full Diffusion Trajectory with Fine-Grained Human Preferencecited by 30
  37. 2025UniCombine: Unified Multi-Conditional Combination with Diffusion Transformercited by 26
  38. 2024AnyFit: Controllable Virtual Try-on for Any Combination of Attire Across Any Scenariocited by 23

50 most cited of 57 All 57 (JSON)

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2024FabricDiffusion: High-Fidelity Texture Transfer for 3D Garments Generation from In-The-Wild Clothing Images
  2. 2025DiffFit: Disentangled Garment Warping and Texture Refinement for Virtual Try-On
  3. 2026WearWow: Native 2K Multi-Garment Virtual Try-On via Adaptive Token Packing and Preference Alignment
  4. 2026GarmentPainter: Efficient 3D Garment Texture Synthesis with Character-Guided Diffusion Model
  5. 2025GarmentDiffusion: 3D Garment Sewing Pattern Generation with Multimodal Diffusion Transformers
  6. 2024StableGarment: Garment-Centric Generation via Stable Diffusion
  7. 2026OmniFabric: Coherent UV Space Texture Synthesis for 3D Garment Reconstruction
  8. 2024GarmentDreamer: 3DGS Guided Garment Synthesis with Diverse Geometry and Texture Details