DetailAnywhere: Fashion Detail Generation via Cross-Modal Feature Alignment Distillation
On the map: Diffusion models → 3D, point cloud and scene generation
Abstract (arXiv)
Diffusion-based generative AI has achieved remarkable success in e-commerce applications such as virtual try-on, poster generation, and product background synthesis. However, when making online purchasing decisions for apparel, consumers also desire the freedom to examine specific detail regions of interest, such as collars, cuffs, and fabric textures, yet existing methods have not explicitly studied this setting. We therefore formalize a new, non-template task: Fashion Detail Generation with focus conditioning, and release FDBench, the first benchmark comprising 40K+ human-verified reference-detail pairs across 41 different categories. This task poses a unique semantic gap challenge: the model must bridge the correspondence between a focus marker on a product reference image and a photorealistic close-up view of the indicated region, while faithfully preserving the garment's identity, without any precise prompt. To bridge this gap, we propose Cross-modal Feature Alignment Distillation (CFAD), which leverages a fine-tuned DINOv3 teacher to align both branches of a Multimodal Diffusion Transformer in a shared semantic space via dual-branch distillation. To further improve consistency between generated details and reference images, we introduce a consistency reward model that jointly scores image pairs along three quality axes and optimizes generation via reinforcement learning. Experiments show that our model DetailAnywhere significantly outperforms all state-of-the-art opensource methods across all metrics and human evaluations.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Placed in 3D, point cloud and scene generation, one of 14 directions in Diffusion models. Builds on 65 of its 77 references that are in the map. First posted on arXiv 2 Jul 2026.
Builds on
65 of 77 references.
Closest ancestors · 10
Same direction, newest first
- 2025DiffPCN: Latent Diffusion Model Based on Multi-view Depth Images for Point Cloud Completion28 Sep
- 2025From Editor to Dense Geometry Estimator4 Sep
- 2025Jasmine: Harnessing Diffusion Prior for Self-supervised Depth Estimation20 Mar
- 2024CatVTON: Concatenation Is All You Need for Virtual Try-On with Diffusion Models21 Jul
- 2024Digging into contrastive learning for robust depth estimation with diffusion models15 Apr
- 2024Texture-Preserving Diffusion Models for High-Fidelity Virtual Try-On1 Apr
- 2024Improving Diffusion Models for Authentic Virtual Try-on in the Wild8 Mar
- 2023StableVITON: Learning Semantic Correspondence with Latent Diffusion Model for Virtual Try-On4 Dec
- 2023LaDI-VTON: Latent Diffusion Textual-Inversion Enhanced Virtual Try-On22 May
- 2023Multimodal Garment Designer: Human-Centric Latent Diffusion Models for Fashion Image Editing4 Apr
Other references · 55
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 2015Distilling the Knowledge in a Neural Networkcited by 10,076
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,893
- 2022Scalable Diffusion Models with Transformerscited by 5,931
- 2022Classifier-Free Diffusion Guidancecited by 5,717
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
38 more
- 2022Flow Matching for Generative Modelingcited by 5,426
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
- 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,591
- 2025Qwen3-VL Technical Reportcited by 2,534
- 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,903
- 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Modelscited by 1,439
- 2025DINOv3cited by 1,297
- 2023ImageReward: Learning and Evaluating Human Preferences for Text-to-Image Generationcited by 1,010
- 2025Qwen-Image Technical Reportcited by 973
- 2023Training Diffusion Models with Reinforcement Learningcited by 939
- 2023Human Preference Score v2: A Solid Benchmark for Evaluating Human Preferences of Text-to-Image Synthesiscited by 847
- 2023Attend-and-Excite: Attention-Based Semantic Guidance for Text-to-Image Diffusion Modelscited by 696
- 2017DeepFM: A Factorization-Machine based Neural Network for CTR Predictioncited by 673
- 2024Representation Alignment for Generation: Training Diffusion Transformers Is Easier Than You Thinkcited by 666
- 2023Emergent Correspondence from Image Diffusioncited by 437
- 2023DPOK: Reinforcement Learning for Fine-tuning Text-to-Image Diffusion Modelscited by 431
- 2025Step1X-Edit: A Practical Framework for General Image Editingcited by 417
- 2021VITON-HD: High-Resolution Virtual Try-On via Misalignment-Aware Normalizationcited by 287
- 2025Diffusion Transformers with Representation Autoencoderscited by 275
- 2025ImgEdit: A Unified Image Editing Dataset and Benchmarkcited by 225
- 2025REPA-E: Unlocking VAE for End-to-End Tuning with Latent Diffusion Transformerscited by 212
- 2025DiffusionNFT: Online Diffusion Reinforcement with Forward Processcited by 204
- 2025In-Context Edit: Enabling Instructional Image Editing with In-Context Generation in Large Scale Diffusion Transformercited by 199
- 2025HPSv3: Towards Wide-Spectrum Human Preference Scorecited by 196
- 2015Cross Modal Distillation for Supervision Transfercited by 173
- 2023TryOnDiffusion: A Tale of Two UNetscited by 141
- 2023Denoising Diffusion Autoencoders are Unified Self-supervised Learnerscited by 128
- 2025EditScore: Unlocking Online RL for Image Editing via High-Fidelity Reward Modelingcited by 61
- 2025EditReward: A Human-Aligned Reward Model for Instruction-Guided Image Editingcited by 59
- 2025VLM-R3: Region Recognition, Reasoning, and Refinement for Enhanced Multimodal Chain-of-Thoughtcited by 47
- 2025PosterMaker: Towards High-Quality Product Poster Generation with Accurate Text Renderingcited by 41
- 2026FireRed-Image-Edit-1.0 Technical Reportcited by 31
- 2025Aligning Text to Image in Diffusion Models is Easier Than You Thinkcited by 21
- 2025Multimodal Representation Alignment for Image Generation: Text-Image Interleaved Control Is Easier Than You Thinkcited by 18
- 2025SymmCompletion: High-Fidelity and High-Consistency Point Cloud Completion with Symmetry Guidancecited by 15
- 2025Sculpting Features from Noise: Reward-Guided Hierarchical Diffusion for Task-Optimal Feature Transformationcited by 13
- 2024Text Embedding is Not All You Need: Attention Control for Text-to-Image Semantic Alignment with Text Self-Attention Mapscited by 12
- 2026PosterOmni: Generalized Artistic Poster Creation via Task Distillation and Unified Reward Feedbackcited by 8
50 most cited of 55 All 55 (JSON)
Built on by
Citing papers per year: 2026: 3.
3 papers.
Similar, not cited
Close in wording, no citation either way
- 2023DiffCloth: Diffusion Based Garment Synthesis and Manipulation via Structural Cross-modal Semantic Alignment
- 2024DPDEdit: Detail-Preserved Diffusion Models for Multimodal Fashion Image Editing
- 2024FashionSD-X: Multimodal Fashion Garment Synthesis using Latent Diffusion
- 2025HiGarment: Cross-modal Harmony Based Diffusion Model for Flat Sketch to Realistic Garment Image
- 2026VersaVogue: Visual Expert Orchestration and Preference Alignment for Unified Fashion Synthesis
- 2024GarmentAligner: Text-to-Garment Generation via Retrieval-augmented Multi-level Corrections
- 2025Fashion-RAG: Multimodal Fashion Image Editing via Retrieval-Augmented Generation
- 2023DiffFashion: Reference-based Fashion Design with Structure-aware Transfer by Diffusion Models