Grounding Free-Form Instructions for Fashion Complementary Image Generation
Not on the map. Why?
Abstract (arXiv)
Fashion complementary image generation (CIG) aims to create garments that stylistically match a seed item based on user intent, making it a natural multimodal grounding problem where models must interpret language in visual context. Existing CIG benchmarks rely on rigid template prompts (e.g., "a photo of a skirt"), failing to reflect natural user queries and obscuring model behavior across levels of linguistic specificity. We introduce fashion complementary image generation with free-form instructions, a multimodal language-grounding setting where a model generates a compatible garment from a seed image and a natural-language instruction. To this end, we enrich three CIG benchmarks with low-, medium-, and high-specificity instructions generated by a vision-language model and validated by human annotators. We instantiate the task with StyleFlow, a Rectified Flow Matching model that jointly conditions on the seed image and instruction within a single multimodal transformer. Across image quality metrics, catalog-alignment analysis, ablations, and human evaluation, StyleFlow consistently produces instruction-aligned and stylistically coherent garments while reducing architectural complexity and inference cost relative to auxiliary-module approaches.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 22 of its 40 references that are in the map. First posted on arXiv 24 Aug 2026.
Builds on
22 of 40 references.
References · 22
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
- 2022Generative Adversarial Networkscited by 5,603
- 2015Rethinking the Inception Architecture for Computer Visioncited by 5,451
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
- 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,550
- 2023Sigmoid Loss for Language Image Pre-Trainingcited by 3,048
- 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,591
- 2021CLIPScore: A Reference-free Evaluation Metric for Image Captioningcited by 2,388
- 2018Demystifying MMD GANscited by 1,268
- 2018Which Training Methods for GANs do actually Converge?cited by 672
10 more
- 2021VITON-HD: High-Resolution Virtual Try-On via Misalignment-Aware Normalizationcited by 287
- 2022Dress Code: High-Resolution Multi-Category Virtual Try-Oncited by 161
- 2023LaDI-VTON: Latent Diffusion Textual-Inversion Enhanced Virtual Try-Oncited by 151
- 2023Multimodal Garment Designer: Human-Centric Latent Diffusion Models for Fashion Image Editingcited by 62
- 2017Visually-Aware Fashion Recommendation and Design with Generative Image Modelscited by 43
- 2024Diffusion Models for Generative Outfit Recommendationcited by 29
- 2022A Review of Modern Fashion Recommender Systemscited by 25
- 2018Explainable Outfit Recommendation with Joint Outfit Matching and Comment Generationcited by 16
- 2024HieraFashDiff: Hierarchical Fashion Design with Multi-stage Diffusion Modelscited by 6
- 2023Semi-supervised Adversarial Learning for Complementary Item Recommendationcited by 5
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026VersaVogue: Visual Expert Orchestration and Preference Alignment for Unified Fashion Synthesis
- 2026GarmentSketch: Large-scale Sketch-to-Fashion Benchmark
- 2024ChatGarment: Garment Estimation, Generation and Editing via Large Language Models
- 2024GarmentAligner: Text-to-Garment Generation via Retrieval-augmented Multi-level Corrections
- 2025EditGarment: An Instruction-Based Garment Editing Dataset Constructed with Automated MLLM Synthesis and Semantic-Aware Evaluation
- 2026Multi-Level Conditioning by Pairing Localized Text and Sketch for Fashion Image Generation
- 2023Fashion Matrix: Editing Photos by Just Talking
- 2024UniFashion: A Unified Vision-Language Model for Multimodal Fashion Retrieval and Generation