Cross-Cultural Fashion Design via Interactive Large Language Models and Diffusion Models
On the map: Diffusion models → 3D, point cloud and scene generation
Abstract (arXiv)
Fashion content generation is an emerging area at the intersection of artificial intelligence and creative design, with applications ranging from virtual try-on to culturally diverse design prototyping. Existing methods often struggle with cultural bias, limited scalability, and alignment between textual prompts and generated visuals, particularly under weak supervision. In this work, we propose a novel framework that integrates Large Language Models (LLMs) with Latent Diffusion Models (LDMs) to address these challenges. Our method leverages LLMs for semantic refinement of textual prompts and introduces a weak supervision filtering module to effectively utilize noisy or weakly labeled data. By fine-tuning the LDM on an enhanced DeepFashion+ dataset enriched with global fashion styles, the proposed approach achieves state-of-the-art performance. Experimental results demonstrate that our method significantly outperforms baselines, achieving lower Frechet Inception Distance (FID) and higher Inception Scores (IS), while human evaluations confirm its ability to generate culturally diverse and semantically relevant fashion content. These results highlight the potential of LLM-guided diffusion models in driving scalable and inclusive AI-driven fashion innovation.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in 3D, point cloud and scene generation, one of 14 directions in Diffusion models. Builds on 25 of its 33 references that are in the map. First posted on arXiv 26 Jan 2025.
Builds on
25 of 33 references.
Closest ancestors · 3
Same direction, newest first
- 2024UniFashion: A Unified Vision-Language Model for Multimodal Fashion Retrieval and Generation21 Aug
- 2024Diffusion Models for Generative Outfit Recommendation27 Feb
- 2023Interactive Fashion Content Generation Using LLMs and Latent Diffusion Models15 May
Other references · 22
- 2023Smooth Diffusion: Crafting Smooth Latent Spaces in Diffusion Modelscited by 49
- 2024Rethinking Visual Dependency in Long-Context Reasoning for Large Vision-Language Modelscited by 42
- 2023Lost in Translation: Large Language Models in Non-English Content Analysiscited by 35
- 2024Goldfish: Monolingual Language Models for 350 Languagescited by 29
- 2023On the Robustness of Latent Diffusion Modelscited by 21
- 2022Cedille: A large autoregressive French language modelcited by 20
- 2024Hyperbolic Geometric Latent Diffusion Model for Graph Generationcited by 20
- 2024InsectMamba: Insect Pest Classification with State Space Modelcited by 11
- 2016Fashion DNA: Merging Content and Sales Data for Recommendation and Article Mappingcited by 10
- 2024Diffusion Model with Representation Alignment for Protein Inverse Foldingcited by 10
- 2023How Good are Commercial Large Language Models on African Languages?cited by 8
- 2024A Survey of Large Language Models for European Languagescited by 6
10 more
- 2022A Precis of Language Models are not Models of Languagecited by 4
- 2023Planning with Logical Graph-based Language Model for Instruction Generationcited by 4
- 2023FIRST: A Million-Entry Dataset for Text-Driven Fashion Synthesis and Designcited by 4
- 2024Towards diffusion models for large-scale sea-ice modellingcited by 4
- 2024Modelling Language using Large Language Modelscited by 2
- 2024LLaMA-Reg: Using LLaMA 2 for Unsupervised Medical Image Registrationcited by 2
- 2018"Woman-Metal-White vs Man-Dress-Shorts": Combining Social, Temporal and Image Signals to Understand Popularity of Pinterest Fashion Boardscited by 1
- 2022SnapMode: An Intelligent and Distributed Large-Scale Fashion Image Retrieval Platform Based On Big Data and Deep Generative Adversarial Network Technologiescited by 1
- 2023Beyond the limitations of any imaginable mechanism: large language models and psycholinguisticscited by 1
- 2024Advancing bioinformatics with large language models: components, applications and perspectivescited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2024FashionSD-X: Multimodal Fashion Garment Synthesis using Latent Diffusion
- 2023Multimodal Garment Designer: Human-Centric Latent Diffusion Models for Fashion Image Editing
- 2025Integrating Domain Knowledge into Large Language Models for Enhanced Fashion Recommendations
- 2023DiffCloth: Diffusion Based Garment Synthesis and Manipulation via Structural Cross-modal Semantic Alignment
- 2024Automatic Generation of Fashion Images using Prompting in Generative Machine Learning Models
- 2025LOTS of Fashion! Multi-Conditioning for Image Generation via Sketch-Text Pairing
- 2024Multimodal-Conditioned Latent Diffusion Models for Fashion Image Editing
- 2025Fine-Grained Customized Fashion Design with Image-into-Prompt benchmark and dataset from LMM