FashionFlow: Leveraging Diffusion Models for Dynamic Fashion Video Synthesis from Static Imagery
On the map: Diffusion models → 3D, point cloud and scene generation
Abstract (arXiv)
Our study introduces a new image-to-video generator called FashionFlow to generate fashion videos. By utilising a diffusion model, we are able to create short videos from still fashion images. Our approach involves developing and connecting relevant components with the diffusion model, which results in the creation of high-fidelity videos that are aligned with the conditional image. The components include the use of pseudo-3D convolutional layers to generate videos efficiently. VAE and CLIP encoders capture vital characteristics from still images to condition the diffusion model at a global level. Our research demonstrates a successful synthesis of fashion videos featuring models posing from various angles, showcasing the fit and appearance of the garment. Our findings hold great promise for improving and enhancing the shopping experience for the online fashion industry.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in 3D, point cloud and scene generation, one of 14 directions in Diffusion models. Builds on 58 of its 77 references that are in the map. First posted on arXiv 29 Sep 2023.
Builds on
58 of 77 references.
Closest ancestors · 3
Same direction, newest first
- 2023DreamPose: Fashion Image-to-Video Synthesis via Stable Diffusion12 Apr
- 2023DiffFashion: Reference-based Fashion Design with Structure-aware Transfer by Diffusion Models14 Feb
- 2022Person Image Synthesis via Denoising Diffusion Model22 Nov
Other references · 55
- 2017Attention Is All You Needcited by 59,932
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
- 2014Going Deeper with Convolutionscited by 4,231
- 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,067
- 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,736
- 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,580
38 more
- 2017Quo Vadis, Action Recognition? A New Model and the Kinetics Datasetcited by 3,259
- 2016Improved Techniques for Training GANscited by 2,938
- 2016Xception: Deep Learning with Depthwise Separable Convolutionscited by 2,320
- 2022Video Diffusion Modelscited by 2,280
- 2014Conditional Generative Adversarial Netscited by 2,152
- 2022Imagen Video: High Definition Video Generation with Diffusion Modelscited by 1,765
- 2022Make-A-Video: Text-to-Video Generation without Text-Video Datacited by 1,725
- 2023Align your Latents: High-Resolution Video Synthesis with Latent Diffusion Modelscited by 1,465
- 2021Palette: Image-to-Image Diffusion Modelscited by 1,296
- 2018Towards Accurate Generative Models of Video: A New Metric & Challengescited by 1,204
- 2020Training Generative Adversarial Networks with Limited Datacited by 1,184
- 2017A Closer Look at Spatiotemporal Convolutions for Action Recognitioncited by 1,139
- 2022Diffusion Models in Vision: A Surveycited by 1,008
- 2022Tune-A-Video: One-Shot Tuning of Image Diffusion Models for Text-to-Video Generationcited by 958
- 2015Image-based Recommendations on Styles and Substitutescited by 702
- 2023Structure and Content-Guided Video Synthesis with Diffusion Modelscited by 589
- 2017MoCoGAN: Decomposing Motion and Content for Video Generationcited by 523
- 2022Phenaki: Variable Length Video Generation From Open Domain Textual Descriptioncited by 475
- 2022MagicVideo: Efficient Video Generation With Latent Diffusion Modelscited by 463
- 2016Generating Videos with Scene Dynamicscited by 376
- 2023VideoFusion: Decomposed Diffusion Models for High-Quality Video Generationcited by 330
- 2021StyleGAN-V: A Continuous Video Generator with the Price, Image Quality and Perks of StyleGAN2cited by 300
- 2021VITON-HD: High-Resolution Virtual Try-On via Misalignment-Aware Normalizationcited by 287
- 2017VITON: An Image-based Virtual Try-on Networkcited by 285
- 2023Preserve Your Own Correlation: A Noise Prior for Video Diffusion Modelscited by 284
- 2017Pose Guided Person Image Generationcited by 251
- 2021Attention Mechanisms in Computer Vision: A Surveycited by 232
- 2018Toward Characteristic-Preserving Image-based Virtual Try-On Networkcited by 192
- 2019Liquid Warping GAN: A Unified Framework for Human Motion Imitation, Appearance Transfer and Novel View Synthesiscited by 161
- 2020Towards Photo-Realistic Virtual Try-On by Adaptively GeneratingleftrightarrowPreserving Image Contentcited by 148
- 2018StoryGAN: A Sequential Conditional GAN for Story Visualizationcited by 137
- 2019DwNet: Dense warp-based network for pose-guided human video generationcited by 114
- 2019Towards Multi-pose Guided Virtual Try-on Networkcited by 95
- 2018Recycle-GAN: Unsupervised Video Retargetingcited by 89
- 2021Stochastic Image-to-Video Synthesis using cINNscited by 49
- 2017TextureGAN: Controlling Deep Image Synthesis with Texture Patchescited by 47
- 2021Understanding Object Dynamics for Interactive Image-to-Video Synthesiscited by 38
- 2019Mocycle-GAN: Unpaired Video-to-Video Translationcited by 37
50 most cited of 55 All 55 (JSON)
Built on by
Citing papers per year: 2025: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2024DiffusionTrend: A Minimalist Approach to Virtual Fashion Try-On
- 2024FashionSD-X: Multimodal Fashion Garment Synthesis using Latent Diffusion
- 2023SGDiff: A Style Guided Diffusion Model for Fashion Synthesis
- 2024Fashion-VDM: Video Diffusion Model for Virtual Try-On
- 2024Fashionability-Enhancing Outfit Image Editing with Conditional Diffusion Models
- 2024VITON-DiT: Learning In-the-Wild Video Try-On from Human Dance Videos via Diffusion Transformers
- 2023Multimodal Garment Designer: Human-Centric Latent Diffusion Models for Fashion Image Editing
- 2024StableGarment: Garment-Centric Generation via Stable Diffusion