mlsanityData to 7 Oct 2026

DreamPose: Fashion Image-to-Video Synthesis via Stable Diffusion

arXiv 2304.06025 ↗First posted 12 Apr 2023cs.CVcited by 167

On the map: Diffusion models → 3D, point cloud and scene generation

Abstract (arXiv)

We present DreamPose, a diffusion-based method for generating animated fashion videos from still images. Given an image and a sequence of human body poses, our method synthesizes a video containing both human and fabric motion. To achieve this, we transform a pretrained text-to-image model (Stable Diffusion) into a pose-and-image guided video synthesis model, using a novel fine-tuning strategy, a set of architectural changes to support the added conditioning signals, and techniques to encourage temporal consistency. We fine-tune on a collection of fashion videos from the UBC Fashion dataset. We evaluate our method on a variety of clothing styles and poses, and demonstrate that our method produces state-of-the-art results on fashion video animation.Video results are available on our project page.

Key facts. Cited by 167 papers in the map (data through 7 Oct 2026). Placed in 3D, point cloud and scene generation, one of 14 directions in Diffusion models. Builds on 49 of its 59 references that are in the map. First posted on arXiv 12 Apr 2023.

Builds on

49 of 59 references.

Closest ancestors · 4

Same direction, newest first

  1. 2023DiffFashion: Reference-based Fashion Design with Structure-aware Transfer by Diffusion Models14 Feb
  2. 2022Person Image Synthesis via Denoising Diffusion Model22 Nov
  3. 2022Novel View Synthesis with Diffusion Models6 Oct
  4. 2022DreamFusion: Text-to-3D using 2D Diffusion29 Sep

Other references · 45

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  3. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
  4. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
  5. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,539
  6. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
  7. 2022Classifier-Free Diffusion Guidancecited by 5,717
  8. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
  9. 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,286
  10. 2016Perceptual Losses for Real-Time Style Transfer and Super-Resolutioncited by 2,678
  11. 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,591
  12. 2022Video Diffusion Modelscited by 2,280
33 more
  1. 2022Imagen Video: High Definition Video Generation with Diffusion Modelscited by 1,765
  2. 2022Make-A-Video: Text-to-Video Generation without Text-Video Datacited by 1,725
  3. 2018Towards Accurate Generative Models of Video: A New Metric & Challengescited by 1,204
  4. 2018OpenPose: Realtime Multi-Person 2D Pose Estimation using Part Affinity Fieldscited by 1,161
  5. 2022Tune-A-Video: One-Shot Tuning of Image Diffusion Models for Text-to-Video Generationcited by 958
  6. 2020First Order Motion Model for Image Animationcited by 698
  7. 2022Pseudo Numerical Methods for Diffusion Models on Manifoldscited by 695
  8. 2018DensePose: Dense Human Pose Estimation In The Wildcited by 573
  9. 2023Universal Guidance for Diffusion Modelscited by 426
  10. 2022Flexible Diffusion Modeling of Long Videoscited by 294
  11. 2021VITON-HD: High-Resolution Virtual Try-On via Misalignment-Aware Normalizationcited by 287
  12. 2021Motion Representations for Articulated Animationcited by 253
  13. 2022Diffusion Probabilistic Modeling for Video Generationcited by 237
  14. 2019Depth-Aware Video Frame Interpolationcited by 232
  15. 2022Thin-Plate Spline Motion Model for Image Animationcited by 209
  16. 2018Animating Arbitrary Objects via Deep Motion Transfercited by 206
  17. 2023Text-To-4D Dynamic Scene Generationcited by 204
  18. 2023Dreamix: Video Diffusion Models are General Video Editorscited by 189
  19. 2022Latent Image Animator: Learning to Animate Images via Latent Space Navigationcited by 172
  20. 2022FILM: Frame Interpolation for Large Motioncited by 149
  21. 2019Progressive Pose Attention Transfer for Person Image Generationcited by 138
  22. 2019DeepFashion2: A Versatile Benchmark for Detection, Pose Estimation, Segmentation and Re-Identification of Clothing Imagescited by 132
  23. 2019DwNet: Dense warp-based network for pose-guided human video generationcited by 114
  24. 2022EVA3D: Compositional 3D Human Generation from 2D Image Collectionscited by 111
  25. 2020Deep Image Spatial Transformation for Person Image Generationcited by 100
  26. 2021PISE: Person Image Synthesis and Editing with Decoupled GANcited by 62
  27. 2018Photo Wake-Up: 3D Character Animation from a Single Photocited by 60
  28. 2020Animating Pictures with Eulerian Motion Fieldscited by 54
  29. 2021Dressing in Order: Recurrent Person Image Generation for Pose Transfer, Virtual Try-on and Outfit Editingcited by 54
  30. 2022DALLE-2 is Seeing Double: Flaws in Word-to-Concept Mapping in Text2Image Modelscited by 50
  31. 2021Pose with Style: Detail-Preserving Pose-Guided Image Synthesis with Conditional StyleGANcited by 45
  32. 2022Implicit Warping for Animation with Image Setscited by 45
  33. 2022DynaST: Dynamic Sparse Transformer for Exemplar-Guided Image Generationcited by 24

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 21; 2024: 76; 2025: 52; 2026: 18.

167 papers.

Sort:

By area:

  1. 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,755
  2. 2023NExT-GPT: Any-to-Any Multimodal LLMcited by 610
  3. 2023DynamiCrafter: Animating Open-domain Images with Video Diffusion Priorscited by 463
  4. 2023MagicAnimate: Temporally Consistent Human Image Animation using Diffusion Modelcited by 330
  5. 2025VBench-2.0: Advancing Video Generation Benchmark Suite for Intrinsic Faithfulnesscited by 289
  6. 2024Motion-I2V: Consistent and Controllable Image-to-Video Generation with Explicit Motion Modelingcited by 209
  7. 2023A Survey on Video Diffusion Modelscited by 203
  8. 2024LivePortrait: Efficient Portrait Animation with Stitching and Retargeting Controlcited by 202
  9. 2024MimicMotion: High-Quality Human Motion Video Generation with Confidence-aware Pose Guidancecited by 196
  10. 2024ControlNeXt: Powerful and Efficient Control for Image and Video Generationcited by 158
  11. 2023DisCo: Disentangled Control for Realistic Human Dance Generationcited by 141
  12. 2023State of the Art on Diffusion Models for Visual Computingcited by 126
38 more
  1. 2023MagicPose: Realistic Human Poses and Facial Expressions Retargeting with Identity-aware Diffusioncited by 115
  2. 2023Kandinsky: an Improved Text-to-Image Synthesis with Image Prior and Latent Diffusioncited by 114
  3. 2023Generative Image Dynamicscited by 93
  4. 2025Controllable Video Generation: A Surveycited by 93
  5. 2024NVS-Solver: Video Diffusion Model as Zero-Shot Novel View Synthesizercited by 79
  6. 2023SiTH: Single-view Textured Human Reconstruction with Image-Conditioned Diffusioncited by 72
  7. 2023Alleviating Exposure Bias in Diffusion Models through Sampling with Shifted Time Stepscited by 71
  8. 2024EchoMimicV2: Towards Striking, Simplified, and Semi-Body Human Animationcited by 69
  9. 2023AnimateAnything: Fine-Grained Open Domain Image Animation with Motion Guidancecited by 66
  10. 2024Deepfake Generation and Detection: A Benchmark and Surveycited by 66
  11. 2024DreamClear: High-Capacity Real-World Image Restoration with Privacy-Safe Dataset Curationcited by 64
  12. 2024HumanVid: Demystifying Training Data for Camera-controllable Human Image Animationcited by 63
  13. 2024MIMO: Controllable Character Video Synthesis with Spatial Decomposed Modelingcited by 63
  14. 2024Follow-Your-Click: Open-domain Regional Image Animation via Short Promptscited by 52
  15. 2023RenAIssance: A Survey into AI Text-to-Image Generation in the Era of Large Modelcited by 47
  16. 2024UniEdit: A Unified Tuning-Free Framework for Video Motion and Appearance Editingcited by 47
  17. 2023LivePhoto: Real Image Animation with Text-guided Motion Controlcited by 44
  18. 2024Diffusion Model-Based Video Editing: A Surveycited by 44
  19. 2024Wear-Any-Way: Manipulable Virtual Try-on via Sparse Correspondence Alignmentcited by 42
  20. 2024VBench++: Comprehensive and Versatile Benchmark Suite for Video Generative Modelscited by 42
  21. 2025VideoAnydoor: High-fidelity Video Object Insertion with Precise Motion Controlcited by 42
  22. 2024TrackGo: A Flexible and Efficient Method for Controllable Video Generationcited by 39
  23. 2024Texture-Preserving Diffusion Models for High-Fidelity Virtual Try-Oncited by 38
  24. 2024CyberHost: Taming Audio-driven Avatar Diffusion Model with Region Codebook Attentioncited by 38
  25. 2024RealisDance: Equip controllable character animation with realistic handscited by 37
  26. 2025DreamActor-M1: Holistic, Expressive and Robust Human Image Animation with Hybrid Guidancecited by 36
  27. 2024Co-Speech Gesture Video Generation via Motion-Decoupled Diffusion Modelcited by 34
  28. 2024Tunnel Try-on: Excavating Spatial-temporal Tunnels for High-quality Virtual Try-on in Videoscited by 32
  29. 2024TRIP: Temporal Residual Learning with Image Noise Prior for Image-to-Video Diffusion Modelscited by 30
  30. 2025OmniHuman-1.5: Instilling an Active Mind in Avatars via Cognitive Simulationcited by 30
  31. 2024StoryAgent: Customized Storytelling Video Generation via Multi-Agent Collaborationcited by 28
  32. 2024AIGCBench: Comprehensive Evaluation of Image-to-Video Content Generated by AIcited by 27
  33. 2024Diffusion Models Meet Remote Sensing: Principles, Methods, and Perspectivescited by 27
  34. 2024VividPose: Advancing Stable Video Diffusion for Realistic Human Image Animationcited by 27
  35. 2024Kandinsky 3: Text-to-Image Synthesis for Multifunctional Generative Frameworkcited by 25
  36. 2025Human Motion Video Generation: A Surveycited by 25
  37. 2024A Comprehensive Survey on Human Video Generation: Challenges, Methods, and Insightscited by 24
  38. 2024MagicMan: Generative Novel View Synthesis of Humans with 3D-Aware Diffusion and Iterative Refinementcited by 24

50 most cited of 167 All 167 (JSON)

Similar, not cited

Close in wording, no citation either way

  1. 2023Animate Anyone: Consistent and Controllable Image-to-Video Synthesis for Character Animation
  2. 2024StableGarment: Garment-Centric Generation via Stable Diffusion
  3. 2024WildVidFit: Video Virtual Try-On in the Wild via Image-Based Controlled Diffusion Models
  4. 2023SGDiff: A Style Guided Diffusion Model for Fashion Synthesis
  5. 2023Multimodal Garment Designer: Human-Centric Latent Diffusion Models for Fashion Image Editing
  6. 2025MagicTryOn: Harnessing Diffusion Transformer for Garment-Preserving Video Virtual Try-on
  7. 2024FashionSD-X: Multimodal Fashion Garment Synthesis using Latent Diffusion
  8. 2023DreaMoving: A Human Video Generation Framework based on Diffusion Models