From Mannequin to Human: A Pose-Aware and Identity-Preserving Video Generation Framework for Lifelike Clothing Display
On the map: Diffusion models → 3D, point cloud and scene generation
Abstract (arXiv)
Mannequin-based clothing displays offer a cost-effective alternative to real-model showcases for online fashion presentation, but lack realism and expressive detail. To overcome this limitation, we introduce a new task called mannequin-to-human (M2H) video generation, which aims to synthesize identity-controllable, photorealistic human videos from footage of mannequins. We propose M2HVideo, a pose-aware and identity-preserving video generation framework that addresses two key challenges: the misalignment between head and body motion, and identity drift caused by temporal modeling. In particular, M2HVideo incorporates a dynamic pose-aware head encoder that fuses facial semantics with body pose to produce consistent identity embeddings across frames. To address the loss of fine facial details due to latent space compression, we introduce a mirror loss applied in pixel space through a denoising diffusion implicit model (DDIM)-based one-step denoising. Additionally, we design a distribution-aware adapter that aligns statistical distributions of identity and clothing features to enhance temporal coherence. Extensive experiments on the UBC fashion dataset, our self-constructed ASOS dataset, and the newly collected MannequinVideos dataset captured on-site demonstrate that M2HVideo achieves superior performance in terms of clothing consistency, identity preservation, and video fidelity in comparison to state-of-the-art methods.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in 3D, point cloud and scene generation, one of 14 directions in Diffusion models. Builds on 37 of its 44 references that are in the map. First posted on arXiv 19 Oct 2025.
Builds on
37 of 44 references.
Closest ancestors · 9
Same direction, newest first
- 2024Fashion-VDM: Video Diffusion Model for Virtual Try-On31 Oct
- 2024CatVTON: Concatenation Is All You Need for Virtual Try-On with Diffusion Models21 Jul
- 2024ViViD: Video Virtual Try-on using Diffusion Models20 May
- 2024OOTDiffusion: Outfitting Fusion based Latent Diffusion for Controllable Virtual Try-on4 Mar
- 2024Coarse-to-Fine Latent Diffusion for Pose-Guided Person Image Synthesis28 Feb
- 2023StableVITON: Learning Semantic Correspondence with Latent Diffusion Model for Virtual Try-On4 Dec
- 2023LaDI-VTON: Latent Diffusion Textual-Inversion Enhanced Virtual Try-On22 May
- 2023DreamPose: Fashion Image-to-Video Synthesis via Stable Diffusion12 Apr
- 2022Person Image Synthesis via Denoising Diffusion Model22 Nov
Other references · 28
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,364
- 2020Denoising Diffusion Implicit Modelscited by 9,781
- 2022Generative Adversarial Networkscited by 5,627
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
- 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,611
- 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,581
- 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,245
- 2015Deep Learning and the Information Bottleneck Principlecited by 802
16 more
- 2023Animate Anyone: Consistent and Controllable Image-to-Video Synthesis for Character Animationcited by 688
- 2024Sora: A Review on Background, Technology, Limitations, and Opportunities of Large Vision Modelscited by 477
- 2023Rerender A Video: Zero-Shot Text-Guided Video-to-Video Translationcited by 253
- 2024MimicMotion: High-Quality Human Motion Video Generation with Confidence-aware Pose Guidancecited by 198
- 2024ControlNeXt: Powerful and Efficient Control for Image and Video Generationcited by 159
- 2023Make-Your-Video: Customized Video Generation Using Textual and Structural Guidancecited by 129
- 2023MagicPose: Realistic Human Poses and Facial Expressions Retargeting with Identity-aware Diffusioncited by 117
- 2019DwNet: Dense warp-based network for pose-guided human video generationcited by 115
- 2023MonoHuman: Animatable Human Neural Field from Monocular Videocited by 85
- 2020World-Consistent Video-to-Video Synthesiscited by 69
- 2025HumanDiT: Pose-Guided Diffusion Transformer for Long-form Human Motion Video Generationcited by 39
- 2024Tunnel Try-on: Excavating Spatial-temporal Tunnels for High-quality Virtual Try-on in Videoscited by 32
- 2021Garment4D: Garment Reconstruction from Point Cloud Sequencescited by 23
- 2018Unsupervised Video-to-Video Translationcited by 8
- 2025RealVVT: Towards Photorealistic Video Virtual Try-on via Spatio-Temporal Consistencycited by 8
- 2024Pattern Guided UV Recovery for Realistic Video Garment Texturingcited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025MagicTryOn: Harnessing Diffusion Transformer for Garment-Preserving Video Virtual Try-on
- 2026Vanast: Virtual Try-On with Human Image Animation via Synthetic Triplet Supervision
- 2026ReImagine: Rethinking Controllable High-Quality Human Video Generation via Image-First Synthesis
- 2024Dynamic Try-On: Taming Video Virtual Try-on with Dynamic Attention Mechanism
- 2026FashionChameleon: Towards Real-Time and Interactive Human-Garment Video Customization
- 2024WildVidFit: Video Virtual Try-On in the Wild via Image-Based Controlled Diffusion Models
- 2025Pursuing Temporal-Consistent Video Virtual Try-On via Dynamic Pose Interaction
- 2025The devil is in the details: Enhancing Video Virtual Try-On via Keyframe-Driven Details Injection