FashionPose: Unified Text-Driven Fashion Synthesis with Joint Geometric and Photometric Control
Not on the map. Why?
Abstract (arXiv)
Realistic and controllable garment synthesis is essential for fashion e-commerce, yet it demands precise coordination between human pose geometry and environmental photometry. Conventional pose-guided frameworks suffer from two fundamental limitations: they rely heavily on predefined skeletons from off-the-shelf estimators, restricting semantic flexibility; and they predominantly focus on studio-like generation under neutral lighting, failing to reconcile geometric configurations with complex, scene-specific illumination described in natural language. To bridge this gap, we propose FashionPose, a cascaded architecture that reconciles geometric and photometric control within a unified language-driven interface. Unlike conventional frameworks, our framework employs a decoupled yet synergistic strategy: (1) a bidirectional contrastive alignment mechanism that grounds textual semantics into an explicit geometric manifold, enabling template-free pose generation; (2) an identity-anchored synthesis module that translates these geometric priors into high-fidelity imagery while preserving fine-grained appearance; and (3) a prompt-conditioned relighting module that leverages the generated pose as a spatial anchor to achieve environment-aware shading. This hierarchical design effectively transforms high-level instructions into consistent visual representations, ensuring both structural precision and atmospheric harmony. To facilitate this paradigm, we construct PoseCap, a dataset with over 40,000 caption-keypoint pairs. Extensive experiments demonstrate that FashionPose outperforms existing benchmarks in pose accuracy and physical realism, providing a robust solution for personalized, scene-aware virtual fashion displays.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 21 of its 36 references that are in the map. First posted on arXiv 17 Jul 2025.
Builds on
21 of 36 references.
References · 21
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,152
- 2018OpenPose: Realtime Multi-Person 2D Pose Estimation using Part Affinity Fieldscited by 1,162
- 2021YOLOX: Exceeding YOLO Series in 2021cited by 1,071
- 2020GANSpace: Discovering Interpretable GAN Controlscited by 614
- 2017Pose Guided Person Image Generationcited by 251
- 2022Person Image Synthesis via Denoising Diffusion Modelcited by 104
- 2023Advancing Pose-Guided Image Synthesis with Progressive Conditional Diffusion Modelscited by 104
- 2022Exploring Dual-task Correlation for Pose Guided Person Image Generationcited by 68
- 2025Long-Term TalkingFace Generation via Motion-Prior Conditional Diffusion Modelcited by 49
- 2024Coarse-to-Fine Latent Diffusion for Pose-Guided Person Image Synthesiscited by 48
- 2025SimMotionEdit: Text-Based Human Motion Editing with Motion Similarity Predictioncited by 27
9 more
- 2025SynthLight: Portrait Relighting with Diffusion Model by Learning to Re-render Synthetic Facescited by 24
- 2025Comprehensive Relighting: Generalizable and Consistent Monocular Human Relighting and Harmonizationcited by 12
- 2024MoRAG -- Multi-Fusion Retrieval Augmented Generation for Human Motioncited by 11
- 2025Shape My Moves: Text-Driven Shape-Aware Synthesis of Human Motionscited by 11
- 2024MoLA: Motion Generation and Editing with Latent Diffusion Enhanced by Adversarial Trainingcited by 9
- 2020Adversarial Synthesis of Human Pose from Textcited by 7
- 2024Controlling Human Shape and Pose in Text-to-Image Diffusion Models via Domain Adaptationcited by 7
- 2023FineControlNet: Fine-level Text Control for Image Generation with Spatially Aligned Text Control Injectioncited by 6
- 2024GUNet: A Graph Convolutional Network United Diffusion Model for Stable and Diversity Pose Generationcited by 1
Built on by
Not cited yet.