Neural Texture Extraction and Distribution for Controllable Person Image Synthesis
Not on the map. Why?
Cited by 21 in Diffusion models, but placed by its own abstract, which didn’t fit.
Abstract (arXiv)
We deal with the controllable person image synthesis task which aims to re-render a human from a reference image with explicit control over body pose and appearance. Observing that person images are highly structured, we propose to generate desired images by extracting and distributing semantic entities of reference images. To achieve this goal, a neural texture extraction and distribution operation based on double attention is described. This operation first extracts semantic neural textures from reference feature maps. Then, it distributes the extracted neural textures according to the spatial distributions learned from target poses. Our model is trained to predict human images in arbitrary poses, which encourages it to extract disentangled and expressive neural textures representing the appearance of different semantic entities. The disentangled representation further enables explicit appearance control. Neural textures of different reference images can be fused to control the appearance of the interested areas. Experimental comparisons show the superiority of the proposed model. Code is available at https://github.com/RenYurui/Neural-Texture-Extraction-Distribution.
Key facts. Cited by 55 papers in the map (data through 7 Oct 2026). Builds on 32 of its 40 references that are in the map. First posted on arXiv 13 Apr 2022.
Builds on
32 of 40 references.
References · 32
- 2017Attention Is All You Needcited by 59,932
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,510
- 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,580
- 2016Improved Techniques for Training GANscited by 2,938
- 2016Perceptual Losses for Real-Time Style Transfer and Super-Resolutioncited by 2,678
- 2017Non-local Neural Networkscited by 2,290
- 2014Conditional Generative Adversarial Netscited by 2,152
- 2019Semantic Image Synthesis with Spatially-Adaptive Normalizationcited by 1,295
- 2017High-Resolution Image Synthesis and Semantic Manipulation with Conditional GANscited by 1,176
- 2018OpenPose: Realtime Multi-Person 2D Pose Estimation using Part Affinity Fieldscited by 1,161
- 2017StarGAN: Unified Generative Adversarial Networks for Multi-Domain Image-to-Image Translationcited by 1,036
20 more
- 2018Self-Attention Generative Adversarial Networkscited by 809
- 2018Multimodal Unsupervised Image-to-Image Translationcited by 795
- 2018Efficient Attention: Attention with Linear Complexitiescited by 366
- 2019Few-shot Video-to-Video Synthesiscited by 196
- 2017Deformable GANs for Pose-based Human Image Generationcited by 166
- 2019Liquid Warping GAN: A Unified Framework for Human Motion Imitation, Appearance Transfer and Novel View Synthesiscited by 161
- 2020Controllable Person Image Synthesis with Attribute-Decomposed GANcited by 150
- 2019Progressive Pose Attention Transfer for Person Image Generationcited by 138
- 2018A Variational U-Net for Conditional Appearance and Shape Generationcited by 124
- 2020Cross-domain Correspondence Learning for Exemplar-based Image Translationcited by 116
- 2019Dense Intrinsic Appearance Flow for Human Pose Transfercited by 104
- 2020Deep Image Spatial Transformation for Person Image Generationcited by 100
- 2017Disentangled Person Image Generationcited by 98
- 2021Style and Pose Control for Image Synthesis of Humans from a Single Monocular Viewcited by 53
- 2021Pose with Style: Detail-Preserving Pose-Guided Image Synthesis with Conditional StyleGANcited by 45
- 2019Multi-mapping Image-to-Image Translation via Learning Disentanglementcited by 35
- 2021TryOnGAN: Body-Aware Try-On via Layered Interpolationcited by 31
- 2014Do Convnets Learn Correspondence?cited by 28
- 2021Structure-aware Person Image Generation with Pose Decomposition and Semantic Correlationcited by 11
- 2021Combining Attention with Flow for Person Image Synthesiscited by 9
Built on by
Citing papers per year: 2022: 8; 2023: 13; 2024: 23; 2025: 8; 2026: 3.
55 papers.
Sort:
By area:
- 2023TryOnDiffusion: A Tale of Two UNetscited by 141
- 2022Person Image Synthesis via Denoising Diffusion Modelcited by 104
- 2023HumanSD: A Native Skeleton-Guided Diffusion Model for Human Image Generationcited by 104
- 2023Advancing Pose-Guided Image Synthesis with Progressive Conditional Diffusion Modelscited by 104
- 2024UniAnimate: Taming Unified Video Diffusion Models for Consistent Human Image Animationcited by 101
- 2024Animate-X: Universal Character Image Animation with Enhanced Motion Representationcited by 86
- 2024Coarse-to-Fine Latent Diffusion for Pose-Guided Person Image Synthesiscited by 48
- 2024Learning Flow Fields in Attention for Controllable Person Image Generationcited by 27
- 2023Bidirectionally Deformable Motion Modulation For Video-based Human Pose Transfercited by 25
- 2022DynaST: Dynamic Sparse Transformer for Exemplar-Guided Image Generationcited by 24
- 2024WildVidFit: Video Virtual Try-On in the Wild via Image-Based Controlled Diffusion Modelscited by 22
- 2024Boosting Camera Motion Control for Video Diffusion Transformerscited by 20
38 more
- 2024Towards Effective Usage of Human-Centric Priors in Diffusion Models for Text-based Human Image Generationcited by 17
- 2024Fashion-VDM: Video Diffusion Model for Virtual Try-Oncited by 16
- 2023UPGPT: Universal Diffusion Model for Person Image Generation, Editing and Pose Transfercited by 12
- 2023UniHuman: A Unified Model for Editing Human Images in the Wildcited by 12
- 2024Cross-view Masked Diffusion Transformers for Person Image Synthesiscited by 12
- 2025DreamVVT: Mastering Realistic Video Virtual Try-On in the Wild via a Stage-Wise Diffusion Transformer Frameworkcited by 12
- 2022HumanDiffusion: a Coarse-to-Fine Alignment Diffusion Framework for Controllable Text-Driven Person Image Generationcited by 11
- 2022Human Image Generation: A Comprehensive Surveycited by 11
- 2024DiffLoRA: Generating Personalized Low-Rank Adaptation Weights with Diffusioncited by 11
- 2023Semantic 3D-aware Portrait Synthesis and Manipulation Based on Compositional Neural Radiance Fieldcited by 10
- 2025VTON 360: High-Fidelity Virtual Try-On from Any Viewing Directioncited by 10
- 2025Animate-X++: Universal Character Image Animation with Dynamic Backgroundscited by 10
- 2024BeyondScene: Higher-Resolution Human-Centric Scene Generation With Pretrained Diffusioncited by 9
- 2025One-to-All Animation: Alignment-Free Character Animation and Image Pose Transfercited by 9
- 2024Pose-Guided Fine-Grained Sign Language Video Generationcited by 8
- 2023ViscoNet: Bridging and Harmonizing Visual and Textual Conditioning for ControlNetcited by 7
- 2022Collecting The Puzzle Pieces: Disentangled Self-Driven Human Pose Transfer by Permuting Texturescited by 6
- 2024DiffBody: Diffusion-based Pose and Shape Editing of Human Imagescited by 6
- 2025Multi-focal Conditioned Latent Diffusion for Person Image Synthesiscited by 6
- 2022VGFlow: Visibility guided Flow Network for Human Reposingcited by 5
- 2023Total Selfie: Generating Full-Body Selfiescited by 5
- 2024Diversifying Human Pose in Synthetic Data for Aerial-view Human Detectioncited by 5
- 2023Disentangled Representation Learning for Controllable Person Image Generationcited by 4
- 2022Pose Guided Human Image Synthesis with Partially Decoupled GANcited by 3
- 2023Open-World Pose Transfer via Sequential Test-Time Adaptioncited by 3
- 2024Deep Bayesian Future Fusion for Self-Supervised, High-Resolution, Off-Road Mappingcited by 3
- 2025Enhanced Multi-Scale Cross-Attention for Person Image Generationcited by 3
- 2023RePoseDM: Recurrent Pose Alignment and Gradient Guidance for Pose Guided Image Synthesiscited by 2
- 2024One-Shot Learning for Pose-Guided Person Image Synthesis in the Wildcited by 2
- 2024One-shot Human Motion Transfer via Occlusion-Robust Flow Prediction and Neural Texturingcited by 2
- 2026OrthoTryOn: Geometric Orthogonalization for Conflict-Free Unified Fashion Generationcited by 2
- 2022UMFuse: Unified Multi View Fusion for Human Editing applicationscited by 1
- 2024ENTED: Enhanced Neural Texture Extraction and Distribution for Reference-based Blind Face Restorationcited by 1
- 2024Sketch2Human: Deep Human Generation with Disentangled Geometry and Appearance Controlcited by 1
- 2024FAMOUS: High-Fidelity Monocular 3D Human Digitization Using View Synthesiscited by 1
- 2026DAC-Pose: Dual-Agent Collaborative Framework for Pose-Guided Human Generationcited by 1
- 2023One-Shot Stylization for Full-Body Human Imagescited by 0
- 2024Beyond Imperfections: A Conditional Inpainting Approach for End-to-End Artifact Removal in VTON and Pose Transfercited by 0
50 most cited of 55 All 55 (JSON)
- 2026DAC-Pose: Dual-Agent Collaborative Framework for Pose-Guided Human Generation5 Aug 2026
- 2026OrthoTryOn: Geometric Orthogonalization for Conflict-Free Unified Fashion Generation26 Jun 2026
- 2026PoseCraft: Tokenized 3D Body Landmark and Camera Conditioning for Photorealistic Human Image Synthesis22 Feb 2026
- 2025One-to-All Animation: Alignment-Free Character Animation and Image Pose Transfer28 Nov 2025
- 2025Jointly Conditioned Diffusion Model for Multi-View Pose-Guided Person Image Synthesis19 Nov 2025
- 2025Animate-X++: Universal Character Image Animation with Dynamic Backgrounds13 Aug 2025
- 2025DreamVVT: Mastering Realistic Video Virtual Try-On in the Wild via a Stage-Wise Diffusion Transformer Framework4 Aug 2025
- 2025Real-Time Person Image Synthesis Using a Flow Matching Model6 May 2025
- 2025Multi-focal Conditioned Latent Diffusion for Person Image Synthesis19 Mar 2025
- 2025VTON 360: High-Fidelity Virtual Try-On from Any Viewing Direction15 Mar 2025
- 2025Enhanced Multi-Scale Cross-Attention for Person Image Generation15 Jan 2025
- 2024DRDM: A Disentangled Representations Diffusion Model for Synthesizing Realistic Person Images25 Dec 2024
38 more
- 2024Learning Flow Fields in Attention for Controllable Person Image Generation11 Dec 2024
- 2024Fusion Embedding for Pose-Guided Person Image Synthesis with Diffusion Model10 Dec 2024
- 2024One-shot Human Motion Transfer via Occlusion-Robust Flow Prediction and Neural Texturing9 Dec 2024
- 2024Fashion-VDM: Video Diffusion Model for Virtual Try-On31 Oct 2024
- 2024Boosting Camera Motion Control for Video Diffusion Transformers14 Oct 2024
- 2024Animate-X: Universal Character Image Animation with Enhanced Motion Representation14 Oct 2024
- 2024FAMOUS: High-Fidelity Monocular 3D Human Digitization Using View Synthesis13 Oct 2024
- 2024Beyond Imperfections: A Conditional Inpainting Approach for End-to-End Artifact Removal in VTON and Pose Transfer5 Oct 2024
- 2024Pose-Guided Fine-Grained Sign Language Video Generation25 Sep 2024
- 2024One-Shot Learning for Pose-Guided Person Image Synthesis in the Wild15 Sep 2024
- 2024DiffLoRA: Generating Personalized Low-Rank Adaptation Weights with Diffusion13 Aug 2024
- 2024WildVidFit: Video Virtual Try-On in the Wild via Image-Based Controlled Diffusion Models15 Jul 2024
- 2024UniAnimate: Taming Unified Video Diffusion Models for Consistent Human Image Animation3 Jun 2024
- 2024Diversifying Human Pose in Synthetic Data for Aerial-view Human Detection24 May 2024
- 2024Sketch2Human: Deep Human Generation with Disentangled Geometry and Appearance Control24 Apr 2024
- 2024BeyondScene: Higher-Resolution Human-Centric Scene Generation With Pretrained Diffusion6 Apr 2024
- 2024Deep Bayesian Future Fusion for Self-Supervised, High-Resolution, Off-Road Mapping18 Mar 2024
- 2024Towards Effective Usage of Human-Centric Priors in Diffusion Models for Text-based Human Image Generation8 Mar 2024
- 2024Coarse-to-Fine Latent Diffusion for Pose-Guided Person Image Synthesis28 Feb 2024
- 2024Cross-view Masked Diffusion Transformers for Person Image Synthesis2 Feb 2024
- 2024ENTED: Enhanced Neural Texture Extraction and Distribution for Reference-based Blind Face Restoration13 Jan 2024
- 2024DiffBody: Diffusion-based Pose and Shape Editing of Human Images5 Jan 2024
- 2023UniHuman: A Unified Model for Editing Human Images in the Wild22 Dec 2023
- 2023Disentangled Representation Learning for Controllable Person Image Generation10 Dec 2023
- 2023ViscoNet: Bridging and Harmonizing Visual and Textual Conditioning for ControlNet5 Dec 2023
- 2023RePoseDM: Recurrent Pose Alignment and Gradient Guidance for Pose Guided Image Synthesis24 Oct 2023
- 2023Advancing Pose-Guided Image Synthesis with Progressive Conditional Diffusion Models10 Oct 2023
- 2023Total Selfie: Generating Full-Body Selfies28 Aug 2023
- 2023Bidirectionally Deformable Motion Modulation For Video-based Human Pose Transfer15 Jul 2023
- 2023TryOnDiffusion: A Tale of Two UNets14 Jun 2023
- 2023UPGPT: Universal Diffusion Model for Person Image Generation, Editing and Pose Transfer18 Apr 2023
- 2023One-Shot Stylization for Full-Body Human Images14 Apr 2023
- 2023HumanSD: A Native Skeleton-Guided Diffusion Model for Human Image Generation9 Apr 2023
- 2023Open-World Pose Transfer via Sequential Test-Time Adaption20 Mar 2023
- 2023Semantic 3D-aware Portrait Synthesis and Manipulation Based on Compositional Neural Radiance Field3 Feb 2023
- 2022Human Image Generation: A Comprehensive Survey17 Dec 2022
- 2022Person Image Synthesis via Denoising Diffusion Model22 Nov 2022
- 2022UMFuse: Unified Multi View Fusion for Human Editing applications17 Nov 2022
50 newest of 55 All 55 (JSON)
- 2022Person Image Synthesis via Denoising Diffusion Modelcited by 104
- 2023HumanSD: A Native Skeleton-Guided Diffusion Model for Human Image Generationcited by 104
- 2023Advancing Pose-Guided Image Synthesis with Progressive Conditional Diffusion Modelscited by 104
- 2024UniAnimate: Taming Unified Video Diffusion Models for Consistent Human Image Animationcited by 101
- 2024Coarse-to-Fine Latent Diffusion for Pose-Guided Person Image Synthesiscited by 48
- 2024WildVidFit: Video Virtual Try-On in the Wild via Image-Based Controlled Diffusion Modelscited by 22
- 2024Boosting Camera Motion Control for Video Diffusion Transformerscited by 20
- 2024Towards Effective Usage of Human-Centric Priors in Diffusion Models for Text-based Human Image Generationcited by 17
- 2024Fashion-VDM: Video Diffusion Model for Virtual Try-Oncited by 16
- 2023UPGPT: Universal Diffusion Model for Person Image Generation, Editing and Pose Transfercited by 12
- 2024Cross-view Masked Diffusion Transformers for Person Image Synthesiscited by 12
- 2025DreamVVT: Mastering Realistic Video Virtual Try-On in the Wild via a Stage-Wise Diffusion Transformer Frameworkcited by 12
12 most cited of 21 All 21 (JSON)
- 2025One-to-All Animation: Alignment-Free Character Animation and Image Pose Transfer28 Nov 2025
- 2025Jointly Conditioned Diffusion Model for Multi-View Pose-Guided Person Image Synthesis19 Nov 2025
- 2025DreamVVT: Mastering Realistic Video Virtual Try-On in the Wild via a Stage-Wise Diffusion Transformer Framework4 Aug 2025
- 2025Real-Time Person Image Synthesis Using a Flow Matching Model6 May 2025
- 2025Multi-focal Conditioned Latent Diffusion for Person Image Synthesis19 Mar 2025
- 2024DRDM: A Disentangled Representations Diffusion Model for Synthesizing Realistic Person Images25 Dec 2024
- 2024Fusion Embedding for Pose-Guided Person Image Synthesis with Diffusion Model10 Dec 2024
- 2024Fashion-VDM: Video Diffusion Model for Virtual Try-On31 Oct 2024
- 2024Boosting Camera Motion Control for Video Diffusion Transformers14 Oct 2024
- 2024DiffLoRA: Generating Personalized Low-Rank Adaptation Weights with Diffusion13 Aug 2024
- 2024WildVidFit: Video Virtual Try-On in the Wild via Image-Based Controlled Diffusion Models15 Jul 2024
- 2024UniAnimate: Taming Unified Video Diffusion Models for Consistent Human Image Animation3 Jun 2024
12 newest of 21 All 21 (JSON)
- 2023TryOnDiffusion: A Tale of Two UNetscited by 141
- 2024Animate-X: Universal Character Image Animation with Enhanced Motion Representationcited by 86
- 2024Learning Flow Fields in Attention for Controllable Person Image Generationcited by 27
- 2023Bidirectionally Deformable Motion Modulation For Video-based Human Pose Transfercited by 25
- 2022DynaST: Dynamic Sparse Transformer for Exemplar-Guided Image Generationcited by 24
- 2023UniHuman: A Unified Model for Editing Human Images in the Wildcited by 12
- 2022HumanDiffusion: a Coarse-to-Fine Alignment Diffusion Framework for Controllable Text-Driven Person Image Generationcited by 11
- 2022Human Image Generation: A Comprehensive Surveycited by 11
- 2023Semantic 3D-aware Portrait Synthesis and Manipulation Based on Compositional Neural Radiance Fieldcited by 10
- 2025VTON 360: High-Fidelity Virtual Try-On from Any Viewing Directioncited by 10
- 2025Animate-X++: Universal Character Image Animation with Dynamic Backgroundscited by 10
- 2024Pose-Guided Fine-Grained Sign Language Video Generationcited by 8
12 most cited of 34 All 34 (JSON)
- 2026DAC-Pose: Dual-Agent Collaborative Framework for Pose-Guided Human Generation5 Aug 2026
- 2026OrthoTryOn: Geometric Orthogonalization for Conflict-Free Unified Fashion Generation26 Jun 2026
- 2026PoseCraft: Tokenized 3D Body Landmark and Camera Conditioning for Photorealistic Human Image Synthesis22 Feb 2026
- 2025Animate-X++: Universal Character Image Animation with Dynamic Backgrounds13 Aug 2025
- 2025VTON 360: High-Fidelity Virtual Try-On from Any Viewing Direction15 Mar 2025
- 2025Enhanced Multi-Scale Cross-Attention for Person Image Generation15 Jan 2025
- 2024Learning Flow Fields in Attention for Controllable Person Image Generation11 Dec 2024
- 2024One-shot Human Motion Transfer via Occlusion-Robust Flow Prediction and Neural Texturing9 Dec 2024
- 2024Animate-X: Universal Character Image Animation with Enhanced Motion Representation14 Oct 2024
- 2024FAMOUS: High-Fidelity Monocular 3D Human Digitization Using View Synthesis13 Oct 2024
- 2024Beyond Imperfections: A Conditional Inpainting Approach for End-to-End Artifact Removal in VTON and Pose Transfer5 Oct 2024
- 2024Pose-Guided Fine-Grained Sign Language Video Generation25 Sep 2024
12 newest of 34 All 34 (JSON)