Dance Dance Generation: Motion Transfer for Internet Videos
Not on the map. Why?
Abstract (arXiv)
This work presents computational methods for transferring body movements from one person to another with videos collected in the wild. Specifically, we train a personalized model on a single video from the Internet which can generate videos of this target person driven by the motions of other people. Our model is built on two generative networks: a human (foreground) synthesis net which generates photo-realistic imagery of the target person in a novel pose, and a fusion net which combines the generated foreground with the scene (background), adding shadows or reflections as needed to enhance realism. We validate the the efficacy of our proposed models over baselines with qualitative and quantitative evaluations as well as a subjective test.
Key facts. Cited by 28 papers in the map (data through 14 Oct 2026). First posted on arXiv 30 Mar 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 11; 2022: 6; 2023: 4; 2024: 3; 2025: 3; 2026: 1.
28 papers.
Sort:
By area:
- 2023DisCo: Disentangled Control for Realistic Human Dance Generationcited by 142
- 2022Signing at Scale: Learning to Co-Articulate Signs for Large-Scale Photo-Realistic Sign Language Productioncited by 61
- 2021Neural Re-Rendering of Humans from a Single Imagecited by 59
- 2021Dynamic Neural Garmentscited by 27
- 2023SignDiff: Diffusion Model for American Sign Language Productioncited by 25
- 2021Few-Shot Human Motion Transfer by Personalized Geometry and Texture Modelingcited by 21
- 2023Controllable Group Choreography using Contrastive Diffusioncited by 17
- 2021Deep Person Generation: A Survey from the Perspective of Face, Pose and Cloth Synthesiscited by 16
- 2021Strumming to the Beat: Audio-Conditioned Contrastive Video Texturescited by 14
- 2022Jointly Harnessing Prior Structures and Temporal Consistency for Sign Language Video Generationcited by 14
- 2021Smile Like You Mean It: Driving Animatronic Robotic Face with Learned Modelscited by 12
- 2021Flow Guided Transformable Bottleneck Networks for Motion Retargetingcited by 12
16 more
- 2022Fast-Vid2Vid: Spatial-Temporal Compression for Video-to-Video Synthesiscited by 12
- 2022VideoFACT: Detecting Video Forgeries Using Attention, Scene Context, and Forensic Tracescited by 9
- 2025WonderHuman: Hallucinating Unseen Parts in Dynamic 3D Human Reconstructioncited by 6
- 2021FDA-GAN: Flow-based Dual Attention GAN for Human Pose Transfercited by 5
- 2024A Spatio-Temporal Representation Learning as an Alternative to Traditional Glosses in Sign Language Translation and Productioncited by 5
- 2025Spatial-Temporal Graph Mamba for Music-Guided Dance Video Synthesiscited by 4
- 2021Video Reenactment as Inductive Bias for Content-Motion Disentanglementcited by 3
- 2023Bidirectional Temporal Diffusion Model for Temporally Consistent Human Animationcited by 2
- 2024SignLLM: Sign Language Production Large Language Modelscited by 2
- 2021Discriminative Semantic Transitive Consistency for Cross-Modal Learningcited by 1
- 2021Do as we do: Multiple Person Video-To-Video Transfercited by 1
- 2022DF-Captcha: A Deepfake Captcha for Preventing Fake Callscited by 1
- 2022MetaDance: Few-shot Dancing Video Retargeting via Temporal-aware Meta-learningcited by 0
- 2024Garment Animation NeRF with Color Editingcited by 0
- 2025Geometry-Aware Losses for Structure-Preserving Text-to-Sign Language Generationcited by 0
- 2026FlowDance: Music-Driven Dance Video Generation with Parallel Pose and RGB Streamscited by 0
- 2026FlowDance: Music-Driven Dance Video Generation with Parallel Pose and RGB Streams16 Aug 2026
- 2025Geometry-Aware Losses for Structure-Preserving Text-to-Sign Language Generation27 Sep 2025
- 2025Spatial-Temporal Graph Mamba for Music-Guided Dance Video Synthesis9 Jul 2025
- 2025WonderHuman: Hallucinating Unseen Parts in Dynamic 3D Human Reconstruction3 Feb 2025
- 2024Garment Animation NeRF with Color Editing29 Jul 2024
- 2024A Spatio-Temporal Representation Learning as an Alternative to Traditional Glosses in Sign Language Translation and Production3 Jul 2024
- 2024SignLLM: Sign Language Production Large Language Models17 May 2024
- 2023Controllable Group Choreography using Contrastive Diffusion29 Oct 2023
- 2023SignDiff: Diffusion Model for American Sign Language Production30 Aug 2023
- 2023Bidirectional Temporal Diffusion Model for Temporally Consistent Human Animation2 Jul 2023
- 2023DisCo: Disentangled Control for Realistic Human Dance Generation30 Jun 2023
- 2022VideoFACT: Detecting Video Forgeries Using Attention, Scene Context, and Forensic Traces28 Nov 2022
16 more
- 2022DF-Captcha: A Deepfake Captcha for Preventing Fake Calls17 Aug 2022
- 2022Fast-Vid2Vid: Spatial-Temporal Compression for Video-to-Video Synthesis11 Jul 2022
- 2022Jointly Harnessing Prior Structures and Temporal Consistency for Sign Language Video Generation8 Jul 2022
- 2022Signing at Scale: Learning to Co-Articulate Signs for Large-Scale Photo-Realistic Sign Language Production29 Mar 2022
- 2022MetaDance: Few-shot Dancing Video Retargeting via Temporal-aware Meta-learning13 Jan 2022
- 2021FDA-GAN: Flow-based Dual Attention GAN for Human Pose Transfer1 Dec 2021
- 2021Deep Person Generation: A Survey from the Perspective of Face, Pose and Cloth Synthesis5 Sep 2021
- 2021Flow Guided Transformable Bottleneck Networks for Motion Retargeting14 Jun 2021
- 2021Smile Like You Mean It: Driving Animatronic Robotic Face with Learned Models26 May 2021
- 2021Do as we do: Multiple Person Video-To-Video Transfer10 Apr 2021
- 2021Strumming to the Beat: Audio-Conditioned Contrastive Video Textures6 Apr 2021
- 2021Few-Shot Human Motion Transfer by Personalized Geometry and Texture Modeling26 Mar 2021
- 2021Discriminative Semantic Transitive Consistency for Cross-Modal Learning25 Mar 2021
- 2021Dynamic Neural Garments23 Feb 2021
- 2021Video Reenactment as Inductive Bias for Content-Motion Disentanglement30 Jan 2021
- 2021Neural Re-Rendering of Humans from a Single Image11 Jan 2021
- 2023DisCo: Disentangled Control for Realistic Human Dance Generationcited by 142
- 2022Signing at Scale: Learning to Co-Articulate Signs for Large-Scale Photo-Realistic Sign Language Productioncited by 61
- 2021Neural Re-Rendering of Humans from a Single Imagecited by 59
- 2021Dynamic Neural Garmentscited by 27
- 2021Few-Shot Human Motion Transfer by Personalized Geometry and Texture Modelingcited by 21
- 2023Controllable Group Choreography using Contrastive Diffusioncited by 17
- 2021Deep Person Generation: A Survey from the Perspective of Face, Pose and Cloth Synthesiscited by 16
- 2021Strumming to the Beat: Audio-Conditioned Contrastive Video Texturescited by 14
- 2022Jointly Harnessing Prior Structures and Temporal Consistency for Sign Language Video Generationcited by 14
- 2021Smile Like You Mean It: Driving Animatronic Robotic Face with Learned Modelscited by 12
- 2021Flow Guided Transformable Bottleneck Networks for Motion Retargetingcited by 12
- 2022Fast-Vid2Vid: Spatial-Temporal Compression for Video-to-Video Synthesiscited by 12
12 most cited of 25 All 25 (JSON)
- 2026FlowDance: Music-Driven Dance Video Generation with Parallel Pose and RGB Streams16 Aug 2026
- 2025Geometry-Aware Losses for Structure-Preserving Text-to-Sign Language Generation27 Sep 2025
- 2025WonderHuman: Hallucinating Unseen Parts in Dynamic 3D Human Reconstruction3 Feb 2025
- 2024Garment Animation NeRF with Color Editing29 Jul 2024
- 2024A Spatio-Temporal Representation Learning as an Alternative to Traditional Glosses in Sign Language Translation and Production3 Jul 2024
- 2024SignLLM: Sign Language Production Large Language Models17 May 2024
- 2023Controllable Group Choreography using Contrastive Diffusion29 Oct 2023
- 2023DisCo: Disentangled Control for Realistic Human Dance Generation30 Jun 2023
- 2022VideoFACT: Detecting Video Forgeries Using Attention, Scene Context, and Forensic Traces28 Nov 2022
- 2022DF-Captcha: A Deepfake Captcha for Preventing Fake Calls17 Aug 2022
- 2022Fast-Vid2Vid: Spatial-Temporal Compression for Video-to-Video Synthesis11 Jul 2022
- 2022Jointly Harnessing Prior Structures and Temporal Consistency for Sign Language Video Generation8 Jul 2022
12 newest of 25 All 25 (JSON)