DreaMoving: A Human Video Generation Framework based on Diffusion Models
On the map: Diffusion models → Video generation
Abstract (arXiv)
In this paper, we present DreaMoving, a diffusion-based controllable video generation framework to produce high-quality customized human videos. Specifically, given target identity and posture sequences, DreaMoving can generate a video of the target identity moving or dancing anywhere driven by the posture sequences. To this end, we propose a Video ControlNet for motion-controlling and a Content Guider for identity preserving. The proposed model is easy to use and can be adapted to most stylized diffusion models to generate diverse results. The project page is available at https://dreamoving.github.io/dreamoving
Key facts. Cited by 25 papers in the map (data through 14 Oct 2026). Placed in Video generation, one of 14 directions in Diffusion models. Builds on 10 of its 13 references that are in the map. First posted on arXiv 8 Dec 2023.
Builds on
10 of 13 references.
Closest ancestors · 1
Same direction, newest first
- 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuning10 Jul
Other references · 9
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
- 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,300
- 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Modelscited by 1,464
- 2021Frozen in Time: A Joint Video and Image Encoder for End-to-End Retrievalcited by 1,177
- 2023ZoeDepth: Zero-shot Transfer by Combining Relative and Metric Depthcited by 657
- 2023MiniGPT-v2: large language model as a unified interface for vision-language multi-task learningcited by 625
- 2023Effective Whole-body Pose Estimation with Two-stages Distillationcited by 311
Built on by
Citing papers per year: 2024: 17; 2025: 3; 2026: 5.
25 papers.
Sort:
By area:
- 2024Champ: Controllable and Consistent Human Image Animation with 3D Parametric Guidancecited by 272
- 2024MimicMotion: High-Quality Human Motion Video Generation with Confidence-aware Pose Guidancecited by 198
- 2024Direct-a-Video: Customized Video Generation with User-Directed Camera Movement and Object Motioncited by 167
- 2024InitNO: Boosting Text-to-Image Diffusion Models via Initial Noise Optimizationcited by 123
- 2024Boximator: Generating Rich and Controllable Motions for Video Synthesiscited by 107
- 2024DeMamba: AI-Generated Video Detection on Million-Scale GenVideo Benchmarkcited by 92
- 20243DTrajMaster: Mastering 3D Trajectory for Multi-Entity Motion in Video Generationcited by 71
- 2024A Survey on Personalized Content Synthesis with Diffusion Modelscited by 29
- 2024A Comprehensive Survey on Human Video Generation: Challenges, Methods, and Insightscited by 25
- 2024I4VGen: Image as Free Stepping Stone for Text-to-Video Generationcited by 14
- 2025DanceTogether! Identity-Preserving Multi-Person Interactive Video Generationcited by 13
- 2024MovieCharacter: A Tuning-Free Framework for Controllable Character Video Synthesiscited by 12
13 more
- 2024High Quality Human Image Animation using Regional Supervision and Motion Blur Conditioncited by 7
- 2025GenHSI: Controllable Generation of Human-Scene Interaction Videoscited by 6
- 2026MagicFight: Personalized Martial Arts Combat Video Generationcited by 4
- 2024Enhancing Motion in Text-to-Video Generation with Decomposed Encoding and Conditioningcited by 3
- 2024CFSynthesis: Controllable and Free-view 3D Human Video Synthesiscited by 3
- 2024SignLLM: Sign Language Production Large Language Modelscited by 2
- 2024Adaptive Multi-Modal Control of Digital Human Hand Synthesis Using a Region-Aware Cycle Losscited by 2
- 2024AnyLogo: Symbiotic Subject-Driven Diffusion System with Gemini Statuscited by 2
- 2025Toward Rich Video Human-Motion2D Generationcited by 2
- 2026CMTA: Leveraging Cross-Modal Temporal Artifacts for Generalizable AI-Generated Video Detectioncited by 2
- 2026ATSS: Detecting AI-Generated Videos via Anomalous Temporal Self-Similaritycited by 1
- 2026Controllable Complex Human Motion Video Generation via Text-to-Skeleton Cascadescited by 0
- 2026MTOR: Generalizable AI-Generated Video Detection with Multimodal Semantics and Temporal Over-Regularitycited by 0
- 2026MTOR: Generalizable AI-Generated Video Detection with Multimodal Semantics and Temporal Over-Regularity5 Oct 2026
- 2026CMTA: Leveraging Cross-Modal Temporal Artifacts for Generalizable AI-Generated Video Detection1 May 2026
- 2026ATSS: Detecting AI-Generated Videos via Anomalous Temporal Self-Similarity5 Apr 2026
- 2026Controllable Complex Human Motion Video Generation via Text-to-Skeleton Cascades9 Mar 2026
- 2026MagicFight: Personalized Martial Arts Combat Video Generation5 Jan 2026
- 2025GenHSI: Controllable Generation of Human-Scene Interaction Videos24 Jun 2025
- 2025Toward Rich Video Human-Motion2D Generation17 Jun 2025
- 2025DanceTogether! Identity-Preserving Multi-Person Interactive Video Generation23 May 2025
- 2024CFSynthesis: Controllable and Free-view 3D Human Video Synthesis15 Dec 2024
- 20243DTrajMaster: Mastering 3D Trajectory for Multi-Entity Motion in Video Generation10 Dec 2024
- 2024Enhancing Motion in Text-to-Video Generation with Decomposed Encoding and Conditioning31 Oct 2024
- 2024MovieCharacter: A Tuning-Free Framework for Controllable Character Video Synthesis28 Oct 2024
13 more
- 2024High Quality Human Image Animation using Regional Supervision and Motion Blur Condition29 Sep 2024
- 2024AnyLogo: Symbiotic Subject-Driven Diffusion System with Gemini Status26 Sep 2024
- 2024Adaptive Multi-Modal Control of Digital Human Hand Synthesis Using a Region-Aware Cycle Loss13 Sep 2024
- 2024A Comprehensive Survey on Human Video Generation: Challenges, Methods, and Insights11 Jul 2024
- 2024MimicMotion: High-Quality Human Motion Video Generation with Confidence-aware Pose Guidance28 Jun 2024
- 2024I4VGen: Image as Free Stepping Stone for Text-to-Video Generation4 Jun 2024
- 2024DeMamba: AI-Generated Video Detection on Million-Scale GenVideo Benchmark30 May 2024
- 2024SignLLM: Sign Language Production Large Language Models17 May 2024
- 2024A Survey on Personalized Content Synthesis with Diffusion Models9 May 2024
- 2024InitNO: Boosting Text-to-Image Diffusion Models via Initial Noise Optimization6 Apr 2024
- 2024Champ: Controllable and Consistent Human Image Animation with 3D Parametric Guidance21 Mar 2024
- 2024Direct-a-Video: Customized Video Generation with User-Directed Camera Movement and Object Motion5 Feb 2024
- 2024Boximator: Generating Rich and Controllable Motions for Video Synthesis2 Feb 2024
- 2024Champ: Controllable and Consistent Human Image Animation with 3D Parametric Guidancecited by 272
- 2024Direct-a-Video: Customized Video Generation with User-Directed Camera Movement and Object Motioncited by 167
- 2024InitNO: Boosting Text-to-Image Diffusion Models via Initial Noise Optimizationcited by 123
- 2024A Survey on Personalized Content Synthesis with Diffusion Modelscited by 29
- 2024I4VGen: Image as Free Stepping Stone for Text-to-Video Generationcited by 14
- 2024High Quality Human Image Animation using Regional Supervision and Motion Blur Conditioncited by 7
- 2025GenHSI: Controllable Generation of Human-Scene Interaction Videoscited by 6
- 2024Adaptive Multi-Modal Control of Digital Human Hand Synthesis Using a Region-Aware Cycle Losscited by 2
- 2024AnyLogo: Symbiotic Subject-Driven Diffusion System with Gemini Statuscited by 2
- 2026Controllable Complex Human Motion Video Generation via Text-to-Skeleton Cascadescited by 0
- 2026Controllable Complex Human Motion Video Generation via Text-to-Skeleton Cascades9 Mar 2026
- 2025GenHSI: Controllable Generation of Human-Scene Interaction Videos24 Jun 2025
- 2024High Quality Human Image Animation using Regional Supervision and Motion Blur Condition29 Sep 2024
- 2024AnyLogo: Symbiotic Subject-Driven Diffusion System with Gemini Status26 Sep 2024
- 2024Adaptive Multi-Modal Control of Digital Human Hand Synthesis Using a Region-Aware Cycle Loss13 Sep 2024
- 2024I4VGen: Image as Free Stepping Stone for Text-to-Video Generation4 Jun 2024
- 2024A Survey on Personalized Content Synthesis with Diffusion Models9 May 2024
- 2024InitNO: Boosting Text-to-Image Diffusion Models via Initial Noise Optimization6 Apr 2024
- 2024Champ: Controllable and Consistent Human Image Animation with 3D Parametric Guidance21 Mar 2024
- 2024Direct-a-Video: Customized Video Generation with User-Directed Camera Movement and Object Motion5 Feb 2024
- 2024MimicMotion: High-Quality Human Motion Video Generation with Confidence-aware Pose Guidancecited by 198
- 2024Boximator: Generating Rich and Controllable Motions for Video Synthesiscited by 107
- 2024DeMamba: AI-Generated Video Detection on Million-Scale GenVideo Benchmarkcited by 92
- 20243DTrajMaster: Mastering 3D Trajectory for Multi-Entity Motion in Video Generationcited by 71
- 2024A Comprehensive Survey on Human Video Generation: Challenges, Methods, and Insightscited by 25
- 2025DanceTogether! Identity-Preserving Multi-Person Interactive Video Generationcited by 13
- 2024MovieCharacter: A Tuning-Free Framework for Controllable Character Video Synthesiscited by 12
- 2026MagicFight: Personalized Martial Arts Combat Video Generationcited by 4
- 2024Enhancing Motion in Text-to-Video Generation with Decomposed Encoding and Conditioningcited by 3
- 2024CFSynthesis: Controllable and Free-view 3D Human Video Synthesiscited by 3
- 2024SignLLM: Sign Language Production Large Language Modelscited by 2
- 2025Toward Rich Video Human-Motion2D Generationcited by 2
12 most cited of 15 All 15 (JSON)
- 2026MTOR: Generalizable AI-Generated Video Detection with Multimodal Semantics and Temporal Over-Regularity5 Oct 2026
- 2026CMTA: Leveraging Cross-Modal Temporal Artifacts for Generalizable AI-Generated Video Detection1 May 2026
- 2026ATSS: Detecting AI-Generated Videos via Anomalous Temporal Self-Similarity5 Apr 2026
- 2026MagicFight: Personalized Martial Arts Combat Video Generation5 Jan 2026
- 2025Toward Rich Video Human-Motion2D Generation17 Jun 2025
- 2025DanceTogether! Identity-Preserving Multi-Person Interactive Video Generation23 May 2025
- 2024CFSynthesis: Controllable and Free-view 3D Human Video Synthesis15 Dec 2024
- 20243DTrajMaster: Mastering 3D Trajectory for Multi-Entity Motion in Video Generation10 Dec 2024
- 2024Enhancing Motion in Text-to-Video Generation with Decomposed Encoding and Conditioning31 Oct 2024
- 2024MovieCharacter: A Tuning-Free Framework for Controllable Character Video Synthesis28 Oct 2024
- 2024A Comprehensive Survey on Human Video Generation: Challenges, Methods, and Insights11 Jul 2024
- 2024MimicMotion: High-Quality Human Motion Video Generation with Confidence-aware Pose Guidance28 Jun 2024
12 newest of 15 All 15 (JSON)
Similar, not cited
Close in wording, no citation either way
- 2023DreamVideo: Composing Your Dream Videos with Customized Subject and Motion
- 2024UniAnimate: Taming Unified Video Diffusion Models for Consistent Human Image Animation
- 2024Towards motion from video diffusion models
- 2023DreamVideo: High-Fidelity Image-to-Video Generation with Image Retention and Text Guidance
- 2023Make Pixels Dance: High-Dynamic Video Generation
- 2024Move-in-2D: 2D-Conditioned Human Motion Generation
- 2025LMP: Leveraging Motion Prior in Zero-Shot Video Generation with Diffusion Transformer
- 2025Time-to-Move: Training-Free Motion Controlled Video Generation via Dual-Clock Denoising