mlsanityData to 14 Oct 2026

Human Motion Video Generation: A Survey

arXiv 2509.03883 ↗First posted 4 Sep 2025cs.CV cs.MMcited by 25

Not on the map. Why?

Abstract (arXiv)

Human motion video generation has garnered significant research interest due to its broad applications, enabling innovations such as photorealistic singing heads or dynamic avatars that seamlessly dance to music. However, existing surveys in this field focus on individual methods, lacking a comprehensive overview of the entire generative process. This paper addresses this gap by providing an in-depth survey of human motion video generation, encompassing over ten sub-tasks, and detailing the five key phases of the generation process: input, motion planning, motion video generation, refinement, and output. Notably, this is the first survey that discusses the potential of large language models in enhancing human motion video generation. Our survey reviews the latest developments and technological trends in human motion video generation across three primary modalities: vision, text, and audio. By covering over two hundred papers, we offer a thorough overview of the field and highlight milestone works that have driven significant technological breakthroughs. Our goal for this survey is to unveil the prospects of human motion video generation and serve as a valuable resource for advancing the comprehensive applications of digital humans. A complete list of the models examined in this survey is available in Our Repository https://github.com/Winn1y/Awesome-Human-Motion-Video-Generation.

Key facts. Cited by 25 papers in the map (data through 14 Oct 2026). Builds on 198 of its 239 references that are in the map. First posted on arXiv 4 Sep 2025.

Builds on

198 of 239 references.

References · 198

  1. 2017Attention Is All You Needcited by 60,361
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  3. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  4. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  5. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
  6. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  7. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
  8. 2020Denoising Diffusion Implicit Modelscited by 9,781
  9. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
  10. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,058
  11. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
  12. 2022Scalable Diffusion Models with Transformerscited by 6,054
38 more
  1. 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 6,013
  2. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
  3. 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,718
  4. 2017Neural Discrete Representation Learningcited by 4,712
  5. 2020wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representationscited by 3,905
  6. 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,761
  7. 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,588
  8. 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,581
  9. 2020Conformer: Convolution-augmented Transformer for Speech Recognitioncited by 1,863
  10. 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,822
  11. 2022Make-A-Video: Text-to-Video Generation without Text-Video Datacited by 1,742
  12. 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Modelscited by 1,464
  13. 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuningcited by 1,433
  14. 2018Towards Accurate Generative Models of Video: A New Metric & Challengescited by 1,234
  15. 2018OpenPose: Realtime Multi-Person 2D Pose Estimation using Part Affinity Fieldscited by 1,162
  16. 2022Diffusion Models: A Comprehensive Survey of Methods and Applicationscited by 1,114
  17. 2023Video-ChatGPT: Towards Detailed Video Understanding via Large Vision and Language Modelscited by 1,062
  18. 2020Improved Techniques for Training Score-Based Generative Modelscited by 1,043
  19. 2024Visual Autoregressive Modeling: Scalable Image Generation via Next-Scale Predictioncited by 1,023
  20. 2022Tune-A-Video: One-Shot Tuning of Image Diffusion Models for Text-to-Video Generationcited by 961
  21. 2023Adversarial Diffusion Distillationcited by 759
  22. 2020First Order Motion Model for Image Animationcited by 704
  23. 2023Animate Anyone: Consistent and Controllable Image-to-Video Synthesis for Character Animationcited by 688
  24. 2020A Lip Sync Expert Is All You Need for Speech to Lip Generation In The Wildcited by 672
  25. 2023Text2Video-Zero: Text-to-Image Diffusion Models are Zero-Shot Video Generatorscited by 670
  26. 2023Structure and Content-Guided Video Synthesis with Diffusion Modelscited by 590
  27. 2024VideoCrafter2: Overcoming Data Limitations for High-Quality Video Diffusion Modelscited by 579
  28. 2018DensePose: Dense Human Pose Estimation In The Wildcited by 575
  29. 2023VideoCrafter1: Open Diffusion Models for High-Quality Video Generationcited by 535
  30. 2017MoCoGAN: Decomposing Motion and Content for Video Generationcited by 524
  31. 2023VideoComposer: Compositional Video Synthesis with Motion Controllabilitycited by 464
  32. 2023TokenFlow: Consistent Diffusion Features for Consistent Video Editingcited by 442
  33. 2022SadTalker: Learning Realistic 3D Motion Coefficients for Stylized Audio-Driven Single Image Talking Face Animationcited by 382
  34. 2023EvalCrafter: Benchmarking and Evaluating Large Video Generation Modelscited by 340
  35. 2023MagicAnimate: Temporally Consistent Human Image Animation using Diffusion Modelcited by 330
  36. 2022Exploring Video Quality Assessment on User Generated Contents from Aesthetic and Technical Perspectivescited by 320
  37. 2018Everybody Dance Nowcited by 315
  38. 2023Follow Your Pose: Pose-Guided Text-to-Video Generation using Pose-Free Videoscited by 314

50 most cited of 198 All 198 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 12; 2026: 13.

25 papers.

Sort:

By area:

  1. 2026Past- and Future-Informed KV Cache Policy with Salience Estimation in Autoregressive Video Diffusioncited by 16
  2. 2025FilmWeaver: Weaving Consistent Multi-Shot Videos with Cache-Guided Autoregressive Diffusioncited by 10
  3. 2025Playmate2: Training-Free Multi-Character Audio-Driven Animation via Diffusion Transformer with Reward Feedbackcited by 8
  4. 2026AffectAgent: Collaborative Multi-Agent Reasoning for Retrieval-Augmented Multimodal Emotion Recognitioncited by 6
  5. 2026Engine-Native Editable 3D World Reconstruction with Objects and Lightingcited by 6
  6. 2025MotionVerse: A Unified Multimodal Framework for Motion Comprehension, Generation and Editingcited by 5
  7. 2025Generating Human Motion Videos using a Cascaded Text-to-Video Frameworkcited by 4
  8. 2025DriveVGGT: Calibration-Constrained Visual Geometry Transformers for Multi-Camera Autonomous Drivingcited by 4
  9. 2025OnlineHOI: Towards Online Human-Object Interaction Generation and Perceptioncited by 3
  10. 2025SatireDecoder: Visual Cascaded Decoupling for Enhancing Satirical Image Comprehensioncited by 3
  11. 2025Decoupled Generative Modeling for Human-Object Interaction Synthesiscited by 3
  12. 2026Attribution as Retrieval: Model-Agnostic AI-Generated Image Attributioncited by 3
13 more
  1. 2026Beyond the Golden Data: Resolving the Motion-Vision Quality Dilemma via Timestep Selective Trainingcited by 3
  2. 2026CoInteract: Physically-Consistent Human-Object Interaction Video Synthesis via Spatially-Structured Co-Generationcited by 3
  3. 2026SoulX-LiveAct: Towards Hour-Scale Real-Time Human Animation with Neighbor Forcing and ConvKV Memorycited by 2
  4. 2025Is Visual Realism Enough? Evaluating Gait Biometric Fidelity in Generative AI Human Animationcited by 1
  5. 2025High-Fidelity and Long-Duration Human Image Animation with Diffusion Transformercited by 1
  6. 2026MVAnimate: Enhancing Character Animation with Multi-View Optimizationcited by 1
  7. 2026Training-free Motion Factorization for Compositional Video Generationcited by 1
  8. 2025GreenPlanner: Practical Floorplan Layout Generation via an Energy-Aware and Function-Feasible Generative Frameworkcited by 0
  9. 2025Screen, Cache, and Match: A Training-Free Causality-Consistent Reference Frame Framework for Human Animationcited by 0
  10. 2026TriC-Motion: Tri-Domain Causal Modeling Grounded Text-to-Motion Generationcited by 0
  11. 2026EgoMotion: Hierarchical Reasoning and Diffusion for Egocentric Vision-Language Motion Generationcited by 0
  12. 2026PCA: Persistence-Aware Compression and Aggregation for Fast Video Large Language Modelscited by 0
  13. 2026ComplexSync: High-Fidelity and Real-Time Lip Sync in Complex Scenarioscited by 0