mlsanityData to 14 Oct 2026

Exploring the Role of Synthetic Data Augmentation in Controllable Human-Centric Video Generation

arXiv 2604.21291 ↗First posted 23 Apr 2026cs.CV cs.AIcited by 1

Not on the map. Why?

Abstract (arXiv)

Controllable human video generation aims to produce realistic videos of humans with explicitly guided motions and appearances,serving as a foundation for digital humans, animation, and embodied AI.However, the scarcity of largescale, diverse, and privacy safe human video datasets poses a major bottleneck, especially for rare identities and complex actions.Synthetic data provides a scalable and controllable alternative,yet its actual contribution to generative modeling remains underexplored due to the persistent Sim2Real gap.In this work,we systematically investigate the impact of synthetic data on controllable human video generation. We propose a diffusion-based framework that enables fine-grained control over appearance and motion while providing a unfied testbed to analyze how synthetic data interacts with real world data during training. Through extensive experiments, we reveal the complementary roles of synthetic and real data and demonstrate possible methods for efficiently selecting synthetic samples to enhance motion realism,temporal consistency,and identity preservation.Our study offers the first comprehensive exploration of synthetic data's role in human-centric video synthesis and provides practical insights for building data-efficient and generalizable generative models.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 43 of its 51 references that are in the map. First posted on arXiv 23 Apr 2026.

Builds on

43 of 51 references.

References · 43

  1. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  3. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  4. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  5. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
  6. 2020Denoising Diffusion Implicit Modelscited by 9,781
  7. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
  8. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
  9. 2022Generative Adversarial Networkscited by 5,627
  10. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
  11. 2022Video Diffusion Modelscited by 2,305
  12. 2020GLU Variants Improve Transformercited by 1,804
31 more
  1. 2017Domain Randomization for Transferring Deep Neural Networks from Simulation to the Real Worldcited by 1,498
  2. 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuningcited by 1,433
  3. 2018Towards Accurate Generative Models of Video: A New Metric & Challengescited by 1,234
  4. 2024Grounded SAM: Assembling Open-World Models for Diverse Visual Taskscited by 929
  5. 2016Playing for Data: Ground Truth from Computer Gamescited by 818
  6. 2023Animate Anyone: Consistent and Controllable Image-to-Video Synthesis for Character Animationcited by 688
  7. 2018Video-to-Video Synthesiscited by 390
  8. 2023MagicAnimate: Temporally Consistent Human Image Animation using Diffusion Modelcited by 330
  9. 2023Common Diffusion Noise Schedules and Sample Steps are Flawedcited by 310
  10. 2018Training Deep Networks with Synthetic Data: Bridging the Reality Gap by Domain Randomizationcited by 294
  11. 2022EMOCA: Emotion Driven Monocular Face Capture and Animationcited by 255
  12. 2016CAD2RL: Real Single-Image Flight without a Single Real Imagecited by 233
  13. 2024Sapiens: Foundation for Human Vision Modelscited by 229
  14. 2024MimicMotion: High-Quality Human Motion Video Generation with Confidence-aware Pose Guidancecited by 198
  15. 2022Fake it till you make it: Learning transferable representations from synthetic ImageNet clonescited by 172
  16. 2018Looking to Listen at the Cocktail Party: A Speaker-Independent Audio-Visual Model for Speech Separationcited by 162
  17. 2023SMPLer-X: Scaling Up Expressive Human Pose and Shape Estimationcited by 155
  18. 2023DisCo: Disentangled Control for Realistic Human Dance Generationcited by 142
  19. 2024StableAnimator: High-Quality Identity-Preserving Human Image Animationcited by 88
  20. 2018Dense Pose Transfercited by 83
  21. 2024MIMO: Controllable Character Video Synthesis with Spatial Decomposed Modelingcited by 64
  22. 2025Animate Anyone 2: High-Fidelity Character Image Animation with Environment Affordancecited by 61
  23. 2023High-Fidelity and Freely Controllable Talking Head Video Generationcited by 42
  24. 2024RealisDance: Equip controllable character animation with realistic handscited by 37
  25. 2025SpeakerVid-5M: A Large-Scale High-Quality Dataset for Audio-Visual Dyadic Interactive Human Generationcited by 30
  26. 2024Generative Inbetweening through Frame-wise Conditions-Driven Video Generationcited by 24
  27. 2024Faces that Speak: Jointly Synthesising Talking Face and Speech from Textcited by 21
  28. 2025AccVideo: Accelerating Video Diffusion Model with Synthetic Datasetcited by 15
  29. 2025StableAnimator++: Overcoming Pose Misalignment and Face Distortion for Human Image Animationcited by 14
  30. 2025Style Transfer with Diffusion Models for Synthetic-to-Real Domain Adaptationcited by 6
  31. 2025Exploring the Equivalence of Closed-Set Generative and Real Data Augmentation in Image Classificationcited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.