mlsanityData to 14 Oct 2026

HyperMotionX: The Dataset and Benchmark with DiT-Based Pose-Guided Human Image Animation of Complex Motions

arXiv 2505.22977 ↗First posted 29 May 2025cs.CVcited by 4

On the map: Diffusion models → Video generation

Abstract (arXiv)

Recent advances in diffusion models have significantly improved conditional video generation, particularly in the pose-guided human image animation task. Although existing methods are capable of generating high-fidelity and time-consistent animation sequences in regular motions and static scenes. However there are still obvious limitations when facing complex human body motions that contain highly dynamic, non-standard motions, and the lack of a high-quality benchmark for evaluation of complex human motion animations. To address this challenge, we propose a concise yet powerful DiT-based human animation generation baseline and design spatial low-frequency enhanced RoPE, a novel module that selectively enhances low-frequency spatial feature modeling by introducing learnable frequency scaling. Furthermore, we introduce the Open-HyperMotionX Dataset and HyperMotionX Bench, which provide high-quality human pose annotations and curated video clips for evaluating and improving pose-guided human image animation models under complex human motion conditions. Our method significantly improves structural stability and appearance consistency in highly dynamic human motion sequences. Extensive experiments demonstrate the effectiveness of our dataset and proposed approach in advancing the generation quality of complex human motion image animations. The codes, model weights, and dataset have been made publicly available at https://vivocameraresearch.github.io/hypermotion/

Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Placed in Video generation, one of 14 directions in Diffusion models. Builds on 46 of its 61 references that are in the map. First posted on arXiv 29 May 2025.

Builds on

46 of 61 references.

Closest ancestors · 7

Same direction, newest first

  1. 2024StableAnimator: High-Quality Identity-Preserving Human Image Animation26 Nov
  2. 2024UniAnimate: Taming Unified Video Diffusion Models for Consistent Human Image Animation3 Jun
  3. 2024Champ: Controllable and Consistent Human Image Animation with 3D Parametric Guidance21 Mar
  4. 2023Animate Anyone: Consistent and Controllable Image-to-Video Synthesis for Character Animation28 Nov
  5. 2023MagicAnimate: Temporally Consistent Human Image Animation using Diffusion Model27 Nov
  6. 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuning10 Jul
  7. 2022Video Diffusion Models7 Apr

Other references · 39

  1. 2017Attention Is All You Needcited by 60,361
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  3. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
  4. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  5. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
  6. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
  7. 2022Scalable Diffusion Models with Transformerscited by 6,054
  8. 2022Generative Adversarial Networkscited by 5,627
  9. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
  10. 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,703
  11. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
  12. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
27 more
  1. 2023InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Taskscited by 2,565
  2. 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,822
  3. 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,660
  4. 2019ZeRO: Memory Optimizations Toward Training Trillion Parameter Modelscited by 1,301
  5. 2018Towards Accurate Generative Models of Video: A New Metric & Challengescited by 1,234
  6. 2018OpenPose: Realtime Multi-Person 2D Pose Estimation using Part Affinity Fieldscited by 1,162
  7. 2022CogVideo: Large-scale Pretraining for Text-to-Video Generation via Transformerscited by 985
  8. 2020First Order Motion Model for Image Animationcited by 704
  9. 2017The Perception-Distortion Tradeoffcited by 587
  10. 2023Effective Whole-body Pose Estimation with Two-stages Distillationcited by 311
  11. 2021Motion Representations for Articulated Animationcited by 255
  12. 2023Motion-X: A Large-scale 3D Expressive Whole-body Human Motion Datasetcited by 227
  13. 2024MimicMotion: High-Quality Human Motion Video Generation with Confidence-aware Pose Guidancecited by 198
  14. 2023RTMPose: Real-Time Multi-Person Pose Estimation based on MMPosecited by 175
  15. 2024ControlNeXt: Powerful and Efficient Control for Image and Video Generationcited by 159
  16. 2023UniMax: Fairer and more Effective Language Sampling for Large-Scale Multilingual Pretrainingcited by 151
  17. 2023DisCo: Disentangled Control for Realistic Human Dance Generationcited by 142
  18. 2019DwNet: Dense warp-based network for pose-guided human video generationcited by 115
  19. 2025VideoJAM: Joint Appearance-Motion Representations for Enhanced Motion Generation in Video Modelscited by 113
  20. 2019Dense Intrinsic Appearance Flow for Human Pose Transfercited by 104
  21. 2022Generative Neural Articulated Radiance Fieldscited by 101
  22. 2024Animate-X: Universal Character Image Animation with Enhanced Motion Representationcited by 88
  23. 2024HumanVid: Demystifying Training Data for Camera-controllable Human Image Animationcited by 64
  24. 2024RealisDance: Equip controllable character animation with realistic handscited by 37
  25. 2025DreamActor-M1: Holistic, Expressive and Robust Human Image Animation with Hybrid Guidancecited by 36
  26. 2025Motion-X++: A Large-Scale Multimodal 3D Whole-body Human Motion Datasetcited by 33
  27. 2025Traversing Distortion-Perception Tradeoff using a Single Score-Based Generative Modelcited by 5

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 2; 2026: 2.

4 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025High-Fidelity and Long-Duration Human Image Animation with Diffusion Transformer
  2. 2025HumanDiT: Pose-Guided Diffusion Transformer for Long-form Human Motion Video Generation
  3. 2025EchoMotion: Unified Human Video and Motion Generation via Dual-Modality Diffusion Transformer
  4. 2026HumANDiff: Articulated Noise Diffusion for Motion-Consistent Human Video Generation
  5. 2025OmniMotion-X: Versatile Multimodal Whole-Body Motion Generation
  6. 2023Make-An-Animation: Large-Scale Text-conditional 3D Human Motion Generation
  7. 2024Towards motion from video diffusion models
  8. 2024DreamDance: Animating Human Images by Enriching 3D Geometry Cues from 2D Poses