HyperMotionX: The Dataset and Benchmark with DiT-Based Pose-Guided Human Image Animation of Complex Motions
On the map: Diffusion models → Video generation
Abstract (arXiv)
Recent advances in diffusion models have significantly improved conditional video generation, particularly in the pose-guided human image animation task. Although existing methods are capable of generating high-fidelity and time-consistent animation sequences in regular motions and static scenes. However there are still obvious limitations when facing complex human body motions that contain highly dynamic, non-standard motions, and the lack of a high-quality benchmark for evaluation of complex human motion animations. To address this challenge, we propose a concise yet powerful DiT-based human animation generation baseline and design spatial low-frequency enhanced RoPE, a novel module that selectively enhances low-frequency spatial feature modeling by introducing learnable frequency scaling. Furthermore, we introduce the Open-HyperMotionX Dataset and HyperMotionX Bench, which provide high-quality human pose annotations and curated video clips for evaluating and improving pose-guided human image animation models under complex human motion conditions. Our method significantly improves structural stability and appearance consistency in highly dynamic human motion sequences. Extensive experiments demonstrate the effectiveness of our dataset and proposed approach in advancing the generation quality of complex human motion image animations. The codes, model weights, and dataset have been made publicly available at https://vivocameraresearch.github.io/hypermotion/
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Placed in Video generation, one of 14 directions in Diffusion models. Builds on 46 of its 61 references that are in the map. First posted on arXiv 29 May 2025.
Builds on
46 of 61 references.
Closest ancestors · 7
Same direction, newest first
- 2024StableAnimator: High-Quality Identity-Preserving Human Image Animation26 Nov
- 2024UniAnimate: Taming Unified Video Diffusion Models for Consistent Human Image Animation3 Jun
- 2024Champ: Controllable and Consistent Human Image Animation with 3D Parametric Guidance21 Mar
- 2023Animate Anyone: Consistent and Controllable Image-to-Video Synthesis for Character Animation28 Nov
- 2023MagicAnimate: Temporally Consistent Human Image Animation using Diffusion Model27 Nov
- 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuning10 Jul
- 2022Video Diffusion Models7 Apr
Other references · 39
- 2017Attention Is All You Needcited by 60,361
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 2022Scalable Diffusion Models with Transformerscited by 6,054
- 2022Generative Adversarial Networkscited by 5,627
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
- 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,703
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
27 more
- 2023InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Taskscited by 2,565
- 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,822
- 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,660
- 2019ZeRO: Memory Optimizations Toward Training Trillion Parameter Modelscited by 1,301
- 2018Towards Accurate Generative Models of Video: A New Metric & Challengescited by 1,234
- 2018OpenPose: Realtime Multi-Person 2D Pose Estimation using Part Affinity Fieldscited by 1,162
- 2022CogVideo: Large-scale Pretraining for Text-to-Video Generation via Transformerscited by 985
- 2020First Order Motion Model for Image Animationcited by 704
- 2017The Perception-Distortion Tradeoffcited by 587
- 2023Effective Whole-body Pose Estimation with Two-stages Distillationcited by 311
- 2021Motion Representations for Articulated Animationcited by 255
- 2023Motion-X: A Large-scale 3D Expressive Whole-body Human Motion Datasetcited by 227
- 2024MimicMotion: High-Quality Human Motion Video Generation with Confidence-aware Pose Guidancecited by 198
- 2023RTMPose: Real-Time Multi-Person Pose Estimation based on MMPosecited by 175
- 2024ControlNeXt: Powerful and Efficient Control for Image and Video Generationcited by 159
- 2023UniMax: Fairer and more Effective Language Sampling for Large-Scale Multilingual Pretrainingcited by 151
- 2023DisCo: Disentangled Control for Realistic Human Dance Generationcited by 142
- 2019DwNet: Dense warp-based network for pose-guided human video generationcited by 115
- 2025VideoJAM: Joint Appearance-Motion Representations for Enhanced Motion Generation in Video Modelscited by 113
- 2019Dense Intrinsic Appearance Flow for Human Pose Transfercited by 104
- 2022Generative Neural Articulated Radiance Fieldscited by 101
- 2024Animate-X: Universal Character Image Animation with Enhanced Motion Representationcited by 88
- 2024HumanVid: Demystifying Training Data for Camera-controllable Human Image Animationcited by 64
- 2024RealisDance: Equip controllable character animation with realistic handscited by 37
- 2025DreamActor-M1: Holistic, Expressive and Robust Human Image Animation with Hybrid Guidancecited by 36
- 2025Motion-X++: A Large-Scale Multimodal 3D Whole-body Human Motion Datasetcited by 33
- 2025Traversing Distortion-Perception Tradeoff using a Single Score-Based Generative Modelcited by 5
Built on by
Citing papers per year: 2025: 2; 2026: 2.
4 papers.
- 2025Animate-X++: Universal Character Image Animation with Dynamic Backgroundscited by 10
- 2025SteadyDancer: Harmonized and Coherent Human Image Animation with First-Frame Preservationcited by 10
- 2026SCAIL-2: Unifying Controlled Character Animation with End-to-End In-Context Conditioningcited by 8
- 2026Controllable Complex Human Motion Video Generation via Text-to-Skeleton Cascadescited by 0
- 2026SCAIL-2: Unifying Controlled Character Animation with End-to-End In-Context Conditioning9 Jun 2026
- 2026Controllable Complex Human Motion Video Generation via Text-to-Skeleton Cascades9 Mar 2026
- 2025SteadyDancer: Harmonized and Coherent Human Image Animation with First-Frame Preservation24 Nov 2025
- 2025Animate-X++: Universal Character Image Animation with Dynamic Backgrounds13 Aug 2025
Similar, not cited
Close in wording, no citation either way
- 2025High-Fidelity and Long-Duration Human Image Animation with Diffusion Transformer
- 2025HumanDiT: Pose-Guided Diffusion Transformer for Long-form Human Motion Video Generation
- 2025EchoMotion: Unified Human Video and Motion Generation via Dual-Modality Diffusion Transformer
- 2026HumANDiff: Articulated Noise Diffusion for Motion-Consistent Human Video Generation
- 2025OmniMotion-X: Versatile Multimodal Whole-Body Motion Generation
- 2023Make-An-Animation: Large-Scale Text-conditional 3D Human Motion Generation
- 2024Towards motion from video diffusion models
- 2024DreamDance: Animating Human Images by Enriching 3D Geometry Cues from 2D Poses