LatentMove: Towards Complex Human Movement Video Generation
Not on the map. Why?
Abstract (arXiv)
Image-to-video (I2V) generation seeks to produce realistic motion sequences from a single reference image. Although recent methods exhibit strong temporal consistency, they often struggle when dealing with complex, non-repetitive human movements, leading to unnatural deformations. To tackle this issue, we present LatentMove, a DiT-based framework specifically tailored for highly dynamic human animation. Our architecture incorporates a conditional control branch and learnable face/body tokens to preserve consistency as well as fine-grained details across frames. We introduce Complex-Human-Videos (CHV), a dataset featuring diverse, challenging human motions designed to benchmark the robustness of I2V systems. We also introduce two metrics to assess the flow and silhouette consistency of generated videos with their ground truth. Experimental results indicate that LatentMove substantially improves human animation quality--particularly when handling rapid, intricate movements--thereby pushing the boundaries of I2V generation. The code, the CHV dataset, and the evaluation metrics will be available at https://github.com/ --.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 59 of its 67 references that are in the map. First posted on arXiv 28 May 2025.
Builds on
59 of 67 references.
References · 59
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
- 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,703
- 2024SAM 2: Segment Anything in Images and Videoscited by 2,863
- 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,581
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,261
- 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,660
- 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuningcited by 1,433
- 2024Depth Anything V2cited by 1,422
- 2018Towards Accurate Generative Models of Video: A New Metric & Challengescited by 1,234
38 more
- 2022CogVideo: Large-scale Pretraining for Text-to-Video Generation via Transformerscited by 985
- 2020First Order Motion Model for Image Animationcited by 704
- 2023Animate Anyone: Consistent and Controllable Image-to-Video Synthesis for Character Animationcited by 688
- 2021VideoGPT: Video Generation using VQ-VAE and Transformerscited by 658
- 2024Open-Sora: Democratizing Efficient Video Production for Allcited by 652
- 2024LTX-Video: Realtime Video Latent Diffusioncited by 581
- 2018DensePose: Dense Human Pose Estimation In The Wildcited by 575
- 2024CameraCtrl: Enabling Camera Control for Text-to-Video Generationcited by 460
- 2024Lumiere: A Space-Time Diffusion Model for Video Generationcited by 455
- 2024Pyramidal Flow Matching for Efficient Video Generative Modelingcited by 366
- 2023MagicAnimate: Temporally Consistent Human Image Animation using Diffusion Modelcited by 330
- 2023Effective Whole-body Pose Estimation with Two-stages Distillationcited by 311
- 2023Photorealistic Video Generation with Diffusion Modelscited by 306
- 2022Unifying Flow, Stereo and Depth Estimationcited by 275
- 2024Champ: Controllable and Consistent Human Image Animation with 3D Parametric Guidancecited by 272
- 2021Motion Representations for Articulated Animationcited by 255
- 2024Sapiens: Foundation for Human Vision Modelscited by 229
- 2024LivePortrait: Efficient Portrait Animation with Stitching and Retargeting Controlcited by 206
- 2024MimicMotion: High-Quality Human Motion Video Generation with Confidence-aware Pose Guidancecited by 198
- 2024ControlNeXt: Powerful and Efficient Control for Image and Video Generationcited by 159
- 2024Identity-Preserving Text-to-Video Generation by Frequency Decompositioncited by 158
- 2023DisCo: Disentangled Control for Realistic Human Dance Generationcited by 142
- 2025OmniHuman-1: Rethinking the Scaling-Up of One-Stage Conditioned Human Animation Modelscited by 129
- 2022Generating Long Videos of Dynamic Scenescited by 113
- 2025VideoJAM: Joint Appearance-Motion Representations for Enhanced Motion Generation in Video Modelscited by 113
- 2024UniAnimate: Taming Unified Video Diffusion Models for Consistent Human Image Animationcited by 102
- 2024DiT4Edit: Diffusion Transformer for Image Editingcited by 101
- 2024Animate-X: Universal Character Image Animation with Enhanced Motion Representationcited by 88
- 2024StableAnimator: High-Quality Identity-Preserving Human Image Animationcited by 88
- 2024EasyAnimate: High-Performance Video Generation Framework with Hybrid Windows Attention and Reward Backpropagationcited by 77
- 2024MIMO: Controllable Character Video Synthesis with Spatial Decomposed Modelingcited by 64
- 2025Animate Anyone 2: High-Fidelity Character Image Animation with Environment Affordancecited by 61
- 2023Text2Performer: Text-Driven Human Video Generationcited by 53
- 2025HumanDiT: Pose-Guided Diffusion Transformer for Long-form Human Motion Video Generationcited by 39
- 2024DisPose: Disentangling Pose Guidance for Controllable Human Image Animationcited by 35
- 2024Task Me Anythingcited by 30
- 2024StoryMaker: Towards Holistic Consistent Characters in Text-to-image Generationcited by 29
- 2024VividPose: Advancing Stable Video Diffusion for Realistic Human Image Animationcited by 27
50 most cited of 59 All 59 (JSON)
Built on by
Citing papers per year: 2026: 1.
1 paper.