mlsanityData to 14 Oct 2026

Kling-MotionControl Technical Report

arXiv 2603.03160 ↗First posted 3 Mar 2026cs.CVcited by 4

Not on the map. Why?

Abstract (arXiv)

Character animation aims to generate lifelike videos by transferring motion dynamics from a driving video to a reference image. Recent strides in generative models have paved the way for high-fidelity character animation. In this work, we present Kling-MotionControl, a unified DiT-based framework engineered specifically for robust, precise, and expressive holistic character animation. Leveraging a divide-and-conquer strategy within a cohesive system, the model orchestrates heterogeneous motion representations tailored to the distinct characteristics of body, face, and hands, effectively reconciling large-scale structural stability with fine-grained articulatory expressiveness. To ensure robust cross-identity generalization, we incorporate adaptive identity-agnostic learning, facilitating natural motion retargeting for diverse characters ranging from realistic humans to stylized cartoons. Simultaneously, we guarantee faithful appearance preservation through meticulous identity injection and fusion designs, further supported by a subject library mechanism that leverages comprehensive reference contexts. To ensure practical utility, we implement an advanced acceleration framework utilizing multi-stage distillation, boosting inference speed by over 10x. Kling-MotionControl distinguishes itself through intelligent semantic motion understanding and precise text responsiveness, allowing for flexible control beyond visual inputs. Human preference evaluations demonstrate that Kling-MotionControl delivers superior performance compared to leading commercial and open-source solutions, achieving exceptional fidelity in holistic motion control, open domain generalization, and visual quality and coherence. These results establish Kling-MotionControl as a robust solution for high-quality, controllable, and lifelike character animation.

Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 32 of its 36 references that are in the map. First posted on arXiv 3 Mar 2026.

Builds on

32 of 36 references.

References · 32

  1. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  3. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
  4. 2022Scalable Diffusion Models with Transformerscited by 6,054
  5. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
  6. 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,581
  7. 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,660
  8. 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuningcited by 1,433
  9. 2020First Order Motion Model for Image Animationcited by 704
  10. 2023Animate Anyone: Consistent and Controllable Image-to-Video Synthesis for Character Animationcited by 688
  11. 2018DensePose: Dense Human Pose Estimation In The Wildcited by 575
  12. 2023MagicAnimate: Temporally Consistent Human Image Animation using Diffusion Modelcited by 330
20 more
  1. 2024Champ: Controllable and Consistent Human Image Animation with 3D Parametric Guidancecited by 272
  2. 2021Motion Representations for Articulated Animationcited by 255
  3. 2024LivePortrait: Efficient Portrait Animation with Stitching and Retargeting Controlcited by 206
  4. 2024MimicMotion: High-Quality Human Motion Video Generation with Confidence-aware Pose Guidancecited by 198
  5. 2024X-Portrait: Expressive Portrait Animation with Hierarchical Motion Attentioncited by 91
  6. 2024Animate-X: Universal Character Image Animation with Enhanced Motion Representationcited by 88
  7. 2025Wan-Animate: Unified Character Animation and Replacement with Holistic Replicationcited by 80
  8. 2024MIMO: Controllable Character Video Synthesis with Spatial Decomposed Modelingcited by 64
  9. 2025Animate Anyone 2: High-Fidelity Character Image Animation with Environment Affordancecited by 61
  10. 2025HuMo: Human-Centric Video Generation via Collaborative Multi-Modal Conditioningcited by 47
  11. 2025UniAnimate-DiT: Human Image Animation with Large-Scale Video Diffusion Transformercited by 42
  12. 2025DreamActor-M1: Holistic, Expressive and Robust Human Image Animation with Hybrid Guidancecited by 36
  13. 2024Co-Speech Gesture Video Generation via Motion-Decoupled Diffusion Modelcited by 35
  14. 2025SkyReels-A1: Expressive Portrait Animation in Video Diffusion Transformerscited by 33
  15. 2024Sora Generates Videos with Stunning Geometrical Consistencycited by 31
  16. 2025X-NeMo: Expressive Neural Motion Reenactment via Disentangled Latent Attentioncited by 28
  17. 2024MagicMan: Generative Novel View Synthesis of Humans with 3D-Aware Diffusion and Iterative Refinementcited by 24
  18. 2025Kling-Avatar: Grounding Multimodal Instructions for Cascaded Long-Duration Avatar Animation Synthesiscited by 21
  19. 2025X-UniMotion: Animating Human Images with Expressive, Unified and Identity-Agnostic Motion Latentscited by 13
  20. 2025KlingAvatar 2.0 Technical Reportcited by 13

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 4.

4 papers.