mlsanityData to 7 Oct 2026

KlingAvatar 2.0 Technical Report

arXiv 2512.13313 ↗First posted 15 Dec 2025cs.CVcited by 11

Not on the map. Why?

Abstract (arXiv)

Avatar video generation models have achieved remarkable progress in recent years. However, prior work exhibits limited efficiency in generating long-duration high-resolution videos, suffering from temporal drifting, quality degradation, and weak prompt following as video length increases. To address these challenges, we propose KlingAvatar 2.0, a spatio-temporal cascade framework that performs upscaling in both spatial resolution and temporal dimension. The framework first generates low-resolution blueprint video keyframes that capture global semantics and motion, and then refines them into high-resolution, temporally coherent sub-clips using a first-last frame strategy, while retaining smooth temporal transitions in long-form videos. To enhance cross-modal instruction fusion and alignment in extended videos, we introduce a Co-Reasoning Director composed of three modality-specific large language model (LLM) experts. These experts reason about modality priorities and infer underlying user intent, converting inputs into detailed storylines through multi-turn dialogue. A Negative Director further refines negative prompts to improve instruction alignment. Building on these components, we extend the framework to support ID-specific multi-character control. Extensive experiments demonstrate that our model effectively addresses the challenges of efficient, multimodally aligned long-form high-resolution video generation, delivering enhanced visual clarity, realistic lip-teeth rendering with accurate lip synchronization, strong identity preservation, and coherent multimodal instruction following.

Key facts. Cited by 11 papers in the map (data through 7 Oct 2026). Builds on 66 of its 74 references that are in the map. First posted on arXiv 15 Dec 2025.

Builds on

66 of 74 references.

References · 66

  1. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  2. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  4. 2020Denoising Diffusion Implicit Modelscited by 9,655
  5. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
  6. 2022Scalable Diffusion Models with Transformerscited by 5,931
  7. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
  8. 2024SAM 2: Segment Anything in Images and Videoscited by 2,784
  9. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
  10. 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,526
  11. 2022Video Diffusion Modelscited by 2,280
  12. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,198
38 more
  1. 2022Make-A-Video: Text-to-Video Generation without Text-Video Datacited by 1,725
  2. 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,597
  3. 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuningcited by 1,418
  4. 2023One-step Diffusion with Distribution Matching Distillationcited by 978
  5. 2020First Order Motion Model for Image Animationcited by 698
  6. 2023Animate Anyone: Consistent and Controllable Image-to-Video Synthesis for Character Animationcited by 683
  7. 2023ModelScope Text-to-Video Technical Reportcited by 651
  8. 2024Open-Sora: Democratizing Efficient Video Production for Allcited by 637
  9. 2020One-Shot Free-View Neural Talking-Head Synthesis for Video Conferencingcited by 438
  10. 2022SadTalker: Learning Realistic 3D Motion Coefficients for Stylized Audio-Driven Single Image Talking Face Animationcited by 380
  11. 2023Effective Whole-body Pose Estimation with Two-stages Distillationcited by 307
  12. 2025MAGI-1: Autoregressive Video Generation at Scalecited by 262
  13. 2021Motion Representations for Articulated Animationcited by 253
  14. 2024EMO: Emote Portrait Alive -- Generating Expressive Portrait Videos with Audio2Video Diffusion Model under Weak Conditionscited by 233
  15. 2022Thin-Plate Spline Motion Model for Image Animationcited by 209
  16. 2024LivePortrait: Efficient Portrait Animation with Stitching and Retargeting Controlcited by 202
  17. 2024Hallo: Hierarchical Audio-Driven Visual Synthesis for Portrait Image Animationcited by 198
  18. 2024EchoMimic: Lifelike Audio-Driven Portrait Animations through Editable Landmark Conditionscited by 196
  19. 2024VASA-1: Lifelike Audio-Driven Talking Faces Generated in Real Timecited by 186
  20. 2025Step-Video-T2V Technical Report: The Practice, Challenges, and Future of Video Foundation Modelcited by 163
  21. 2025Context as Memory: Scene-Consistent Interactive Long Video Generation with Memory Retrievalcited by 157
  22. 2023Diffused Heads: Diffusion Models Beat GANs on Talking-Face Generationcited by 142
  23. 2024Real-Time Video Generation with Pyramid Attention Broadcastcited by 140
  24. 2024PIXART-δ: Fast and Controllable Image Generation with Latent Consistency Modelscited by 139
  25. 2025OmniHuman-1: Rethinking the Scaling-Up of One-Stage Conditioned Human Animation Modelscited by 127
  26. 2025Long-Context Autoregressive Video Modeling with Next-Frame Predictioncited by 119
  27. 2024Loopy: Taming Audio-Driven Portrait Avatar with Long-Term Motion Dependencycited by 102
  28. 2025HunyuanWorld 1.0: Generating Immersive, Explorable, and Interactive 3D Worlds from Words or Pixelscited by 91
  29. 2024V-Express: Conditional Dropout for Progressive Training of Portrait Video Generationcited by 85
  30. 2025FantasyTalking: Realistic Talking Portrait Generation via Coherent Motion Synthesiscited by 77
  31. 2025OmniAvatar: Efficient Audio-Driven Avatar Video Generation with Adaptive Body Animationcited by 77
  32. 2024EchoMimicV2: Towards Striking, Simplified, and Semi-Body Human Animationcited by 69
  33. 2025Vid2World: Crafting Video Diffusion Models to Interactive World Modelscited by 67
  34. 2025Let Them Talk: Audio-Driven Multi-Person Conversational Video Generationcited by 64
  35. 2025Wan-S2V: Audio-Driven Cinematic Video Generationcited by 60
  36. 2023GAIA: Zero-shot Talking Avatar Generationcited by 43
  37. 2025SkyReels-A1: Expressive Portrait Animation in Video Diffusion Transformerscited by 33
  38. 2025EMO2: End-Effector Guided Audio-Driven Avatar Video Generationcited by 32

50 most cited of 66 All 66 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 11.

11 papers.