KlingAvatar 2.0 Technical Report
Not on the map. Why?
Abstract (arXiv)
Avatar video generation models have achieved remarkable progress in recent years. However, prior work exhibits limited efficiency in generating long-duration high-resolution videos, suffering from temporal drifting, quality degradation, and weak prompt following as video length increases. To address these challenges, we propose KlingAvatar 2.0, a spatio-temporal cascade framework that performs upscaling in both spatial resolution and temporal dimension. The framework first generates low-resolution blueprint video keyframes that capture global semantics and motion, and then refines them into high-resolution, temporally coherent sub-clips using a first-last frame strategy, while retaining smooth temporal transitions in long-form videos. To enhance cross-modal instruction fusion and alignment in extended videos, we introduce a Co-Reasoning Director composed of three modality-specific large language model (LLM) experts. These experts reason about modality priorities and infer underlying user intent, converting inputs into detailed storylines through multi-turn dialogue. A Negative Director further refines negative prompts to improve instruction alignment. Building on these components, we extend the framework to support ID-specific multi-character control. Extensive experiments demonstrate that our model effectively addresses the challenges of efficient, multimodally aligned long-form high-resolution video generation, delivering enhanced visual clarity, realistic lip-teeth rendering with accurate lip synchronization, strong identity preservation, and coherent multimodal instruction following.
Key facts. Cited by 11 papers in the map (data through 7 Oct 2026). Builds on 66 of its 74 references that are in the map. First posted on arXiv 15 Dec 2025.
Builds on
66 of 74 references.
References · 66
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2020Denoising Diffusion Implicit Modelscited by 9,655
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
- 2022Scalable Diffusion Models with Transformerscited by 5,931
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
- 2024SAM 2: Segment Anything in Images and Videoscited by 2,784
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
- 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,526
- 2022Video Diffusion Modelscited by 2,280
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,198
38 more
- 2022Make-A-Video: Text-to-Video Generation without Text-Video Datacited by 1,725
- 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,597
- 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuningcited by 1,418
- 2023One-step Diffusion with Distribution Matching Distillationcited by 978
- 2020First Order Motion Model for Image Animationcited by 698
- 2023Animate Anyone: Consistent and Controllable Image-to-Video Synthesis for Character Animationcited by 683
- 2023ModelScope Text-to-Video Technical Reportcited by 651
- 2024Open-Sora: Democratizing Efficient Video Production for Allcited by 637
- 2020One-Shot Free-View Neural Talking-Head Synthesis for Video Conferencingcited by 438
- 2022SadTalker: Learning Realistic 3D Motion Coefficients for Stylized Audio-Driven Single Image Talking Face Animationcited by 380
- 2023Effective Whole-body Pose Estimation with Two-stages Distillationcited by 307
- 2025MAGI-1: Autoregressive Video Generation at Scalecited by 262
- 2021Motion Representations for Articulated Animationcited by 253
- 2024EMO: Emote Portrait Alive -- Generating Expressive Portrait Videos with Audio2Video Diffusion Model under Weak Conditionscited by 233
- 2022Thin-Plate Spline Motion Model for Image Animationcited by 209
- 2024LivePortrait: Efficient Portrait Animation with Stitching and Retargeting Controlcited by 202
- 2024Hallo: Hierarchical Audio-Driven Visual Synthesis for Portrait Image Animationcited by 198
- 2024EchoMimic: Lifelike Audio-Driven Portrait Animations through Editable Landmark Conditionscited by 196
- 2024VASA-1: Lifelike Audio-Driven Talking Faces Generated in Real Timecited by 186
- 2025Step-Video-T2V Technical Report: The Practice, Challenges, and Future of Video Foundation Modelcited by 163
- 2025Context as Memory: Scene-Consistent Interactive Long Video Generation with Memory Retrievalcited by 157
- 2023Diffused Heads: Diffusion Models Beat GANs on Talking-Face Generationcited by 142
- 2024Real-Time Video Generation with Pyramid Attention Broadcastcited by 140
- 2024PIXART-δ: Fast and Controllable Image Generation with Latent Consistency Modelscited by 139
- 2025OmniHuman-1: Rethinking the Scaling-Up of One-Stage Conditioned Human Animation Modelscited by 127
- 2025Long-Context Autoregressive Video Modeling with Next-Frame Predictioncited by 119
- 2024Loopy: Taming Audio-Driven Portrait Avatar with Long-Term Motion Dependencycited by 102
- 2025HunyuanWorld 1.0: Generating Immersive, Explorable, and Interactive 3D Worlds from Words or Pixelscited by 91
- 2024V-Express: Conditional Dropout for Progressive Training of Portrait Video Generationcited by 85
- 2025FantasyTalking: Realistic Talking Portrait Generation via Coherent Motion Synthesiscited by 77
- 2025OmniAvatar: Efficient Audio-Driven Avatar Video Generation with Adaptive Body Animationcited by 77
- 2024EchoMimicV2: Towards Striking, Simplified, and Semi-Body Human Animationcited by 69
- 2025Vid2World: Crafting Video Diffusion Models to Interactive World Modelscited by 67
- 2025Let Them Talk: Audio-Driven Multi-Person Conversational Video Generationcited by 64
- 2025Wan-S2V: Audio-Driven Cinematic Video Generationcited by 60
- 2023GAIA: Zero-shot Talking Avatar Generationcited by 43
- 2025SkyReels-A1: Expressive Portrait Animation in Video Diffusion Transformerscited by 33
- 2025EMO2: End-Effector Guided Audio-Driven Avatar Video Generationcited by 32
50 most cited of 66 All 66 (JSON)
Built on by
Citing papers per year: 2026: 11.
11 papers.
- 2026RoboWM-Bench: A Benchmark for Evaluating World Models in Robotic Manipulationcited by 15
- 2026LPM 1.0: Video-based Character Performance Modelcited by 11
- 2026MME-CoF-Pro: Evaluating Reasoning Coherence in Video Generative Models with Text and Visual Hintscited by 4
- 2026Kling-MotionControl Technical Reportcited by 3
- 2026InterDyad: Interactive Dyadic Speech-to-Video Generation by Querying Intermediate Visual Guidancecited by 1
- 2026Wan-Dancer: A Hierarchical Framework for Minute-scale Coherent Music-to-Dance Generationcited by 1
- 2026JoyStreamer: Unlocking Highly Expressive Avatars via Harmonized Text-Audio Conditioningcited by 0
- 2026Vibe AIGC: A New Paradigm for Content Generation via Agentic Orchestrationcited by 0
- 2026EchoTorrent: Towards Swift, Sustained, and Streaming Multi-Modal Video Generationcited by 0
- 2026V2V-Bench: A Comprehensive Benchmark for Video-to-Video Generation Evaluationcited by 0
- 2026MegaAvatar: Controllable Talking Avatar Generationcited by 0
- 2026MegaAvatar: Controllable Talking Avatar Generation30 Sep 2026
- 2026Wan-Dancer: A Hierarchical Framework for Minute-scale Coherent Music-to-Dance Generation10 Jul 2026
- 2026V2V-Bench: A Comprehensive Benchmark for Video-to-Video Generation Evaluation4 Jun 2026
- 2026RoboWM-Bench: A Benchmark for Evaluating World Models in Robotic Manipulation21 Apr 2026
- 2026LPM 1.0: Video-based Character Performance Model9 Apr 2026
- 2026InterDyad: Interactive Dyadic Speech-to-Video Generation by Querying Intermediate Visual Guidance24 Mar 2026
- 2026MME-CoF-Pro: Evaluating Reasoning Coherence in Video Generative Models with Text and Visual Hints20 Mar 2026
- 2026Kling-MotionControl Technical Report3 Mar 2026
- 2026EchoTorrent: Towards Swift, Sustained, and Streaming Multi-Modal Video Generation14 Feb 2026
- 2026Vibe AIGC: A New Paradigm for Content Generation via Agentic Orchestration4 Feb 2026
- 2026JoyStreamer: Unlocking Highly Expressive Avatars via Harmonized Text-Audio Conditioning31 Jan 2026