LongCat-Video-Avatar 1.5 Technical Report
Not on the map. Why?
Abstract (arXiv)
Despite advances in audio-driven video generation, achieving commercial-grade stability remains challenging. We present LongCat-Video-Avatar 1.5, an upgraded open-source framework prioritizing systematic engineering and production-readiness over architectural novelty. By upgrading the audio encoder to Whisper Large and meticulously scaling our training recipes, v1.5 achieves accurate lip-synchronization, full-body temporal stability, and robust long-video generation with strict identity consistency. Through rigorous data curation and RLHF Training, the model readily generalizes to stylized domains such as anime and animals, and natively handles complex real-world conditions, such as multi-person interactions and object handling. Furthermore, addressing the practical demands of industrial deployment, we employ advanced step distillation to accelerate inference to an optimal 8 NFE, achieving a favorable trade-off between serving efficiency and visual fidelity. The superiority of our approach is validated through extensive quantitative metrics and a rigorous human evaluation conducted on a comprehensive benchmark of over 500 diverse test cases. Results show that v1.5 achieves competitive or superior performance compared to leading closed-source systems (e.g., HeyGen, OmniHuman 1.5, Kling Avatar 2.0) across human-likeness ratings and expert-level quality assessments on our benchmark. With its open-source release, LongCat-Video-Avatar 1.5 narrows the gap between academic research prototypes and commercial-grade deployment.
Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 28 of its 36 references that are in the map. First posted on arXiv 26 May 2026.
Builds on
28 of 36 references.
References · 28
- 2022Training language models to follow instructions with human feedbackcited by 15,712
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
- 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 3,972
- 2020wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representationscited by 3,853
- 2025Qwen3-VL Technical Reportcited by 2,534
- 2021ByteTrack: Multi-Object Tracking by Associating Every Detection Boxcited by 812
- 2024Improved Distribution Matching Distillation for Fast Image Synthesiscited by 648
- 2025Qwen3-Omni Technical Reportcited by 451
- 2022YOLOv6: A Single-Stage Object Detection Framework for Industrial Applicationscited by 273
- 2023Upscale-A-Video: Temporal-Consistent Diffusion Model for Real-World Video Super-Resolutioncited by 131
- 2021Is Someone Speaking? Exploring Long-term Temporal Features for Audio-visual Active Speaker Detectioncited by 110
- 2025FantasyTalking: Realistic Talking Portrait Generation via Coherent Motion Synthesiscited by 77
16 more
- 2025OmniAvatar: Efficient Audio-Driven Avatar Video Generation with Adaptive Body Animationcited by 77
- 2025LongCat-Video Technical Reportcited by 73
- 2025HunyuanVideo-Avatar: High-Fidelity Audio-Driven Human Animation for Multiple Characterscited by 64
- 2025Let Them Talk: Audio-Driven Multi-Person Conversational Video Generationcited by 64
- 2025Wan-S2V: Audio-Driven Cinematic Video Generationcited by 60
- 2025HuMo: Human-Centric Video Generation via Collaborative Multi-Modal Conditioningcited by 44
- 2025InfiniteTalk: Audio-driven Video Generation for Sparse-Frame Video Dubbingcited by 40
- 2024FlowVQTalker: High-Quality Emotional Talking Face Generation through Normalizing Flow and Quantizationcited by 39
- 2025OmniHuman-1.5: Instilling an Active Mind in Avatars via Cognitive Simulationcited by 30
- 2025Kling-Avatar: Grounding Multimodal Instructions for Cascaded Long-Duration Avatar Animation Synthesiscited by 20
- 2026LPM 1.0: Video-based Character Performance Modelcited by 11
- 2025SoulX-FlashTalk: Real-Time Infinite Streaming of Audio-Driven Avatars via Self-Correcting Bidirectional Distillationcited by 10
- 2025PersonaLive! Expressive Portrait Image Animation for Live Streamingcited by 6
- 2025Revisiting Active Speaker Detection: An In-the-Wild Benchmark for Generalization and Robustnesscited by 5
- 2025EvalTalker: Learning to Evaluate Real-Portrait-Driven Multi-Subject Talking Humanscited by 3
- 2025JoyStreamer-Flash: Real-time and Infinite Audio-Driven Avatar Generation with Autoregressive Diffusioncited by 3
Built on by
Citing papers per year: 2026: 5.
5 papers.
- 2026OPSD-V: On-Policy Self-Distillation for Post-Training Few-Step Autoregressive Video Generatorscited by 12
- 2026StreamHOI: Interaction-aware Temporal Memory Adaptation for Streaming HOI Video Generationcited by 2
- 2026AptAvatar: Fast and Vivid Long-Form Audio-Driven Video Generation for Production-Ready Avatarscited by 1
- 2026SingDance: Compositional Zero-Shot Singing-and-Dancing Video Generation with Role-Aware Audio Conditioningcited by 0
- 2026MegaAvatar: Controllable Talking Avatar Generationcited by 0
- 2026MegaAvatar: Controllable Talking Avatar Generation30 Sep 2026
- 2026SingDance: Compositional Zero-Shot Singing-and-Dancing Video Generation with Role-Aware Audio Conditioning17 Aug 2026
- 2026AptAvatar: Fast and Vivid Long-Form Audio-Driven Video Generation for Production-Ready Avatars27 Jul 2026
- 2026StreamHOI: Interaction-aware Temporal Memory Adaptation for Streaming HOI Video Generation22 Jul 2026
- 2026OPSD-V: On-Policy Self-Distillation for Post-Training Few-Step Autoregressive Video Generators9 Jul 2026
Similar, not cited
Close in wording, no citation either way
- 2025StableAvatar: Infinite-Length Audio-Driven Avatar Video Generation
- 2025LLIA -- Enabling Low-Latency Interactive Avatars: Real-Time Audio-Driven Portrait Video Generation with Diffusion Models
- 2025TalkingMachines: Real-Time Audio-Driven FaceTime-Style Video via Autoregressive Diffusion Models
- 2026Long-Horizon Audio-Visual Generation for Persistent Stories and Interactive Worlds
- 2026Omni-LiveAvatar: Minute-Level Real-Time Streaming Joint Audio-Video Avatar Generation
- 2025Live Avatar: Streaming Real-time Audio-Driven Avatar Generation with Infinite Length
- 2026OmniMate: Open-Ended Real-Time Streaming Audio-Visual Generation for Interactive Avatars
- 2026AVTR-1: Open Stack for Real-Time Interactive Avatars