mlsanityData to 7 Oct 2026

LongCat-Video-Avatar 1.5 Technical Report

arXiv 2605.26486 ↗First posted 26 May 2026cs.CVcited by 5

Not on the map. Why?

Abstract (arXiv)

Despite advances in audio-driven video generation, achieving commercial-grade stability remains challenging. We present LongCat-Video-Avatar 1.5, an upgraded open-source framework prioritizing systematic engineering and production-readiness over architectural novelty. By upgrading the audio encoder to Whisper Large and meticulously scaling our training recipes, v1.5 achieves accurate lip-synchronization, full-body temporal stability, and robust long-video generation with strict identity consistency. Through rigorous data curation and RLHF Training, the model readily generalizes to stylized domains such as anime and animals, and natively handles complex real-world conditions, such as multi-person interactions and object handling. Furthermore, addressing the practical demands of industrial deployment, we employ advanced step distillation to accelerate inference to an optimal 8 NFE, achieving a favorable trade-off between serving efficiency and visual fidelity. The superiority of our approach is validated through extensive quantitative metrics and a rigorous human evaluation conducted on a comprehensive benchmark of over 500 diverse test cases. Results show that v1.5 achieves competitive or superior performance compared to leading closed-source systems (e.g., HeyGen, OmniHuman 1.5, Kling Avatar 2.0) across human-likeness ratings and expert-level quality assessments on our benchmark. With its open-source release, LongCat-Video-Avatar 1.5 narrows the gap between academic research prototypes and commercial-grade deployment.

Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 28 of its 36 references that are in the map. First posted on arXiv 26 May 2026.

Builds on

28 of 36 references.

References · 28

  1. 2022Training language models to follow instructions with human feedbackcited by 15,712
  2. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
  3. 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 3,972
  4. 2020wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representationscited by 3,853
  5. 2025Qwen3-VL Technical Reportcited by 2,534
  6. 2021ByteTrack: Multi-Object Tracking by Associating Every Detection Boxcited by 812
  7. 2024Improved Distribution Matching Distillation for Fast Image Synthesiscited by 648
  8. 2025Qwen3-Omni Technical Reportcited by 451
  9. 2022YOLOv6: A Single-Stage Object Detection Framework for Industrial Applicationscited by 273
  10. 2023Upscale-A-Video: Temporal-Consistent Diffusion Model for Real-World Video Super-Resolutioncited by 131
  11. 2021Is Someone Speaking? Exploring Long-term Temporal Features for Audio-visual Active Speaker Detectioncited by 110
  12. 2025FantasyTalking: Realistic Talking Portrait Generation via Coherent Motion Synthesiscited by 77
16 more
  1. 2025OmniAvatar: Efficient Audio-Driven Avatar Video Generation with Adaptive Body Animationcited by 77
  2. 2025LongCat-Video Technical Reportcited by 73
  3. 2025HunyuanVideo-Avatar: High-Fidelity Audio-Driven Human Animation for Multiple Characterscited by 64
  4. 2025Let Them Talk: Audio-Driven Multi-Person Conversational Video Generationcited by 64
  5. 2025Wan-S2V: Audio-Driven Cinematic Video Generationcited by 60
  6. 2025HuMo: Human-Centric Video Generation via Collaborative Multi-Modal Conditioningcited by 44
  7. 2025InfiniteTalk: Audio-driven Video Generation for Sparse-Frame Video Dubbingcited by 40
  8. 2024FlowVQTalker: High-Quality Emotional Talking Face Generation through Normalizing Flow and Quantizationcited by 39
  9. 2025OmniHuman-1.5: Instilling an Active Mind in Avatars via Cognitive Simulationcited by 30
  10. 2025Kling-Avatar: Grounding Multimodal Instructions for Cascaded Long-Duration Avatar Animation Synthesiscited by 20
  11. 2026LPM 1.0: Video-based Character Performance Modelcited by 11
  12. 2025SoulX-FlashTalk: Real-Time Infinite Streaming of Audio-Driven Avatars via Self-Correcting Bidirectional Distillationcited by 10
  13. 2025PersonaLive! Expressive Portrait Image Animation for Live Streamingcited by 6
  14. 2025Revisiting Active Speaker Detection: An In-the-Wild Benchmark for Generalization and Robustnesscited by 5
  15. 2025EvalTalker: Learning to Evaluate Real-Portrait-Driven Multi-Subject Talking Humanscited by 3
  16. 2025JoyStreamer-Flash: Real-time and Infinite Audio-Driven Avatar Generation with Autoregressive Diffusioncited by 3

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 5.

5 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025StableAvatar: Infinite-Length Audio-Driven Avatar Video Generation
  2. 2025LLIA -- Enabling Low-Latency Interactive Avatars: Real-Time Audio-Driven Portrait Video Generation with Diffusion Models
  3. 2025TalkingMachines: Real-Time Audio-Driven FaceTime-Style Video via Autoregressive Diffusion Models
  4. 2026Long-Horizon Audio-Visual Generation for Persistent Stories and Interactive Worlds
  5. 2026Omni-LiveAvatar: Minute-Level Real-Time Streaming Joint Audio-Video Avatar Generation
  6. 2025Live Avatar: Streaming Real-time Audio-Driven Avatar Generation with Infinite Length
  7. 2026OmniMate: Open-Ended Real-Time Streaming Audio-Visual Generation for Interactive Avatars
  8. 2026AVTR-1: Open Stack for Real-Time Interactive Avatars