Kandinsky 6.0 Video: Foundation Models for Synchronized Video and Audio Generation
On the map: Diffusion models → Audio, speech and music also fits: Video generation
Abstract (arXiv)
We present Kandinsky 6.0 Video, a family of foundation diffusion models for synchronized text-to-audio-video generation, comprising Kandinsky 6.0 Video Lite (3B parameters) and Kandinsky 6.0 Video Pro (29B parameters). Both models generate 5-second video clips with synchronized 44 kHz audio, including lip-sync, in text-to-audio-video (T2AV) and image-to-audio-video (I2AV) modes; a built-in super-resolution model raises the output resolution to Full-HD (1920×1080). Building on the video generation capabilities of Kandinsky 5.0, Kandinsky 6.0 Video employs a dual-stream CrossDiT architecture that connects a pretrained video stream and a newly trained audio stream through bidirectional cross-attention for temporal and semantic alignment. Our continuous pretraining strategy first trains the audio stream from scratch on large-scale audio corpora and then trains both streams jointly on paired audio-video data while preserving unimodal fidelity; pretraining is followed by supervised fine-tuning, reinforcement-learning-based post-training, and distillation. In side-by-side human evaluation, Kandinsky 6.0 Video Pro clearly outperforms its predecessor, Kandinsky 5.0 Video Pro, and remains competitive with leading audio-video generation models, particularly in speech quality. To accelerate open research and deployment in multimedia generation, we release the code, model checkpoints, and diffusers integration under the MIT license.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Audio, speech and music, one of 14 directions in Diffusion models. First posted on arXiv 4 Oct 2026.
Builds on
No reference list yet.
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Syncphony: Synchronized Audio-to-Video Generation with Diffusion Transformers
- 2026Diffusion Models for Joint Audio-Video Generation
- 2024Video-to-Audio Generation with Fine-grained Temporal Semantics
- 2024AV-Link: Temporally-Aligned Diffusion Features for Cross-Modal Audio-Video Generation
- 20253MDiT: Unified Tri-Modal Diffusion Transformer for Text-Driven Synchronized Audio-Video Generation
- 2026AVTok: 1D Unified Tokenization for Holistic Audio-Video Generation
- 2024STA-V2A: Video-to-Audio Generation with Semantic and Temporal Alignment
- 2024Text-to-Audio Generation Synchronized with Videos