mlsanityData to 7 Oct 2026

Kling-Omni Technical Report

arXiv 2512.16776 ↗First posted 18 Dec 2025cs.CVcited by 60

Not on the map. Why?

Abstract (arXiv)

We present Kling-Omni, a generalist generative framework designed to synthesize high-fidelity videos directly from multimodal visual language inputs. Adopting an end-to-end perspective, Kling-Omni bridges the functional separation among diverse video generation, editing, and intelligent reasoning tasks, integrating them into a holistic system. Unlike disjointed pipeline approaches, Kling-Omni supports a diverse range of user inputs, including text instructions, reference images, and video contexts, processing them into a unified multimodal representation to deliver cinematic-quality and highly-intelligent video content creation. To support these capabilities, we constructed a comprehensive data system that serves as the foundation for multimodal video creation. The framework is further empowered by efficient large-scale pre-training strategies and infrastructure optimizations for inference. Comprehensive evaluations reveal that Kling-Omni demonstrates exceptional capabilities in in-context generation, reasoning-based editing, and multimodal instruction following. Moving beyond a content creation tool, we believe Kling-Omni is a pivotal advancement toward multimodal world simulators capable of perceiving, reasoning, generating and interacting with the dynamic and complex worlds.

Key facts. Cited by 60 papers in the map (data through 7 Oct 2026). Builds on 28 of its 35 references that are in the map. First posted on arXiv 18 Dec 2025.

Builds on

28 of 35 references.

References · 28

  1. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  2. 2023GPT-4 Technical Reportcited by 18,132
  3. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
  4. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,916
  5. 2024GPT-4o System Cardcited by 4,467
  6. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
  7. 2019Megatron-LM: Training Multi-Billion Parameter Language Models Using Model Parallelismcited by 1,829
  8. 2025Qwen-Image Technical Reportcited by 973
  9. 2024WorldSimBench: Towards Video Generation Models as World Simulatorscited by 867
  10. 2024Improved Distribution Matching Distillation for Fast Image Synthesiscited by 648
  11. 2024FlashAttention-3: Fast and Accurate Attention with Asynchrony and Low-precisioncited by 507
  12. 2023Ring Attention with Blockwise Transformers for Near-Infinite Contextcited by 448
16 more
  1. 2025Seedance 1.0: Exploring the Boundaries of Video Generation Modelscited by 247
  2. 2023DeepSpeed Ulysses: System Optimizations for Enabling Training of Extreme Long Sequence Transformer Modelscited by 239
  3. 2023Patch n' Pack: NaViT, a Vision Transformer for any Aspect Ratio and Resolutioncited by 226
  4. 2024Score identity Distillation: Exponentially Fast Distillation of Pretrained Diffusion Models for One-Step Generationcited by 211
  5. 2025Video models are zero-shot learners and reasonerscited by 208
  6. 2024JanusFlow: Harmonizing Autoregression and Rectified Flow for Unified Multimodal Understanding and Generationcited by 162
  7. 2024Hyper-SD: Trajectory Segmented Consistency Model for Efficient Image Synthesiscited by 153
  8. 2020Memory-Efficient Pipeline-Parallel DNN Trainingcited by 133
  9. 2018PipeDream: Fast and Efficient Pipeline Parallel DNN Trainingcited by 116
  10. 2020DAPPLE: A Pipelined Data Parallel Approach for Training Large Modelscited by 100
  11. 2024Phased Consistency Modelscited by 83
  12. 2025Learning Few-Step Diffusion Models by Trajectory Distribution Matchingcited by 49
  13. 2025Thinking with Video: Video Generation as a Promising Multimodal Reasoning Paradigmcited by 41
  14. 2024FlexSP: Accelerating Large Language Model Training via Flexible Sequence Parallelismcited by 19
  15. 2024Re-evaluating the Memory-balanced Pipeline Parallelism: BPipecited by 3
  16. 2025From Structure to Detail: Hierarchical Distillation for Efficient Diffusion Modelcited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 60.

60 papers.

Sort:

By area:

  1. 2026Kiwi-Edit: Versatile Video Editing via Instruction and Reference Guidancecited by 34
  2. 2026OmniWeaving: Towards Unified Video Generation with Free-form Composition and Reasoningcited by 25
  3. 2026PaperBanana: Automating Academic Illustration for AI Scientistscited by 22
  4. 2026OmniForcing: Unleashing Real-time Joint Audio-Visual Generationcited by 12
  5. 2026Bernini: Latent Semantic Planning for Video Diffusioncited by 11
  6. 2026RefAlign: Representation Alignment for Reference-to-Video Generationcited by 10
  7. 2026LongAV-Compass: Towards Unified Evaluation of Minute-Scale Audio-Visual Generation Across T2AV, I2AV, and V2AVcited by 9
  8. 2026SAMA: Factorized Semantic Anchoring and Motion Alignment for Instruction-Guided Video Editingcited by 8
  9. 2026ConsID-Gen: View-Consistent and Identity-Preserving Image-to-Video Generationcited by 6
  10. 2026Toward Native Multimodal Modeling: A Roadmapcited by 6
  11. 2026What-If World: A Causal Benchmark for General World Models in Embodied Scenarioscited by 6
  12. 2026LoomVideo: Unifying Multimodal Inputs into Video Generation and Editingcited by 6
38 more
  1. 2026MultiRef-Compass: Towards Comprehensive Evaluation of Multi-Reference-to-Audio-Video Generationcited by 6
  2. 2026OmniFysics: Towards Physical Intelligence Evolution via Omni-Modal Signal Processing and Network Optimizationcited by 5
  3. 2026Human Cognition in Machines: A Unified Perspective of World Modelscited by 5
  4. 2026A Systematic Post-Train Framework for Video Generationcited by 5
  5. 2026Ring Forcing: Towards Precise Long-Term Memory for Autoregressive Video Diffusioncited by 5
  6. 2026Soap2Soap: Long Cinematic Video Remaking via Multi-Agent Collaborationcited by 4
  7. 2026GroundShot: Visually Consistent Multi-Shot Long Video Generation via Entity-Grounded Shot Schedulingcited by 4
  8. 2026A Definition and Roadmap for World Modelscited by 3
  9. 2026VA-Judger: Reward Modeling from Human Preference Feedback for Joint Video-Audio Generationcited by 3
  10. 2026How Far Are Video Models from True Multimodal Reasoning?cited by 2
  11. 2026On-Policy Adversarial Flow Distillation for Autoregressive Video Generationcited by 2
  12. 2026ReBind: Multi-Reference Video Editing via Structured Instructions with Explicit Reference Relationshipscited by 2
  13. 2026H2R-Bench: Benchmarking Human-to-Robot Manipulation Video Generation in World Modelscited by 2
  14. 2026CoinVE-200K: A Large-Scale High-Quality Dataset for Compositional Instruction-Guided Video Editingcited by 2
  15. 2026Delta Forcing: Trust Region Steering for Interactive Autoregressive Video Generationcited by 1
  16. 2026VGIF-Score: Interpretable and Diagnostic Evaluation of Spatio-Temporal Instruction Following in Video Generationcited by 1
  17. 2026KeyFrame-Compass: Towards Comprehensive Evaluation of Keyframe-Conditioned Video Generationcited by 1
  18. 2026Apple-π: Benchmarking Thinking with Video Towards Law-Grounded Physical Intelligencecited by 1
  19. 2026Stream Forcing: Constructing Unified Training Trajectory for Robust Streaming Video Generationcited by 1
  20. 2026Avatar-Forever: Decoupled Parallel Training for High-Quality Real-Time Infinite Avatarscited by 1
  21. 2026Physics-Aware Video Generation via Agentic Planning and Graph-Guided Optimizationcited by 1
  22. 2026Salt++: Context-Aligned Post-Training for Few-Step Streaming Multimodal Generationcited by 1
  23. 2026Vibe AIGC: A New Paradigm for Content Generation via Agentic Orchestrationcited by 0
  24. 2026ImVideoEdit: Image-learning Video Editing via 2D Spatial Difference Attention Blockscited by 0
  25. 2026AniMatrix: An Anime Video Generation Model that Thinks in Art, Not Physicscited by 0
  26. 2026AdaptiveLoad: Towards Efficient Video Diffusion Transformer Trainingcited by 0
  27. 2026CogOmniControl: Reasoning-Driven Controllable Video Generation via Creative Intent Cognitioncited by 0
  28. 2026Refining Multidimensional Video Reward Models via Disentangled Influence Functionscited by 0
  29. 2026Dream.exe: Can Video Generation Models Dream Executable Robot Manipulation?cited by 0
  30. 2026SpecLoR: Spectral Lookahead Rectification for Motion-Coherent Text-to-Video Generationcited by 0
  31. 2026Pulling The REINS: Training-Free Safety Alignment of Video Diffusion Models via Representation Steeringcited by 0
  32. 2026EchoStyle: Unlocking High-Fidelity Video Stylization with Reverse Data Synthesiscited by 0
  33. 2026Disco-LoRA: Disentangled Composition of Content, Style, and Motion for Multi-concept Video Customizationcited by 0
  34. 2026WearWow: Native 2K Multi-Garment Virtual Try-On via Adaptive Token Packing and Preference Alignmentcited by 0
  35. 2026FlexComposer: Unified Video Compositing from Images to Dynamic Footage with Flexible Trajectory Controlcited by 0
  36. 2026Robust and Efficient Motion Reasoning for Privacy-Aware Classroom Incident Recognitioncited by 0
  37. 2026Vorch-Omni: Multi-Task Orchestration of Sight and Soundcited by 0
  38. 2026VLMs Win a Systematic Evaluation of Underwater Image Reconstructioncited by 0

50 most cited of 60 All 60 (JSON)