UniVid: The Open-Source Unified Video Model
Not on the map. Why?
Abstract (arXiv)
Unified video modeling that combines generation and understanding capabilities is increasingly important but faces two key challenges: maintaining semantic faithfulness during flow-based generation due to text-visual token imbalance and the limitations of uniform cross-modal attention across the flow trajectory, and efficiently extending image-centric MLLMs to video without costly retraining. We present UniVid, a unified architecture that couples an MLLM with a diffusion decoder through a lightweight adapter, enabling both video understanding and generation. We introduce Temperature Modality Alignment to improve prompt adherence and Pyramid Reflection for efficient temporal reasoning via dynamic keyframe selection. Extensive experiments on standard benchmarks demonstrate state-of-the-art performance, achieving a 2.2% improvement on VBench-Long total score compared to EasyAnimateV5.1, and 1.0% and 3.3% accuracy gains on MSVD-QA and ActivityNet-QA, respectively, compared with the best prior 7B baselines. Code: https://github.com/AIGeeksGroup/UniVid. Website: https://aigeeksgroup.github.io/UniVid.
Key facts. Cited by 19 papers in the map (data through 14 Oct 2026). Builds on 61 of its 71 references that are in the map. First posted on arXiv 29 Sep 2025.
Builds on
61 of 71 references.
References · 61
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2022Scalable Diffusion Models with Transformerscited by 6,054
- 2025Qwen2.5-VL Technical Reportcited by 5,587
- 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,703
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,356
- 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,276
- 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,234
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
- 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,581
- 2023InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Taskscited by 2,565
- 2022Video Diffusion Modelscited by 2,305
38 more
- 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,822
- 2020GLU Variants Improve Transformercited by 1,804
- 2022Imagen Video: High Definition Video Generation with Diffusion Modelscited by 1,778
- 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,660
- 2021Is Space-Time Attention All You Need for Video Understanding?cited by 1,620
- 2021ViViT: A Video Vision Transformercited by 1,620
- 2019Root Mean Square Layer Normalizationcited by 1,480
- 2023Align your Latents: High-Resolution Video Synthesis with Latent Diffusion Modelscited by 1,476
- 2023Video-LLaMA: An Instruction-tuned Audio-Visual Language Model for Video Understandingcited by 1,471
- 2023Video-LLaVA: Learning United Visual Representation by Alignment Before Projectioncited by 1,402
- 2023GQA: Training Generalized Multi-Query Transformer Models from Multi-Head Checkpointscited by 1,346
- 2022VideoMAE: Masked Autoencoders are Data-Efficient Learners for Self-Supervised Video Pre-Trainingcited by 1,322
- 2025SigLIP 2: Multilingual Vision-Language Encoders with Improved Semantic Understanding, Localization, and Dense Featurescited by 1,188
- 2019An Introduction to Variational Autoencoderscited by 1,000
- 2021Multiscale Vision Transformerscited by 897
- 2025Emerging Properties in Unified Multimodal Pretrainingcited by 897
- 2023VideoChat: Chat-Centric Video Understandingcited by 857
- 2024Emu3: Next-Token Prediction is All You Needcited by 781
- 2024Show-o: One Single Transformer to Unify Multimodal Understanding and Generationcited by 752
- 2024VideoCrafter2: Overcoming Data Limitations for High-Quality Video Diffusion Modelscited by 579
- 2021Masked Feature Prediction for Self-Supervised Visual Pre-Trainingcited by 576
- 2019ActivityNet-QA: A Dataset for Understanding Complex Web Videos via Question Answeringcited by 561
- 2017MoCoGAN: Decomposing Motion and Content for Video Generationcited by 524
- 2024Transfusion: Predict the Next Token and Diffuse Images with One Multi-Modal Modelcited by 483
- 2017TGIF-QA: Toward Spatio-Temporal Reasoning in Visual Question Answeringcited by 378
- 2025BLIP3-o: A Family of Fully Open Unified Multimodal Models-Architecture, Training and Datasetcited by 376
- 2023Chat-UniVi: Unified Visual Representation Empowers Large Language Models with Image and Video Understandingcited by 371
- 2023Chameleon: Plug-and-Play Compositional Reasoning with Large Language Modelscited by 356
- 2019A Short Note on the Kinetics-700 Human Action Datasetcited by 310
- 2021StyleGAN-V: A Continuous Video Generator with the Price, Image Quality and Perks of StyleGAN2cited by 301
- 2020Query-Key Normalization for Transformerscited by 280
- 2023Valley: Video Assistant with Large Language model Enhanced abilitYcited by 234
- 2022Zero-Shot Video Question Answering via Frozen Bidirectional Language Modelscited by 229
- 2021VideoMoCo: Contrastive Video Representation Learning with Temporally Adversarial Examplescited by 154
- 2024SlowFast-LLaVA: A Strong Training-Free Baseline for Video Large Language Modelscited by 125
- 2022OmniMAE: Single Model Masked Pretraining on Images and Videoscited by 99
- 2024An Image Grid Can Be Worth a Video: Zero-shot Video Question Answering Using a VLMcited by 97
- 2020Improving Image Captioning with Better Use of Captionscited by 84
50 most cited of 61 All 61 (JSON)
Built on by
Citing papers per year: 2025: 6; 2026: 13.
19 papers.
Sort:
By area:
- 2025UniVideo: Unified Understanding, Generation, and Editing for Videoscited by 87
- 2026VINO: A Unified Visual Generator with Interleaved OmniModal Contextcited by 26
- 2026Omni-Video 2: Scaling MLLM-Conditioned Diffusion for Unified Video Generation and Editingcited by 19
- 2025DriveGen3D: Boosting Feed-Forward Driving Scene Generation with Efficient Video Diffusioncited by 15
- 2026KVPO: ODE-Native GRPO for Autoregressive Video Alignment via KV Semantic Explorationcited by 11
- 2025Video-as-Answer: Predict and Generate Next Video Event with Joint-GRPOcited by 9
- 2026PhyRPR: Training-Free Physics-Constrained Video Generationcited by 7
- 2025iMontage: Unified, Versatile, Highly Dynamic Many-to-many Image Generationcited by 6
- 2025EgoLCD: Egocentric Video Generation with Long Context Diffusioncited by 5
- 2026Video Understanding: From Geometry and Semantics to Unified Modelscited by 5
- 2025What Happens Next? Next Scene Prediction with a Unified Video Modelcited by 2
- 2026Audio-Visual Intelligence in Large Foundation Modelscited by 2
7 more
- 2026InsEdit: Towards Instruction-based Visual Editing via Data-Efficient Video Diffusion Models Adaptationcited by 1
- 2026LogiShot: Logically Coherent Cross-Shot Video Generationcited by 1
- 2026PixelUMM: Encoder-Free Unified Image and Video Understanding and Generationcited by 1
- 2026FlashSign: Pose-Free Guidance for Efficient Sign Language Video Generationcited by 0
- 2026Lumos-Nexus: Efficient Frequency Bridging with Homogeneous Latent Space for Video Unified Modelscited by 0
- 2026Bridging Video Understanding and Generation in a Unified Frameworkcited by 0
- 2026Beyond Text Conditioning: A Systematic Study of MLLM-DiT Fusion for Video Generationcited by 0
- 2026PixelUMM: Encoder-Free Unified Image and Video Understanding and Generation29 Sep 2026
- 2026Beyond Text Conditioning: A Systematic Study of MLLM-DiT Fusion for Video Generation14 Aug 2026
- 2026LogiShot: Logically Coherent Cross-Shot Video Generation9 Aug 2026
- 2026Bridging Video Understanding and Generation in a Unified Framework30 Jun 2026
- 2026Lumos-Nexus: Efficient Frequency Bridging with Homogeneous Latent Space for Video Unified Models29 May 2026
- 2026KVPO: ODE-Native GRPO for Autoregressive Video Alignment via KV Semantic Exploration14 May 2026
- 2026Audio-Visual Intelligence in Large Foundation Models5 May 2026
- 2026InsEdit: Towards Instruction-based Visual Editing via Data-Efficient Video Diffusion Models Adaptation9 Apr 2026
- 2026FlashSign: Pose-Free Guidance for Efficient Sign Language Video Generation30 Mar 2026
- 2026Video Understanding: From Geometry and Semantics to Unified Models18 Mar 2026
- 2026Omni-Video 2: Scaling MLLM-Conditioned Diffusion for Unified Video Generation and Editing9 Feb 2026
- 2026PhyRPR: Training-Free Physics-Constrained Video Generation14 Jan 2026
7 more
- 2026VINO: A Unified Visual Generator with Interleaved OmniModal Context5 Jan 2026
- 2025What Happens Next? Next Scene Prediction with a Unified Video Model15 Dec 2025
- 2025EgoLCD: Egocentric Video Generation with Long Context Diffusion4 Dec 2025
- 2025iMontage: Unified, Versatile, Highly Dynamic Many-to-many Image Generation25 Nov 2025
- 2025Video-as-Answer: Predict and Generate Next Video Event with Joint-GRPO20 Nov 2025
- 2025DriveGen3D: Boosting Feed-Forward Driving Scene Generation with Efficient Video Diffusion17 Oct 2025
- 2025UniVideo: Unified Understanding, Generation, and Editing for Videos9 Oct 2025
- 2026Omni-Video 2: Scaling MLLM-Conditioned Diffusion for Unified Video Generation and Editingcited by 19
- 2025DriveGen3D: Boosting Feed-Forward Driving Scene Generation with Efficient Video Diffusioncited by 15
- 2026PhyRPR: Training-Free Physics-Constrained Video Generationcited by 7
- 2026InsEdit: Towards Instruction-based Visual Editing via Data-Efficient Video Diffusion Models Adaptationcited by 1
- 2026Beyond Text Conditioning: A Systematic Study of MLLM-DiT Fusion for Video Generationcited by 0
- 2026Beyond Text Conditioning: A Systematic Study of MLLM-DiT Fusion for Video Generation14 Aug 2026
- 2026InsEdit: Towards Instruction-based Visual Editing via Data-Efficient Video Diffusion Models Adaptation9 Apr 2026
- 2026Omni-Video 2: Scaling MLLM-Conditioned Diffusion for Unified Video Generation and Editing9 Feb 2026
- 2026PhyRPR: Training-Free Physics-Constrained Video Generation14 Jan 2026
- 2025DriveGen3D: Boosting Feed-Forward Driving Scene Generation with Efficient Video Diffusion17 Oct 2025
- 2025UniVideo: Unified Understanding, Generation, and Editing for Videoscited by 87
- 2026VINO: A Unified Visual Generator with Interleaved OmniModal Contextcited by 26
- 2025iMontage: Unified, Versatile, Highly Dynamic Many-to-many Image Generationcited by 6
- 2025EgoLCD: Egocentric Video Generation with Long Context Diffusioncited by 5
- 2026Video Understanding: From Geometry and Semantics to Unified Modelscited by 5
- 2025What Happens Next? Next Scene Prediction with a Unified Video Modelcited by 2
- 2026Audio-Visual Intelligence in Large Foundation Modelscited by 2
- 2026LogiShot: Logically Coherent Cross-Shot Video Generationcited by 1
- 2026FlashSign: Pose-Free Guidance for Efficient Sign Language Video Generationcited by 0
- 2026Lumos-Nexus: Efficient Frequency Bridging with Homogeneous Latent Space for Video Unified Modelscited by 0
- 2026Bridging Video Understanding and Generation in a Unified Frameworkcited by 0
- 2026LogiShot: Logically Coherent Cross-Shot Video Generation9 Aug 2026
- 2026Bridging Video Understanding and Generation in a Unified Framework30 Jun 2026
- 2026Lumos-Nexus: Efficient Frequency Bridging with Homogeneous Latent Space for Video Unified Models29 May 2026
- 2026Audio-Visual Intelligence in Large Foundation Models5 May 2026
- 2026FlashSign: Pose-Free Guidance for Efficient Sign Language Video Generation30 Mar 2026
- 2026Video Understanding: From Geometry and Semantics to Unified Models18 Mar 2026
- 2026VINO: A Unified Visual Generator with Interleaved OmniModal Context5 Jan 2026
- 2025What Happens Next? Next Scene Prediction with a Unified Video Model15 Dec 2025
- 2025EgoLCD: Egocentric Video Generation with Long Context Diffusion4 Dec 2025
- 2025iMontage: Unified, Versatile, Highly Dynamic Many-to-many Image Generation25 Nov 2025
- 2025UniVideo: Unified Understanding, Generation, and Editing for Videos9 Oct 2025
Similar, not cited
Close in wording, no citation either way
- 2025UniVid: Unifying Vision Tasks with Pre-trained Video Generation Models
- 2025Omni-Video: Democratizing Unified Video Understanding and Generation
- 2026UNIVID: Unified Vision-Language Model for Video Moderation
- 2026UniVid: Pyramid Diffusion Model for High Quality Video Generation
- 2026UniVBench: Towards Unified Evaluation for Video Foundation Models
- 2026Uni-ViGU: Towards Unified Video Generation and Understanding via A Diffusion-Based Video Generator
- 2025UFVideo: Towards Unified Fine-Grained Video Cooperative Understanding with Large Language Models
- 2026UniVidX: A Unified Multimodal Framework for Versatile Video Generation via Diffusion Priors