mlsanityData to 14 Oct 2026

UniVid: The Open-Source Unified Video Model

arXiv 2509.24200 ↗First posted 29 Sep 2025cs.CVcited by 19

Not on the map. Why?

Abstract (arXiv)

Unified video modeling that combines generation and understanding capabilities is increasingly important but faces two key challenges: maintaining semantic faithfulness during flow-based generation due to text-visual token imbalance and the limitations of uniform cross-modal attention across the flow trajectory, and efficiently extending image-centric MLLMs to video without costly retraining. We present UniVid, a unified architecture that couples an MLLM with a diffusion decoder through a lightweight adapter, enabling both video understanding and generation. We introduce Temperature Modality Alignment to improve prompt adherence and Pyramid Reflection for efficient temporal reasoning via dynamic keyframe selection. Extensive experiments on standard benchmarks demonstrate state-of-the-art performance, achieving a 2.2% improvement on VBench-Long total score compared to EasyAnimateV5.1, and 1.0% and 3.3% accuracy gains on MSVD-QA and ActivityNet-QA, respectively, compared with the best prior 7B baselines. Code: https://github.com/AIGeeksGroup/UniVid. Website: https://aigeeksgroup.github.io/UniVid.

Key facts. Cited by 19 papers in the map (data through 14 Oct 2026). Builds on 61 of its 71 references that are in the map. First posted on arXiv 29 Sep 2025.

Builds on

61 of 71 references.

References · 61

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  3. 2022Scalable Diffusion Models with Transformerscited by 6,054
  4. 2025Qwen2.5-VL Technical Reportcited by 5,587
  5. 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,703
  6. 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,356
  7. 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,276
  8. 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,234
  9. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
  10. 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,581
  11. 2023InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Taskscited by 2,565
  12. 2022Video Diffusion Modelscited by 2,305
38 more
  1. 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,822
  2. 2020GLU Variants Improve Transformercited by 1,804
  3. 2022Imagen Video: High Definition Video Generation with Diffusion Modelscited by 1,778
  4. 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,660
  5. 2021Is Space-Time Attention All You Need for Video Understanding?cited by 1,620
  6. 2021ViViT: A Video Vision Transformercited by 1,620
  7. 2019Root Mean Square Layer Normalizationcited by 1,480
  8. 2023Align your Latents: High-Resolution Video Synthesis with Latent Diffusion Modelscited by 1,476
  9. 2023Video-LLaMA: An Instruction-tuned Audio-Visual Language Model for Video Understandingcited by 1,471
  10. 2023Video-LLaVA: Learning United Visual Representation by Alignment Before Projectioncited by 1,402
  11. 2023GQA: Training Generalized Multi-Query Transformer Models from Multi-Head Checkpointscited by 1,346
  12. 2022VideoMAE: Masked Autoencoders are Data-Efficient Learners for Self-Supervised Video Pre-Trainingcited by 1,322
  13. 2025SigLIP 2: Multilingual Vision-Language Encoders with Improved Semantic Understanding, Localization, and Dense Featurescited by 1,188
  14. 2019An Introduction to Variational Autoencoderscited by 1,000
  15. 2021Multiscale Vision Transformerscited by 897
  16. 2025Emerging Properties in Unified Multimodal Pretrainingcited by 897
  17. 2023VideoChat: Chat-Centric Video Understandingcited by 857
  18. 2024Emu3: Next-Token Prediction is All You Needcited by 781
  19. 2024Show-o: One Single Transformer to Unify Multimodal Understanding and Generationcited by 752
  20. 2024VideoCrafter2: Overcoming Data Limitations for High-Quality Video Diffusion Modelscited by 579
  21. 2021Masked Feature Prediction for Self-Supervised Visual Pre-Trainingcited by 576
  22. 2019ActivityNet-QA: A Dataset for Understanding Complex Web Videos via Question Answeringcited by 561
  23. 2017MoCoGAN: Decomposing Motion and Content for Video Generationcited by 524
  24. 2024Transfusion: Predict the Next Token and Diffuse Images with One Multi-Modal Modelcited by 483
  25. 2017TGIF-QA: Toward Spatio-Temporal Reasoning in Visual Question Answeringcited by 378
  26. 2025BLIP3-o: A Family of Fully Open Unified Multimodal Models-Architecture, Training and Datasetcited by 376
  27. 2023Chat-UniVi: Unified Visual Representation Empowers Large Language Models with Image and Video Understandingcited by 371
  28. 2023Chameleon: Plug-and-Play Compositional Reasoning with Large Language Modelscited by 356
  29. 2019A Short Note on the Kinetics-700 Human Action Datasetcited by 310
  30. 2021StyleGAN-V: A Continuous Video Generator with the Price, Image Quality and Perks of StyleGAN2cited by 301
  31. 2020Query-Key Normalization for Transformerscited by 280
  32. 2023Valley: Video Assistant with Large Language model Enhanced abilitYcited by 234
  33. 2022Zero-Shot Video Question Answering via Frozen Bidirectional Language Modelscited by 229
  34. 2021VideoMoCo: Contrastive Video Representation Learning with Temporally Adversarial Examplescited by 154
  35. 2024SlowFast-LLaVA: A Strong Training-Free Baseline for Video Large Language Modelscited by 125
  36. 2022OmniMAE: Single Model Masked Pretraining on Images and Videoscited by 99
  37. 2024An Image Grid Can Be Worth a Video: Zero-shot Video Question Answering Using a VLMcited by 97
  38. 2020Improving Image Captioning with Better Use of Captionscited by 84

50 most cited of 61 All 61 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 6; 2026: 13.

19 papers.

Sort:

By area:

  1. 2025UniVideo: Unified Understanding, Generation, and Editing for Videoscited by 87
  2. 2026VINO: A Unified Visual Generator with Interleaved OmniModal Contextcited by 26
  3. 2026Omni-Video 2: Scaling MLLM-Conditioned Diffusion for Unified Video Generation and Editingcited by 19
  4. 2025DriveGen3D: Boosting Feed-Forward Driving Scene Generation with Efficient Video Diffusioncited by 15
  5. 2026KVPO: ODE-Native GRPO for Autoregressive Video Alignment via KV Semantic Explorationcited by 11
  6. 2025Video-as-Answer: Predict and Generate Next Video Event with Joint-GRPOcited by 9
  7. 2026PhyRPR: Training-Free Physics-Constrained Video Generationcited by 7
  8. 2025iMontage: Unified, Versatile, Highly Dynamic Many-to-many Image Generationcited by 6
  9. 2025EgoLCD: Egocentric Video Generation with Long Context Diffusioncited by 5
  10. 2026Video Understanding: From Geometry and Semantics to Unified Modelscited by 5
  11. 2025What Happens Next? Next Scene Prediction with a Unified Video Modelcited by 2
  12. 2026Audio-Visual Intelligence in Large Foundation Modelscited by 2
7 more
  1. 2026InsEdit: Towards Instruction-based Visual Editing via Data-Efficient Video Diffusion Models Adaptationcited by 1
  2. 2026LogiShot: Logically Coherent Cross-Shot Video Generationcited by 1
  3. 2026PixelUMM: Encoder-Free Unified Image and Video Understanding and Generationcited by 1
  4. 2026FlashSign: Pose-Free Guidance for Efficient Sign Language Video Generationcited by 0
  5. 2026Lumos-Nexus: Efficient Frequency Bridging with Homogeneous Latent Space for Video Unified Modelscited by 0
  6. 2026Bridging Video Understanding and Generation in a Unified Frameworkcited by 0
  7. 2026Beyond Text Conditioning: A Systematic Study of MLLM-DiT Fusion for Video Generationcited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2025UniVid: Unifying Vision Tasks with Pre-trained Video Generation Models
  2. 2025Omni-Video: Democratizing Unified Video Understanding and Generation
  3. 2026UNIVID: Unified Vision-Language Model for Video Moderation
  4. 2026UniVid: Pyramid Diffusion Model for High Quality Video Generation
  5. 2026UniVBench: Towards Unified Evaluation for Video Foundation Models
  6. 2026Uni-ViGU: Towards Unified Video Generation and Understanding via A Diffusion-Based Video Generator
  7. 2025UFVideo: Towards Unified Fine-Grained Video Cooperative Understanding with Large Language Models
  8. 2026UniVidX: A Unified Multimodal Framework for Versatile Video Generation via Diffusion Priors