mlsanityData to 14 Oct 2026

Video-VoT-R1: An efficient video inference model integrating image packing and AoE architecture

arXiv 2503.15807 ↗First posted 20 Mar 2025cs.AIcited by 2

Not on the map. Why?

Abstract (arXiv)

In the field of video-language pretraining, existing models face numerous challenges in terms of inference efficiency and multimodal data processing. This paper proposes a KunLunBaize-VoT-R1 video inference model based on a long-sequence image encoder, along with its training and application methods. By integrating image packing technology, the Autonomy-of-Experts (AoE) architecture, and combining the video of Thought (VoT), a large language model (LLM) trained with large-scale reinforcement learning, and multiple training techniques, the efficiency and accuracy of the model in video inference tasks are effectively improved. Experiments show that this model performs outstandingly in multiple tests, providing a new solution for video-language understanding.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 38 of its 58 references that are in the map. First posted on arXiv 20 Mar 2025.

Builds on

38 of 58 references.

References · 38

  1. 2022Training language models to follow instructions with human feedbackcited by 15,971
  2. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  3. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
  4. 2023Visual Instruction Tuningcited by 7,869
  5. 2025Qwen2.5-VL Technical Reportcited by 5,587
  6. 2022Flamingo: a Visual Language Model for Few-Shot Learningcited by 4,386
  7. 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,152
  8. 2017Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layercited by 3,509
  9. 2022Training Compute-Optimal Large Language Modelscited by 3,019
  10. 2024Qwen2.5-Math Technical Report: Toward Mathematical Expert Model via Self-Improvementcited by 1,090
  11. 2017Multimodal Machine Learning: A Survey and Taxonomycited by 1,013
  12. 2023Multimodal Chain-of-Thought Reasoning in Language Modelscited by 752
26 more
  1. 2021NExT-QA:Next Phase of Question-Answering to Explaining Temporal Actionscited by 744
  2. 2019VideoBERT: A Joint Model for Video and Language Representation Learningcited by 703
  3. 2024VideoCrafter2: Overcoming Data Limitations for High-Quality Video Diffusion Modelscited by 579
  4. 2024LLaVA-CoT: Let Vision Language Models Reason Step-by-Stepcited by 454
  5. 2024LoRA+: Efficient Low Rank Adaptation of Large Modelscited by 377
  6. 2023Towards Revealing the Mystery behind Chain of Thought: A Theoretical Perspectivecited by 294
  7. 2023Multimodal Deep Learningcited by 258
  8. 2021Attention Mechanisms in Computer Vision: A Surveycited by 232
  9. 2024STAR: A Benchmark for Situated Reasoning in Real-World Videoscited by 213
  10. 2024Video-of-Thought: Step-by-Step Video Reasoning from Perception to Cognitioncited by 153
  11. 2020What is More Likely to Happen Next? Video-and-Language Future Event Predictioncited by 62
  12. 2022From Representation to Reasoning: Towards both Evidence and Commonsense Reasoning for Video Question-Answeringcited by 51
  13. 2021Learnable Embedding Sizes for Recommender Systemscited by 42
  14. 2024VideoCoT: A Video Chain-of-Thought Dataset with Active Annotation Toolcited by 35
  15. 2024Question Aware Vision Transformer for Multimodal Reasoningcited by 32
  16. 2018STyLuS*: A Temporal Logic Optimal Control Synthesis Algorithm for Large-Scale Multi-Robot Systemscited by 24
  17. 2021Understanding Chinese Video and Language via Contrastive Multimodal Pre-Trainingcited by 23
  18. 2020Deep Reinforcement Learning Based Intelligent Reflecting Surface for Secure Wireless Communicationscited by 22
  19. 2024Motion-Grounded Video Reasoning: Understanding and Perceiving Motion at Pixel Levelcited by 19
  20. 2023Improving Expert Specialization in Mixture of Expertscited by 17
  21. 2021DVD: A Diagnostic Dataset for Multi-step Reasoning in Video Grounded Dialoguecited by 13
  22. 2019Multimodal Logical Inference System for Visual-Textual Entailmentcited by 11
  23. 2023Face Recognition in the age of CLIP & Billion image datasetscited by 7
  24. 2024Mixture of Experts for Network Optimization: A Large Language Model-enabled Approachcited by 7
  25. 2025Autonomy-of-Experts Modelscited by 7
  26. 2024Enhancing Healthcare Recommendation Systems with a Multimodal LLMs-based MOE Architecturecited by 6

Built on by

Cited by year

Citing papers per year: 2025: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Video-R1: Reinforcing Video Reasoning in MLLMs
  2. 2025Exploring the Effect of Reinforcement Learning on Video Understanding: Insights from SEED-Bench-R1
  3. 2025Video-Thinker: Sparking "Thinking with Videos" via Reinforcement Learning
  4. 2025FrameThinker: Learning to Think with Long Videos via Multi-Turn Frame Spotlighting
  5. 2026Video-ToC: Video Tree-of-Cue Reasoning
  6. 2025Video-RTS: Rethinking Reinforcement Learning and Test-Time Scaling for Efficient and Enhanced Video Reasoning
  7. 2025Thinking With Videos: Multimodal Tool-Augmented Reinforcement Learning for Long Video Reasoning
  8. 2026EasyVideoR1: Easier RL for Video Understanding