mlsanityData to 14 Oct 2026

Leum-VL Technical Report

arXiv 2603.20354 ↗First posted 20 Mar 2026cs.MM cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

A short video succeeds not simply because of what it shows, but because of how it schedules attention -- yet current multimodal models lack the structural grammar to parse or produce this organization. Existing models can describe scenes, answer event-centric questions, and read on-screen text, but they are far less reliable at identifying timeline-grounded units such as hooks, cut rationales, shot-induced tension, and platform-facing packaging cues. We propose SV6D (Structured Video in Six Dimensions), inspired by professional storyboard practice in film and television production, a representation framework that decomposes internet-native video into six complementary structural dimensions -- subject, aesthetics, camera language, editing, narrative, and dissemination -- with each label tied to physically observable evidence on the timeline. We formalize a unified optimization objective over SV6D that combines Hungarian-matched temporal alignment, dimension-wise semantic label distance, and quality regularization. Building on this framework, we present Leum-VL-8B, an 8B video-language model that realizes the SV6D objective through an expert-driven post-training pipeline, further refined through verifiable reinforcement learning on perception-oriented tasks. Leum-VL-8B achieves 70.8 on VideoMME (w/o subtitles), 70.0 on MVBench, and 61.6 on MotionBench, while remaining competitive on general multimodal evaluations such as MMBench-EN. We also construct FeedBench, a benchmark for structure-sensitive short-video understanding. Our results indicate that the missing layer in video AI is not pixel generation but structural representation: grounded on the timeline, linked to visible evidence, and directly consumable by downstream workflows such as editing, retrieval, recommendation, and generation control, including text-heavy internet video formats with overlays and image-text layouts.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 42 of its 57 references that are in the map. First posted on arXiv 20 Mar 2026.

Builds on

42 of 57 references.

References · 42

  1. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
  2. 2023Visual Instruction Tuningcited by 7,869
  3. 2025Qwen3-VL Technical Reportcited by 2,793
  4. 2023Qwen-VL: A Versatile Vision-Language Model for Understanding, Localization, Text Reading, and Beyondcited by 2,224
  5. 2023MMBench: Is Your Multi-modal Model an All-around Player?cited by 2,141
  6. 2022Learn to Explain: Multimodal Reasoning via Thought Chains for Science Question Answeringcited by 1,919
  7. 2019Towards VQA Models That Can Readcited by 1,718
  8. 2022ChartQA: A Benchmark for Question Answering about Charts with Visual and Logical Reasoningcited by 1,479
  9. 2024Video-MME: The First-Ever Comprehensive Evaluation Benchmark of Multi-modal LLMs in Video Analysiscited by 1,413
  10. 2025s1: Simple test-time scalingcited by 1,341
  11. 2020DocVQA: A Dataset for VQA on Document Imagescited by 1,317
  12. 2023MVBench: A Comprehensive Multi-modal Video Understanding Benchmarkcited by 1,109
30 more
  1. 2024MiniCPM-V: A GPT-4V Level MLLM on Your Phonecited by 1,079
  2. 2016Modeling Context in Referring Expressionscited by 1,063
  3. 2024Are We on the Right Way for Evaluating Large Vision-Language Models?cited by 914
  4. 2023OpenAssistant Conversations -- Democratizing Large Language Model Alignmentcited by 721
  5. 2024LongVideoBench: A Benchmark for Long-context Interleaved Video-Language Understandingcited by 665
  6. 2017Localizing Moments in Video with Natural Languagecited by 663
  7. 2023HallusionBench: An Advanced Diagnostic Suite for Entangled Language Hallucination and Visual Illusion in Large Vision-Language Modelscited by 583
  8. 2024BLINK: Multimodal Large Language Models Can See but Not Perceivecited by 550
  9. 2024WildGuard: Open One-Stop Moderation Tools for Safety Risks, Jailbreaks, and Refusals of LLMscited by 496
  10. 2023OCRBench: On the Hidden Mystery of OCR in Large Multimodal Modelscited by 476
  11. 2025GLM-4.5V and GLM-4.1V-Thinking: Towards Versatile Multimodal Reasoning with Scalable Reinforcement Learningcited by 466
  12. 2024LLaVA-CoT: Let Vision Language Models Reason Step-by-Stepcited by 454
  13. 2024TempCompass: Do Video LLMs Really Understand Videos?cited by 363
  14. 2019FUNSD: A Dataset for Form Understanding in Noisy Scanned Documentscited by 349
  15. 2019Scene Text Visual Question Answeringcited by 331
  16. 2024Molmo and PixMo: Open Weights and Open Data for State-of-the-Art Vision-Language Modelscited by 329
  17. 2021IconQA: A New Benchmark for Abstract Diagram Understanding and Visual Language Reasoningcited by 267
  18. 2021ICDAR2019 Competition on Scanned Receipt OCR and Information Extractioncited by 256
  19. 2024APIGen: Automated Pipeline for Generating Verifiable and Diverse Function-Calling Datasetscited by 198
  20. 2026Molmo2: Open Weights and Data for Vision-Language Models with Video Understanding and Groundingcited by 139
  21. 2024Unlocking the conversion of Web Screenshots into HTML Code with the WebSight Datasetcited by 129
  22. 2024TOMATO: Assessing Visual Temporal Reasoning Capabilities in Multimodal Foundation Modelscited by 73
  23. 2025MotionBench: Benchmarking and Improving Fine-grained Video Motion Understanding for Vision Language Modelscited by 70
  24. 2022Syntax-Aware Network for Handwritten Mathematical Expression Recognitioncited by 68
  25. 2024PuzzleVQA: Diagnosing Multimodal Reasoning Challenges of Language Models with Abstract Visual Patternscited by 57
  26. 2025MegaMath: Pushing the Limits of Open Math Corporacited by 51
  27. 2025Nemotron-Math: Efficient Long-Context Distillation of Mathematical Reasoning from Multi-Mode Supervisioncited by 26
  28. 2025FAVOR-Bench: A Comprehensive Benchmark for Fine-Grained Video Motion Understandingcited by 24
  29. 2025VisCoder: Fine-Tuning LLMs for Executable Python Visualization Code Generationcited by 17
  30. 2026CHIMERA: Compact Synthetic Data for Generalizable LLM Reasoningcited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026CinematicVQA: Benchmarking Film-Grammar Reasoning in Large Vision-Language Models
  2. 2024Vinoground: Scrutinizing LMMs over Dense Temporal Reasoning with Short Videos
  3. 2026Beyond Frame Selection: Rethinking Long-Video Understanding with MLLMs
  4. 2024Learning Video Context as Interleaved Multimodal Sequences
  5. 2025VideoITG: Multimodal Video Understanding with Instructed Temporal Grounding
  6. 2025Scene-VLM: Multimodal Video Scene Segmentation via Vision-Language Models
  7. 2024MMBench-Video: A Long-Form Multi-Shot Benchmark for Holistic Video Understanding
  8. 2024VidComposition: Can MLLMs Analyze Compositions in Compiled Videos?