mlsanityData to 7 Oct 2026

Video-FLAIR: Not Whether to Reason, But How

arXiv 2608.26495 ↗First posted 27 Aug 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Multimodal queries can require different types of reasoning. Some can be answered via perceptual reasoning, extracting information directly from the visual signal, while others require compositional reasoning that combines observations or deliberative reasoning that evaluates competing hypotheses. However, many existing methods apply a uniform reasoning strategy across queries, leading to unnecessary computation on simple tasks and insufficient reasoning on complex ones. We introduce Video-FLAIR, a training framework that learns to select the appropriate reasoning mode for each query using reinforcement learning. During training, the model generates responses under all three modes for the same prompt, enabling direct comparison. A composite reward compares these responses to favor the most effective one based on correctness, grounding, and cost, while discouraging unsupported or misaligned deliberation. This yields a supervision signal for learning adaptive reasoning without per-query annotations. Video-FLAIR improves accuracy over the Qwen2.5-VL base model by +5.4 on MathVista, +4.8 on Video-Holmes, and +4.8 on Video-MMMU, while reducing average token usage to 95 compared to 417 for always-thinking baselines.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 83 of its 92 references that are in the map. First posted on arXiv 27 Aug 2026.

Builds on

83 of 92 references.

References · 83

  1. 2014Microsoft COCO: Common Objects in Contextcited by 17,498
  2. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  3. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
  4. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,916
  5. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,146
  6. 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,767
  7. 2025Qwen2.5-VL Technical Reportcited by 5,418
  8. 2025DAPO: An Open-Source LLM Reinforcement Learning System at Scalecited by 2,678
  9. 2025Qwen3-VL Technical Reportcited by 2,534
  10. 2023MMMU: A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for Expert AGIcited by 2,044
  11. 2019Towards VQA Models That Can Readcited by 1,696
  12. 2023MathVista: Evaluating Mathematical Reasoning of Foundation Models in Visual Contextscited by 1,582
38 more
  1. 2022ChartQA: A Benchmark for Question Answering about Charts with Visual and Logical Reasoningcited by 1,449
  2. 2024Video-MME: The First-Ever Comprehensive Evaluation Benchmark of Multi-modal LLMs in Video Analysiscited by 1,375
  3. 2019ZeRO: Memory Optimizations Toward Training Trillion Parameter Modelscited by 1,278
  4. 2023ShareGPT4V: Improving Large Multi-Modal Models with Better Captionscited by 1,000
  5. 2016A Diagram Is Worth A Dozen Imagescited by 793
  6. 2017Localizing Moments in Video with Natural Languagecited by 660
  7. 2019MathQA: Towards Interpretable Math Word Problem Solving with Operation-Based Formalismscited by 653
  8. 2017TALL: Temporal Activity Localization via Language Querycited by 581
  9. 2024Thinking in Space: How Multimodal Large Language Models See, Remember, and Recall Spacescited by 580
  10. 2023HallusionBench: An Advanced Diagnostic Suite for Entangled Language Hallucination and Visual Illusion in Large Vision-Language Modelscited by 572
  11. 2024LLaVA-Video: Video Instruction Tuning With Synthetic Datacited by 550
  12. 2023MovieChat: From Dense Token to Sparse Memory for Long Video Understandingcited by 536
  13. 2016Hollywood in Homes: Crowdsourcing Data Collection for Activity Understandingcited by 535
  14. 2018GOT-10k: A Large High-Diversity Benchmark for Generic Object Tracking in the Wildcited by 471
  15. 2025Video-R1: Reinforcing Video Reasoning in MLLMscited by 464
  16. 2025Stop Overthinking: A Survey on Efficient Reasoning for Large Language Modelscited by 456
  17. 2025Towards Reasoning Era: A Survey of Long Chain-of-Thought for Reasoning Large Language Modelscited by 381
  18. 2024SWIFT:A Scalable lightWeight Infrastructure for Fine-Tuningcited by 345
  19. 2018TrackingNet: A Large-Scale Dataset and Benchmark for Object Tracking in the Wildcited by 342
  20. 2023Perception Test: A Diagnostic Benchmark for Multimodal Video Modelscited by 310
  21. 2024LongVILA: Scaling Long-Context Visual Language Models for Long Videoscited by 303
  22. 2023MeViS: A Large-scale Benchmark for Video Segmentation with Motion Expressionscited by 225
  23. 2024STAR: A Benchmark for Situated Reasoning in Real-World Videoscited by 213
  24. 2026GDPO: Group reward-Decoupled Normalization Policy Optimization for Multi-reward RL Optimizationcited by 175
  25. 2025Sa2VA: Marrying SAM2 with MLLM for Dense Grounded Understanding of Images and Videoscited by 154
  26. 2025AdaptThink: Reasoning Models Can Learn When to Thinkcited by 141
  27. 2025Can MLLMs Reason in Multimodality? EMMA: An Enhanced MultiModal ReAsoning Benchmarkcited by 132
  28. 2025MMVU: Measuring Expert-Level Multi-Discipline Video Understandingcited by 131
  29. 2024C3oT: Generating Shorter Chain-of-Thought without Compromising Effectivenesscited by 117
  30. 2025Between Underthinking and Overthinking: An Empirical Study of Reasoning Length and correctness in LLMscited by 115
  31. 2025Video-Holmes: Can MLLM Think Like Holmes for Complex Video Reasoning?cited by 107
  32. 2025VisuLogic: A Benchmark for Evaluating Visual Reasoning in Multi-modal Large Language Modelscited by 102
  33. 2025HD-EPIC: A Highly-Detailed Egocentric Video Datasetcited by 101
  34. 2025OverThink: Slowdown Attacks on Reasoning LLMscited by 94
  35. 2025Perception, Reason, Think, and Plan: A Survey on Large Multimodal Reasoning Modelscited by 89
  36. 2025Thinking With Videos: Multimodal Tool-Augmented Reinforcement Learning for Long Video Reasoningcited by 88
  37. 2025AdaCoT: Pareto-Optimal Adaptive Chain-of-Thought Triggering via Reinforcement Learningcited by 86
  38. 2025VideoRFT: Incentivizing Video Reasoning Capability in MLLMs via Reinforced Fine-Tuningcited by 86

50 most cited of 83 All 83 (JSON)

Built on by

Not cited yet.