mlsanityData to 14 Oct 2026

Omni-AutoThink: Adaptive Multimodal Reasoning via Reinforcement Learning

arXiv 2512.03783 ↗First posted 3 Dec 2025cs.AI cs.SDcited by 5

On the map: LLM reasoning → Multimodal reasoning

Abstract (arXiv)

Recent advances in Omni models have enabled unified multimodal perception and generation. However, most existing systems still exhibit rigid reasoning behaviors, either overthinking simple problems or failing to reason when necessary. To address this limitation, we propose Omni-AutoThink, a novel adaptive reasoning framework that dynamically adjusts the model's reasoning depth according to task difficulty. Our framework comprises two stages: (1) an Adaptive Supervised Fine-Tuning (Adaptive SFT) stage, which endows the Omni model with fundamental reasoning capability using large-scale reasoning-augmented data, and (2) an Adaptive Reinforcement Learning (Adaptive GRPO) stage, which optimizes reasoning behaviors based on task complexity and reward feedback. We further construct a comprehensive adaptive reasoning benchmark that spans text-only, text-audio, text-visual, and text-audio-visual modalities, providing both training and evaluation splits for multimodal reasoning assessment. Experimental results demonstrate that our proposed framework significantly improves adaptive reasoning performance compared to previous baselines. All benchmark data and code will be publicly released.

Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 29 of its 43 references that are in the map. First posted on arXiv 3 Dec 2025.

Builds on

29 of 43 references.

Closest ancestors · 3

Same direction, newest first

  1. 2025Advancing Multimodal Reasoning: From Optimized Cold Start to Staged Reinforcement Learning4 Jun
  2. 2025Vision-R1: Incentivizing Reasoning Capability in Multimodal Large Language Models9 Mar
  3. 2024MultiMath: Bridging Visual and Mathematical Reasoning for Large Language Models30 Aug

Other references · 26

  1. 2023GPT-4 Technical Reportcited by 18,396
  2. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
  3. 2025Qwen3 Technical Reportcited by 8,820
  4. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
  5. 2025Qwen2.5-VL Technical Reportcited by 5,587
  6. 2018Think you have Solved Question Answering? Try ARC, the AI2 Reasoning Challengecited by 4,886
  7. 2023Gemini: A Family of Highly Capable Multimodal Modelscited by 872
  8. 2023Instruction Tuning with GPT-4cited by 686
  9. 2023Qwen-Audio: Advancing Universal Audio Understanding via Unified Large-Scale Audio-Language Modelscited by 608
  10. 2023SALMONN: Towards Generic Hearing Abilities for Large Language Modelscited by 506
  11. 2025Qwen3-Omni Technical Reportcited by 497
  12. 2025OpenThoughts: Data Recipes for Reasoning Modelscited by 304
14 more
  1. 2024MMAU: A Massive Multi-Task Audio Understanding and Reasoning Benchmarkcited by 288
  2. 2024Audio Flamingo: A Novel Audio Language Model with Few-Shot Learning and Dialogue Abilitiescited by 186
  3. 2025AIMO-2 Winning Solution: Building State-of-the-Art Mathematical Reasoning Models with OpenMathReasoning datasetcited by 174
  4. 2025AdaptThink: Reasoning Models Can Learn When to Thinkcited by 147
  5. 2025MMAR: A Challenging Benchmark for Deep Reasoning in Speech, Audio, Music, and Their Mixcited by 117
  6. 2024OmniBench: Towards The Future of Universal Omni-Language Modelscited by 102
  7. 2025AdaCoT: Pareto-Optimal Adaptive Chain-of-Thought Triggering via Reinforcement Learningcited by 87
  8. 2025Reinforcement Learning Outperforms Supervised Fine-Tuning: A Case Study on Audio Question Answeringcited by 65
  9. 2025Omni-R1: Do You Really Need Audio to Fine-Tune Your Audio LLM?cited by 46
  10. 2024Beyond Text: Frozen Large Language Models in Visual Signal Comprehensioncited by 23
  11. 2025Audio-Thinker: Guiding Audio Language Model When and How to Think via Reinforcement Learningcited by 19
  12. 2025R-4B: Incentivizing General-Purpose Auto-Thinking Capability in MLLMs via Bi-Mode Annealing and Reinforce Learningcited by 18
  13. 2023MiniGPT-5: Interleaved Vision-and-Language Generation via Generative Vokenscited by 15
  14. 2025KAT-V1: Kwai-AutoThink Technical Reportcited by 12

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 5.

5 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Perception, Reason, Think, and Plan: A Survey on Large Multimodal Reasoning Models
  2. 2025Advancing Multimodal Reasoning via Reinforcement Learning with Cold Start
  3. 2024Diving into Self-Evolving Training for Multimodal Reasoning
  4. 2026Text-Centric Post-Training for Omni-Modal Reasoning
  5. 2026R-C2: Cycle-Consistent Reinforcement Learning Improves Multimodal Reasoning
  6. 2025ARES: Multimodal Adaptive Reasoning via Difficulty-Aware Token-Level Entropy Shaping
  7. 2025OpenMMReasoner: Pushing the Frontiers for Multimodal Reasoning with an Open and General Recipe
  8. 2026Omni-Perception Policy Optimization for Multimodal Emotion Reasoning