Omni-AutoThink: Adaptive Multimodal Reasoning via Reinforcement Learning
On the map: LLM reasoning → Multimodal reasoning
Abstract (arXiv)
Recent advances in Omni models have enabled unified multimodal perception and generation. However, most existing systems still exhibit rigid reasoning behaviors, either overthinking simple problems or failing to reason when necessary. To address this limitation, we propose Omni-AutoThink, a novel adaptive reasoning framework that dynamically adjusts the model's reasoning depth according to task difficulty. Our framework comprises two stages: (1) an Adaptive Supervised Fine-Tuning (Adaptive SFT) stage, which endows the Omni model with fundamental reasoning capability using large-scale reasoning-augmented data, and (2) an Adaptive Reinforcement Learning (Adaptive GRPO) stage, which optimizes reasoning behaviors based on task complexity and reward feedback. We further construct a comprehensive adaptive reasoning benchmark that spans text-only, text-audio, text-visual, and text-audio-visual modalities, providing both training and evaluation splits for multimodal reasoning assessment. Experimental results demonstrate that our proposed framework significantly improves adaptive reasoning performance compared to previous baselines. All benchmark data and code will be publicly released.
Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 29 of its 43 references that are in the map. First posted on arXiv 3 Dec 2025.
Builds on
29 of 43 references.
Closest ancestors · 3
Same direction, newest first
- 2025Advancing Multimodal Reasoning: From Optimized Cold Start to Staged Reinforcement Learning4 Jun
- 2025Vision-R1: Incentivizing Reasoning Capability in Multimodal Large Language Models9 Mar
- 2024MultiMath: Bridging Visual and Mathematical Reasoning for Large Language Models30 Aug
Other references · 26
- 2023GPT-4 Technical Reportcited by 18,396
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
- 2025Qwen3 Technical Reportcited by 8,820
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
- 2025Qwen2.5-VL Technical Reportcited by 5,587
- 2018Think you have Solved Question Answering? Try ARC, the AI2 Reasoning Challengecited by 4,886
- 2023Gemini: A Family of Highly Capable Multimodal Modelscited by 872
- 2023Instruction Tuning with GPT-4cited by 686
- 2023Qwen-Audio: Advancing Universal Audio Understanding via Unified Large-Scale Audio-Language Modelscited by 608
- 2023SALMONN: Towards Generic Hearing Abilities for Large Language Modelscited by 506
- 2025Qwen3-Omni Technical Reportcited by 497
- 2025OpenThoughts: Data Recipes for Reasoning Modelscited by 304
14 more
- 2024MMAU: A Massive Multi-Task Audio Understanding and Reasoning Benchmarkcited by 288
- 2024Audio Flamingo: A Novel Audio Language Model with Few-Shot Learning and Dialogue Abilitiescited by 186
- 2025AIMO-2 Winning Solution: Building State-of-the-Art Mathematical Reasoning Models with OpenMathReasoning datasetcited by 174
- 2025AdaptThink: Reasoning Models Can Learn When to Thinkcited by 147
- 2025MMAR: A Challenging Benchmark for Deep Reasoning in Speech, Audio, Music, and Their Mixcited by 117
- 2024OmniBench: Towards The Future of Universal Omni-Language Modelscited by 102
- 2025AdaCoT: Pareto-Optimal Adaptive Chain-of-Thought Triggering via Reinforcement Learningcited by 87
- 2025Reinforcement Learning Outperforms Supervised Fine-Tuning: A Case Study on Audio Question Answeringcited by 65
- 2025Omni-R1: Do You Really Need Audio to Fine-Tune Your Audio LLM?cited by 46
- 2024Beyond Text: Frozen Large Language Models in Visual Signal Comprehensioncited by 23
- 2025Audio-Thinker: Guiding Audio Language Model When and How to Think via Reinforcement Learningcited by 19
- 2025R-4B: Incentivizing General-Purpose Auto-Thinking Capability in MLLMs via Bi-Mode Annealing and Reinforce Learningcited by 18
- 2023MiniGPT-5: Interleaved Vision-and-Language Generation via Generative Vokenscited by 15
- 2025KAT-V1: Kwai-AutoThink Technical Reportcited by 12
Built on by
Citing papers per year: 2026: 5.
5 papers.
- 2026AdaptMMBench: Benchmarking Adaptive Multimodal Reasoning for Mode Selection and Reasoning Processcited by 3
- 2026OmniFocus: Query-Guided Modality-Balanced Token Compression for Omni-Modal Large Language Modelscited by 2
- 2026Switch-Reasoner: Learn When to Think in Multitask Mixtures via Reinforcement Learningcited by 0
- 2026Video-FLAIR: Not Whether to Reason, But Howcited by 0
- 2026SWEAR: Section-Wise Efficient Audio Reasoning via Self-Rated Difficultycited by 0
- 2026SWEAR: Section-Wise Efficient Audio Reasoning via Self-Rated Difficulty9 Oct 2026
- 2026Video-FLAIR: Not Whether to Reason, But How27 Aug 2026
- 2026Switch-Reasoner: Learn When to Think in Multitask Mixtures via Reinforcement Learning9 Jul 2026
- 2026OmniFocus: Query-Guided Modality-Balanced Token Compression for Omni-Modal Large Language Models3 Jul 2026
- 2026AdaptMMBench: Benchmarking Adaptive Multimodal Reasoning for Mode Selection and Reasoning Process2 Feb 2026
Similar, not cited
Close in wording, no citation either way
- 2025Perception, Reason, Think, and Plan: A Survey on Large Multimodal Reasoning Models
- 2025Advancing Multimodal Reasoning via Reinforcement Learning with Cold Start
- 2024Diving into Self-Evolving Training for Multimodal Reasoning
- 2026Text-Centric Post-Training for Omni-Modal Reasoning
- 2026R-C2: Cycle-Consistent Reinforcement Learning Improves Multimodal Reasoning
- 2025ARES: Multimodal Adaptive Reasoning via Difficulty-Aware Token-Level Entropy Shaping
- 2025OpenMMReasoner: Pushing the Frontiers for Multimodal Reasoning with an Open and General Recipe
- 2026Omni-Perception Policy Optimization for Multimodal Emotion Reasoning