Omni-R1: Towards the Unified Generative Paradigm for Multimodal Reasoning
On the map: LLM reasoning → Multimodal reasoning
Abstract (arXiv)
Multimodal Large Language Models (MLLMs) are making significant progress in multimodal reasoning. Early approaches focus on pure text-based reasoning. More recent studies have incorporated multimodal information into the reasoning steps; however, they often follow a single task-specific reasoning pattern, which limits their generalizability across various multimodal tasks. In fact, there are numerous multimodal tasks requiring diverse reasoning skills, such as zooming in on a specific region or marking an object within an image. To address this, we propose unified generative multimodal reasoning, which unifies diverse multimodal reasoning skills by generating intermediate images during the reasoning process. We instantiate this paradigm with Omni-R1, a two-stage SFT+RL framework featuring perception alignment loss and perception reward, thereby enabling functional image generation. Additionally, we introduce Omni-R1-Zero, which eliminates the need for multimodal annotations by bootstrapping step-wise visualizations from text-only reasoning data. Empirical results show that Omni-R1 achieves unified generative reasoning across a wide range of multimodal tasks, and Omni-R1-Zero can match or even surpass Omni-R1 on average, suggesting a promising direction for generative multimodal reasoning.
Key facts. Cited by 7 papers in the map (data through 7 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 31 of its 36 references that are in the map. First posted on arXiv 14 Jan 2026.
Builds on
31 of 36 references.
Closest ancestors · 14
Same direction, newest first
- 2025Zebra-CoT: A Dataset for Interleaved Vision Language Reasoning22 Jul
- 2025MINT-CoT: Enabling Interleaved Visual Tokens in Mathematical Chain-of-Thought Reasoning5 Jun
- 2025Thinking with Generated Images28 May
- 2025ViC-Bench: Benchmarking Visual-Interleaved Chain-of-Thought Capability in MLLMs with Free-Style Intermediate State Representations20 May
- 2025DeepEyes: Incentivizing "Thinking with Images" via Reinforcement Learning20 May
- 2025MM-Eureka: Exploring the Frontiers of Multimodal Reasoning with Rule-based Reinforcement Learning10 Mar
- 2025R1-Zero's "Aha Moment" in Visual Reasoning on a 2B Non-SFT Model7 Mar
- 2025Imagine while Reasoning in Space: Multimodal Visualization-of-Thought13 Jan
- 2024Interleaved-Modal Chain-of-Thought29 Nov
- 2024Visual Sketchpad: Sketching as a Visual Chain of Thought for Multimodal Language Models13 Jun
- 2024M3CoT: A Novel Benchmark for Multi-Domain Multi-step Multi-modal Chain-of-Thought26 May
- 2024KAM-CoT: Knowledge Augmented Multimodal Chain-of-Thoughts Reasoning23 Jan
2 more
Other references · 17
- 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,393
- 2024HybridFlow: A Flexible and Efficient RLHF Frameworkcited by 1,980
- 2023Evaluating Object Hallucination in Large Vision-Language Modelscited by 1,696
- 2023MME: A Comprehensive Evaluation Benchmark for Multimodal Large Language Modelscited by 1,624
- 2023MM-Vet: Evaluating Large Multimodal Models for Integrated Capabilitiescited by 1,221
- 2024Chameleon: Mixed-Modal Early-Fusion Foundation Modelscited by 904
- 2025Emerging Properties in Unified Multimodal Pretrainingcited by 855
- 2024Eyes Wide Shut? Exploring the Visual Shortcomings of Multimodal LLMscited by 719
- 2025Flow-GRPO: Training Flow Matching Models via Online RLcited by 605
- 2024BLINK: Multimodal Large Language Models Can See but Not Perceivecited by 529
- 2023V*: Guided Visual Search as a Core Mechanism in Multimodal LLMscited by 459
- 2024VLMEvalKit: An Open-Source Toolkit for Evaluating Large Multi-Modality Modelscited by 443
5 more
- 2021Inter-GPS: Interpretable Geometry Problem Solving with Formal Language and Symbolic Reasoningcited by 376
- 2024Multimodal ArXiv: A Dataset for Improving Scientific Comprehension of Large Vision-Language Modelscited by 138
- 2024Is LLM-as-a-Judge Robust? Investigating Universal Adversarial Attacks on Zero-shot LLM Assessmentcited by 117
- 2024ANOLE: An Open, Autoregressive, Native Large Multimodal Models for Interleaved Image-Text Generationcited by 112
- 2025Omni-R1: Reinforcement Learning for Omnimodal Reasoning via Two-System Collaborationcited by 38
Built on by
Citing papers per year: 2026: 7.
7 papers.
- 2026Thinking in Frames: How Visual Context and Test-Time Scaling Empower Video Reasoningcited by 10
- 2026VBVR-Pro: A Scalable and Verifiable Suite for Native Visual Reasoningcited by 4
- 2026TwiFF (Think With Future Frames): A Large-Scale Dataset for Dynamic Visual Reasoningcited by 3
- 2026Watch, Remember, Reason: Human-View Video Understanding with MLLMscited by 3
- 2026Optical Reasoning: Rethinking Images as an Expressive Reasoning Medium Beyond Textcited by 0
- 2026Efficient Reinforcement for Visual-Textual Thinking with Discrete Diffusion Modelcited by 0
- 2026Aphanta: Diagnosing Task-Aligned Image-Edited Intermediates for Multimodal Reasoningcited by 0
- 2026Aphanta: Diagnosing Task-Aligned Image-Edited Intermediates for Multimodal Reasoning27 Aug 2026
- 2026VBVR-Pro: A Scalable and Verifiable Suite for Native Visual Reasoning26 Aug 2026
- 2026Efficient Reinforcement for Visual-Textual Thinking with Discrete Diffusion Model11 Jun 2026
- 2026Optical Reasoning: Rethinking Images as an Expressive Reasoning Medium Beyond Text8 Jun 2026
- 2026Watch, Remember, Reason: Human-View Video Understanding with MLLMs5 Jun 2026
- 2026TwiFF (Think With Future Frames): A Large-Scale Dataset for Dynamic Visual Reasoning11 Feb 2026
- 2026Thinking in Frames: How Visual Context and Test-Time Scaling Empower Video Reasoning28 Jan 2026
Similar, not cited
Close in wording, no citation either way
- 2025ROVER: Benchmarking Reciprocal Cross-Modal Reasoning for Omnimodal Generation
- 2025R1-Onevision: Advancing Generalized Multimodal Reasoning through Cross-Modal Formalization
- 2025DiffThinker: Towards Generative Multimodal Reasoning with Diffusion Models
- 2025Uni-MMMU: A Massive Multi-discipline Multimodal Unified Benchmark
- 2026Reasoning with Image Generation
- 2025Mind with Eyes: from Language Reasoning to Multimodal Reasoning
- 2026FiRe: Fine-grained Multimodal Reasoning for Enhanced Image Generation
- 2025Query-Kontext: An Unified Multimodal Model for Image Generation and Editing