Generative Universal Verifier as Multimodal Meta-Reasoner
On the map: LLM reasoning → Multimodal reasoning
Abstract (arXiv)
We introduce Generative Universal Verifier, a novel concept and plugin designed for next-generation multimodal reasoning in vision-language models and unified multimodal models, providing the fundamental capability of reflection and refinement on visual outcomes during the reasoning and generation process. This work makes three main contributions: (1) We build ViVerBench, a comprehensive benchmark spanning 16 categories of critical tasks for evaluating visual outcomes in multimodal reasoning. Results show that existing VLMs consistently underperform across these tasks, underscoring a substantial gap from human-level capability in reliable visual verification. (2) We design two automated pipelines to construct large-scale visual verification data and train OmniVerifier-7B, the first omni-capable generative verifier trained for universal visual verification and achieves notable gains on ViVerBench(+8.3). Through training, we identify three atomic capabilities in visual verification and demonstrate how they generalize and interact synergistically. (3) We propose OmniVerifier-TTS, a sequential test-time scaling paradigm that leverages the universal verifier to bridge image generation and editing within unified models, enhancing the upper bound of generative ability through iterative fine-grained optimization. Beyond generation, we extend universal verifier to broader world-modeling interleaved reasoning scenarios. Empirically, OmniVerifier-TTS achieves improvements on T2I-ReasonBench(+3.7), and GenEval++(+4.3), outperforming existing parallel test-time scaling methods, such as Best-of-N. By endowing multimodal reasoning with reliable visual verification, OmniVerifier advances both reliable reflection during generation and scalable test-time refinement, marking a step toward more trustworthy and controllable next-generation reasoning systems.
Key facts. Cited by 17 papers in the map (data through 7 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 45 of its 62 references that are in the map. First posted on arXiv 15 Oct 2025.
Builds on
45 of 62 references.
Closest ancestors · 14
Same direction, newest first
- 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiency25 Aug
- 2025T2I-ReasonBench: Benchmarking Reasoning-Informed Text-to-Image Generation24 Aug
- 2025PeRL: Permutation-Enhanced Reinforcement Learning for Interleaved Vision-Language Reasoning17 Jun
- 2025MINT-CoT: Enabling Interleaved Visual Tokens in Mathematical Chain-of-Thought Reasoning5 Jun
- 2025VisualSphinx: Large-Scale Synthetic Vision Logic Puzzles for RL29 May
- 2025Sherlock: Self-Correcting Reasoning in Vision-Language Models28 May
- 2025VisualQuality-R1: Reasoning-Induced Image Quality Assessment via Reinforcement Learning to Rank20 May
- 2025DeepEyes: Incentivizing "Thinking with Images" via Reinforcement Learning20 May
- 2025T2I-R1: Reinforcing Image Generation with Collaborative Semantic-level and Token-level CoT1 May
- 2025VLM-R1: A Stable and Generalizable R1-style Large Vision-Language Model10 Apr
- 2025Kimi-VL Technical Report10 Apr
- 2025LMM-R1: Empowering 3B LMMs with Strong Reasoning Abilities Through Two-Stage Rule-Based RL10 Mar
2 more
Other references · 31
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
- 2025Qwen2.5-VL Technical Reportcited by 5,418
- 2024GPT-4o System Cardcited by 4,467
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
- 2024SAM 2: Segment Anything in Images and Videoscited by 2,784
- 2023MiniGPT-4: Enhancing Vision-Language Understanding with Advanced Large Language Modelscited by 2,689
- 2025DAPO: An Open-Source LLM Reinforcement Learning System at Scalecited by 2,678
- 2024OpenAI o1 System Cardcited by 1,220
- 2025Qwen-Image Technical Reportcited by 973
- 2025Emerging Properties in Unified Multimodal Pretrainingcited by 855
- 2025Janus-Pro: Unified Multimodal Understanding and Generation with Data and Model Scalingcited by 787
- 2024DeepSeek-VL: Towards Real-World Vision-Language Understandingcited by 718
19 more
- 2024Training Language Models to Self-Correct via Reinforcement Learningcited by 405
- 2024OS-ATLAS: A Foundation Action Model for Generalist GUI Agentscited by 370
- 2025Seed1.5-VL Technical Reportcited by 367
- 2025BLIP3-o: A Family of Fully Open Unified Multimodal Models-Architecture, Training and Datasetcited by 363
- 2025Show-o2: Improved Native Unified Multimodal Modelscited by 242
- 2025MMaDA: Multimodal Large Diffusion Language Modelscited by 241
- 2025OmniGen2: Towards Instruction-Aligned Multimodal Generationcited by 241
- 2025Seedream 3.0 Technical Reportcited by 146
- 2025Mogao: An Omni Foundation Model for Interleaved Multi-Modal Generationcited by 108
- 2025Echo-4o: Harnessing the Power of GPT-4o Synthetic Images for Improved Image Generationcited by 95
- 2025ShareGPT-4o-Image: Aligning Multimodal Models with GPT-4o-Level Image Generationcited by 94
- 2025IntPhys 2: Benchmarking Intuitive Physics Understanding In Complex Synthetic Environmentscited by 49
- 2025Reconstruction Alignment Improves Unified Multimodal Modelscited by 48
- 2025Kwai Keye-VL Technical Reportcited by 47
- 2025LLaVA-Critic-R1: Your Critic Model is Secretly a Strong Policy Modelcited by 34
- 2024IterComp: Iterative Composition-Aware Feedback Learning from Model Gallery for Text-to-Image Generationcited by 32
- 2025Delving into RL for Image Generation with CoT: A Study on DPO vs. GRPOcited by 31
- 2025PointArena: Probing Multimodal Grounding Through Language-Guided Pointingcited by 30
- 2025HermesFlow: Seamlessly Closing the Gap in Multimodal Understanding and Generationcited by 17
Built on by
Citing papers per year: 2025: 3; 2026: 14.
17 papers.
Sort:
By area:
- 2026RLAnything: Forge Environment, Policy, and Reward Model in Completely Dynamic RL Systemcited by 19
- 2025Multimodal RewardBench 2: Evaluating Omni Reward Models for Interleaved Text and Imagecited by 16
- 2025DraCo: Draft as CoT for Text-to-Image Preview and Rare Concept Generationcited by 13
- 2026Who&When Pro: Can LLMs Really Attribute Failures in AI Agents?cited by 11
- 2026Reward Modeling from Natural Language Human Feedbackcited by 7
- 2026Beyond VLM-Based Rewards: Diffusion-Native Latent Reward Modelingcited by 5
- 2025See Less, See Right: Bi-directional Perceptual Shaping For Multimodal Reasoningcited by 3
- 2026PerceptionBench: Evaluating Atomic Visual Perception in Multimodal Large Language Modelscited by 3
- 2026OmniVerifier-M1: Multimodal Meta-Verifier with Explicit Structured Recalibrationcited by 2
- 2026Verification Mirage: Mapping the Reliability Boundary of Self-Verification in Medical VQAcited by 1
- 2026VidForensics-M1: Meta-Detection Reinforcement Learning with Verifiable Temporal Grounding for AI-Generated Video Forensicscited by 1
- 2026Benchmarking and Evolving Reason-Reflect-Rectify for Reflective Visual Generationcited by 0
5 more
- 2026Test-Time Scaling in Multimodal Foundation Models: A Comprehensive Survey of Generation and Reasoningcited by 0
- 2026LOCI: A Locator-Critic with Refinement Loopcited by 0
- 2026Agentic Visual Generation: From Generative Models to Agentic Controlcited by 0
- 2026SciGen-Verifier: A Multimodal Reasoner for Explainable Verification in Scientific Image Generationcited by 0
- 2026OP-CAD: On-Policy Clean-Audio Distillation for Robust Audio-Visual Reasoningcited by 0
- 2026OP-CAD: On-Policy Clean-Audio Distillation for Robust Audio-Visual Reasoning30 Sep 2026
- 2026SciGen-Verifier: A Multimodal Reasoner for Explainable Verification in Scientific Image Generation27 Sep 2026
- 2026Agentic Visual Generation: From Generative Models to Agentic Control6 Sep 2026
- 2026LOCI: A Locator-Critic with Refinement Loop31 Aug 2026
- 2026VidForensics-M1: Meta-Detection Reinforcement Learning with Verifiable Temporal Grounding for AI-Generated Video Forensics11 Aug 2026
- 2026PerceptionBench: Evaluating Atomic Visual Perception in Multimodal Large Language Models27 Jul 2026
- 2026Who&When Pro: Can LLMs Really Attribute Failures in AI Agents?10 Jul 2026
- 2026Test-Time Scaling in Multimodal Foundation Models: A Comprehensive Survey of Generation and Reasoning6 Jun 2026
- 2026OmniVerifier-M1: Multimodal Meta-Verifier with Explicit Structured Recalibration27 May 2026
- 2026Benchmarking and Evolving Reason-Reflect-Rectify for Reflective Visual Generation19 May 2026
- 2026Verification Mirage: Mapping the Reliability Boundary of Self-Verification in Medical VQA11 May 2026
- 2026Beyond VLM-Based Rewards: Diffusion-Native Latent Reward Modeling11 Feb 2026
5 more
- 2026RLAnything: Forge Environment, Policy, and Reward Model in Completely Dynamic RL System2 Feb 2026
- 2026Reward Modeling from Natural Language Human Feedback12 Jan 2026
- 2025See Less, See Right: Bi-directional Perceptual Shaping For Multimodal Reasoning26 Dec 2025
- 2025Multimodal RewardBench 2: Evaluating Omni Reward Models for Interleaved Text and Image18 Dec 2025
- 2025DraCo: Draft as CoT for Text-to-Image Preview and Rare Concept Generation4 Dec 2025
- 2025DraCo: Draft as CoT for Text-to-Image Preview and Rare Concept Generationcited by 13
- 2025See Less, See Right: Bi-directional Perceptual Shaping For Multimodal Reasoningcited by 3
- 2026Benchmarking and Evolving Reason-Reflect-Rectify for Reflective Visual Generationcited by 0
- 2026Test-Time Scaling in Multimodal Foundation Models: A Comprehensive Survey of Generation and Reasoningcited by 0
- 2026OP-CAD: On-Policy Clean-Audio Distillation for Robust Audio-Visual Reasoningcited by 0
- 2026OP-CAD: On-Policy Clean-Audio Distillation for Robust Audio-Visual Reasoning30 Sep 2026
- 2026Test-Time Scaling in Multimodal Foundation Models: A Comprehensive Survey of Generation and Reasoning6 Jun 2026
- 2026Benchmarking and Evolving Reason-Reflect-Rectify for Reflective Visual Generation19 May 2026
- 2025See Less, See Right: Bi-directional Perceptual Shaping For Multimodal Reasoning26 Dec 2025
- 2025DraCo: Draft as CoT for Text-to-Image Preview and Rare Concept Generation4 Dec 2025
- 2026PerceptionBench: Evaluating Atomic Visual Perception in Multimodal Large Language Modelscited by 3
- 2026OmniVerifier-M1: Multimodal Meta-Verifier with Explicit Structured Recalibrationcited by 2
- 2026Verification Mirage: Mapping the Reliability Boundary of Self-Verification in Medical VQAcited by 1
- 2026LOCI: A Locator-Critic with Refinement Loopcited by 0
- 2026LOCI: A Locator-Critic with Refinement Loop31 Aug 2026
- 2026PerceptionBench: Evaluating Atomic Visual Perception in Multimodal Large Language Models27 Jul 2026
- 2026OmniVerifier-M1: Multimodal Meta-Verifier with Explicit Structured Recalibration27 May 2026
- 2026Verification Mirage: Mapping the Reliability Boundary of Self-Verification in Medical VQA11 May 2026
Similar, not cited
Close in wording, no citation either way
- 2026Omni-R1: Towards the Unified Generative Paradigm for Multimodal Reasoning
- 2025VERIFY: A Benchmark of Visual Explanation and Reasoning for Investigating Multimodal Reasoning Fidelity
- 2026When to Rethink: Learning Multi-Perspective Self-Verification for Vision-Language Models
- 2026Reflect to Inform: Boosting Multimodal Reasoning via Information-Gain-Driven Verification
- 2026Reasoning with Image Generation
- 2026Vision Inference Former: Sustaining Visual Consistency in Multimodal Large Language Models
- 2026When Does Visual Generation Help Visual Understanding in Unified Multimodal Models?
- 2025Uni-MMMU: A Massive Multi-discipline Multimodal Unified Benchmark