mlsanityData to 7 Oct 2026

Generative Universal Verifier as Multimodal Meta-Reasoner

arXiv 2510.13804 ↗First posted 15 Oct 2025cs.CV cs.AI cs.CLcited by 17

On the map: LLM reasoning → Multimodal reasoning

also in 1 more
Abstract (arXiv)

We introduce Generative Universal Verifier, a novel concept and plugin designed for next-generation multimodal reasoning in vision-language models and unified multimodal models, providing the fundamental capability of reflection and refinement on visual outcomes during the reasoning and generation process. This work makes three main contributions: (1) We build ViVerBench, a comprehensive benchmark spanning 16 categories of critical tasks for evaluating visual outcomes in multimodal reasoning. Results show that existing VLMs consistently underperform across these tasks, underscoring a substantial gap from human-level capability in reliable visual verification. (2) We design two automated pipelines to construct large-scale visual verification data and train OmniVerifier-7B, the first omni-capable generative verifier trained for universal visual verification and achieves notable gains on ViVerBench(+8.3). Through training, we identify three atomic capabilities in visual verification and demonstrate how they generalize and interact synergistically. (3) We propose OmniVerifier-TTS, a sequential test-time scaling paradigm that leverages the universal verifier to bridge image generation and editing within unified models, enhancing the upper bound of generative ability through iterative fine-grained optimization. Beyond generation, we extend universal verifier to broader world-modeling interleaved reasoning scenarios. Empirically, OmniVerifier-TTS achieves improvements on T2I-ReasonBench(+3.7), and GenEval++(+4.3), outperforming existing parallel test-time scaling methods, such as Best-of-N. By endowing multimodal reasoning with reliable visual verification, OmniVerifier advances both reliable reflection during generation and scalable test-time refinement, marking a step toward more trustworthy and controllable next-generation reasoning systems.

Key facts. Cited by 17 papers in the map (data through 7 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 45 of its 62 references that are in the map. First posted on arXiv 15 Oct 2025.

Builds on

45 of 62 references.

Closest ancestors · 14

Same direction, newest first

  1. 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiency25 Aug
  2. 2025T2I-ReasonBench: Benchmarking Reasoning-Informed Text-to-Image Generation24 Aug
  3. 2025PeRL: Permutation-Enhanced Reinforcement Learning for Interleaved Vision-Language Reasoning17 Jun
  4. 2025MINT-CoT: Enabling Interleaved Visual Tokens in Mathematical Chain-of-Thought Reasoning5 Jun
  5. 2025VisualSphinx: Large-Scale Synthetic Vision Logic Puzzles for RL29 May
  6. 2025Sherlock: Self-Correcting Reasoning in Vision-Language Models28 May
  7. 2025VisualQuality-R1: Reasoning-Induced Image Quality Assessment via Reinforcement Learning to Rank20 May
  8. 2025DeepEyes: Incentivizing "Thinking with Images" via Reinforcement Learning20 May
  9. 2025T2I-R1: Reinforcing Image Generation with Collaborative Semantic-level and Token-level CoT1 May
  10. 2025VLM-R1: A Stable and Generalizable R1-style Large Vision-Language Model10 Apr
  11. 2025Kimi-VL Technical Report10 Apr
  12. 2025LMM-R1: Empowering 3B LMMs with Strong Reasoning Abilities Through Two-Stage Rule-Based RL10 Mar
2 more
  1. 2025Can MLLMs Reason in Multimodality? EMMA: An Enhanced MultiModal ReAsoning Benchmark9 Jan
  2. 2025Unlocking Multimodal Mathematical Reasoning via Process Reward Model8 Jan

Other references · 31

  1. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
  2. 2025Qwen2.5-VL Technical Reportcited by 5,418
  3. 2024GPT-4o System Cardcited by 4,467
  4. 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
  5. 2024SAM 2: Segment Anything in Images and Videoscited by 2,784
  6. 2023MiniGPT-4: Enhancing Vision-Language Understanding with Advanced Large Language Modelscited by 2,689
  7. 2025DAPO: An Open-Source LLM Reinforcement Learning System at Scalecited by 2,678
  8. 2024OpenAI o1 System Cardcited by 1,220
  9. 2025Qwen-Image Technical Reportcited by 973
  10. 2025Emerging Properties in Unified Multimodal Pretrainingcited by 855
  11. 2025Janus-Pro: Unified Multimodal Understanding and Generation with Data and Model Scalingcited by 787
  12. 2024DeepSeek-VL: Towards Real-World Vision-Language Understandingcited by 718
19 more
  1. 2024Training Language Models to Self-Correct via Reinforcement Learningcited by 405
  2. 2024OS-ATLAS: A Foundation Action Model for Generalist GUI Agentscited by 370
  3. 2025Seed1.5-VL Technical Reportcited by 367
  4. 2025BLIP3-o: A Family of Fully Open Unified Multimodal Models-Architecture, Training and Datasetcited by 363
  5. 2025Show-o2: Improved Native Unified Multimodal Modelscited by 242
  6. 2025MMaDA: Multimodal Large Diffusion Language Modelscited by 241
  7. 2025OmniGen2: Towards Instruction-Aligned Multimodal Generationcited by 241
  8. 2025Seedream 3.0 Technical Reportcited by 146
  9. 2025Mogao: An Omni Foundation Model for Interleaved Multi-Modal Generationcited by 108
  10. 2025Echo-4o: Harnessing the Power of GPT-4o Synthetic Images for Improved Image Generationcited by 95
  11. 2025ShareGPT-4o-Image: Aligning Multimodal Models with GPT-4o-Level Image Generationcited by 94
  12. 2025IntPhys 2: Benchmarking Intuitive Physics Understanding In Complex Synthetic Environmentscited by 49
  13. 2025Reconstruction Alignment Improves Unified Multimodal Modelscited by 48
  14. 2025Kwai Keye-VL Technical Reportcited by 47
  15. 2025LLaVA-Critic-R1: Your Critic Model is Secretly a Strong Policy Modelcited by 34
  16. 2024IterComp: Iterative Composition-Aware Feedback Learning from Model Gallery for Text-to-Image Generationcited by 32
  17. 2025Delving into RL for Image Generation with CoT: A Study on DPO vs. GRPOcited by 31
  18. 2025PointArena: Probing Multimodal Grounding Through Language-Guided Pointingcited by 30
  19. 2025HermesFlow: Seamlessly Closing the Gap in Multimodal Understanding and Generationcited by 17

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 3; 2026: 14.

17 papers.

Sort:

By area:

  1. 2026RLAnything: Forge Environment, Policy, and Reward Model in Completely Dynamic RL Systemcited by 19
  2. 2025Multimodal RewardBench 2: Evaluating Omni Reward Models for Interleaved Text and Imagecited by 16
  3. 2025DraCo: Draft as CoT for Text-to-Image Preview and Rare Concept Generationcited by 13
  4. 2026Who&When Pro: Can LLMs Really Attribute Failures in AI Agents?cited by 11
  5. 2026Reward Modeling from Natural Language Human Feedbackcited by 7
  6. 2026Beyond VLM-Based Rewards: Diffusion-Native Latent Reward Modelingcited by 5
  7. 2025See Less, See Right: Bi-directional Perceptual Shaping For Multimodal Reasoningcited by 3
  8. 2026PerceptionBench: Evaluating Atomic Visual Perception in Multimodal Large Language Modelscited by 3
  9. 2026OmniVerifier-M1: Multimodal Meta-Verifier with Explicit Structured Recalibrationcited by 2
  10. 2026Verification Mirage: Mapping the Reliability Boundary of Self-Verification in Medical VQAcited by 1
  11. 2026VidForensics-M1: Meta-Detection Reinforcement Learning with Verifiable Temporal Grounding for AI-Generated Video Forensicscited by 1
  12. 2026Benchmarking and Evolving Reason-Reflect-Rectify for Reflective Visual Generationcited by 0
5 more
  1. 2026Test-Time Scaling in Multimodal Foundation Models: A Comprehensive Survey of Generation and Reasoningcited by 0
  2. 2026LOCI: A Locator-Critic with Refinement Loopcited by 0
  3. 2026Agentic Visual Generation: From Generative Models to Agentic Controlcited by 0
  4. 2026SciGen-Verifier: A Multimodal Reasoner for Explainable Verification in Scientific Image Generationcited by 0
  5. 2026OP-CAD: On-Policy Clean-Audio Distillation for Robust Audio-Visual Reasoningcited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2026Omni-R1: Towards the Unified Generative Paradigm for Multimodal Reasoning
  2. 2025VERIFY: A Benchmark of Visual Explanation and Reasoning for Investigating Multimodal Reasoning Fidelity
  3. 2026When to Rethink: Learning Multi-Perspective Self-Verification for Vision-Language Models
  4. 2026Reflect to Inform: Boosting Multimodal Reasoning via Information-Gain-Driven Verification
  5. 2026Reasoning with Image Generation
  6. 2026Vision Inference Former: Sustaining Visual Consistency in Multimodal Large Language Models
  7. 2026When Does Visual Generation Help Visual Understanding in Unified Multimodal Models?
  8. 2025Uni-MMMU: A Massive Multi-discipline Multimodal Unified Benchmark