Perceptual Flow Network for Visually Grounded Reasoning
On the map: LLM reasoning → Multimodal reasoning
Abstract (arXiv)
Despite the success of Large-Vision Language Models (LVLMs), general optimization objectives (e.g., standard MLE) fail to constrain visual trajectories, leading to language bias and hallucination. To mitigate this, current methods introduce geometric priors from visual experts as additional supervision. However, we observe that such supervision is typically suboptimal: it is biased toward geometric precision and offers limited reasoning utility. To bridge this gap, we propose Perceptual Flow Network (PFlowNet), which eschews rigid alignment with the expert priors and achieves interpretable yet more effective visual reasoning. Specifically, PFlowNet decouples perception from reasoning to establish a self-conditioned generation process. Based on this, it integrates multi-dimensional rewards with vicinal geometric shaping via variational reinforcement learning, thereby facilitating reasoning-oriented perceptual behaviors while preserving visual reliability. PFlowNet delivers a provable performance guarantee and competitive empirical results, particularly setting new SOTA records on V* Bench (90.6%) and MME-RealWorld-lite (67.0%).
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 55 of its 60 references that are in the map. First posted on arXiv 4 May 2026.
Builds on
55 of 60 references.
Closest ancestors · 21
Same direction, newest first
- 2026StruVis: Enhancing Reasoning-based Text-to-Image Generation via Thinking with Structured Vision6 Mar
- 2026DeepScan: A Training-Free Framework for Visually Grounded Reasoning in Large Vision-Language Models4 Mar
- 2025CodeDance: A Dynamic Tool-integrated MLLM for Executable Visual Reasoning19 Dec
- 2025VACoT: Rethinking Visual Data Augmentation with VLMs2 Dec
- 2025Look as You Think: Unifying Reasoning and Visual Evidence Attribution for Verifiable Document RAG via Reinforcement Learning15 Nov
- 2025MIRG-RL: Multi-Image Reasoning and Grounding with Reinforcement Learning26 Sep
- 2025Thyme: Think Beyond Images15 Aug
- 2025VGR: Visual Grounded Reasoning13 Jun
- 2025Grounded Reinforcement Learning for Visual Reasoning29 May
- 2025VLM-R3: Region Recognition, Reasoning, and Refinement for Enhanced Multimodal Chain-of-Thought22 May
- 2025Pixel Reasoner: Incentivizing Pixel-Space Reasoning with Curiosity-Driven Reinforcement Learning21 May
- 2025DeepEyes: Incentivizing "Thinking with Images" via Reinforcement Learning20 May
9 more
- 2025Visual Agentic Reinforcement Fine-Tuning20 May
- 2025SoTA with Less: MCTS-Guided Sample Selection for Data-Efficient Visual Reasoning Self-Improvement10 Apr
- 2025VLM-R1: A Stable and Generalizable R1-style Large Vision-Language Model10 Apr
- 2025Kimi-VL Technical Report10 Apr
- 2025Visual-RFT: Visual Reinforcement Fine-Tuning3 Mar
- 2024Visual Sketchpad: Sketching as a Visual Chain of Thought for Multimodal Language Models13 Jun
- 2024Measuring Multimodal Mathematical Reasoning with MATH-Vision Dataset22 Feb
- 2023MMBench: Is Your Multi-modal Model an All-around Player?12 Jul
- 2022ChartQA: A Benchmark for Question Answering about Charts with Visual and Logical Reasoning19 Mar
Other references · 34
- 2017Attention Is All You Needcited by 59,932
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2023Visual Instruction Tuningcited by 7,792
- 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,767
- 2025Qwen2.5-VL Technical Reportcited by 5,418
- 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,274
- 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,669
- 2025InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Modelscited by 1,769
- 2023Evaluating Object Hallucination in Large Vision-Language Modelscited by 1,696
- 2024LlamaFactory: Unified Efficient Fine-Tuning of 100+ Language Modelscited by 1,442
- 2025Does Reinforcement Learning Really Incentivize Reasoning Capacity in LLMs Beyond the Base Model?cited by 948
- 2024Cambrian-1: A Fully Open, Vision-Centric Exploration of Multimodal LLMscited by 822
22 more
- 2016A Diagram Is Worth A Dozen Imagescited by 793
- 2025UI-TARS: Pioneering Automated GUI Interaction with Native Agentscited by 584
- 2023HallusionBench: An Advanced Diagnostic Suite for Entangled Language Hallucination and Visual Illusion in Large Vision-Language Modelscited by 572
- 2024SeeClick: Harnessing GUI Grounding for Advanced Visual GUI Agentscited by 553
- 2023V*: Guided Visual Search as a Core Mechanism in Multimodal LLMscited by 459
- 2024Navigating the Digital World as Humans Do: Universal Visual Grounding for GUI Agentscited by 373
- 2024OS-ATLAS: A Foundation Action Model for Generalist GUI Agentscited by 370
- 2025Seed1.5-VL Technical Reportcited by 367
- 2024A Survey on Hallucination in Large Vision-Language Modelscited by 352
- 2024MME-RealWorld: Could Your Multimodal LLM Challenge High-Resolution Real-World Scenarios that are Difficult for Humans?cited by 284
- 2023Detecting and Preventing Hallucinations in Large Vision Language Modelscited by 254
- 2025ScreenSpot-Pro: GUI Grounding for Professional High-Resolution Computer Usecited by 246
- 2025GUI-R1 : A Generalist R1-Style Vision-Language Action Model For GUI Agentscited by 240
- 2024Divide, Conquer and Combine: A Training-Free Framework for High-Resolution Image Perception in Multimodal Large Language Modelscited by 151
- 2024Multimodal ArXiv: A Dataset for Improving Scientific Comprehension of Large Vision-Language Modelscited by 138
- 2022Learning GFlowNets from partial episodes for improved convergence and stabilitycited by 129
- 2025DeepEyesV2: Toward Agentic Multimodal Modelcited by 119
- 2025Traceable Evidence Enhanced Visual Grounded Reasoning: Evaluation and Methodologycited by 67
- 2024The Dawn of GUI Agent: A Preliminary Case Study with Claude 3.5 Computer Usecited by 62
- 2024Multi-Object Hallucination in Vision-Language Modelscited by 60
- 2025DyFo: A Training-Free Dynamic Focus Visual Search for Enhancing LMMs in Fine-Grained Visual Understandingcited by 47
- 2025Zoom-Refine: Boosting High-Resolution Multimodal Understanding via Localized Zoom and Self-Refinementcited by 18
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025GFlowVLM: Enhancing Multi-step Reasoning in Vision-Language Models with Generative Flow Networks
- 2025MathFlow: Enhancing the Perceptual Flow of MLLMs for Visual Mathematical Problems
- 2026Flow-of-Thought: A Framework for Visual Reasoning
- 2025Perception Before Reasoning: Two-Stage Reinforcement Learning for Visual Reasoning in Vision-Language Models
- 2025Artemis: Structured Visual Reasoning for Perception Policy Learning
- 2025GeoPQA: Bridging the Visual Perception Gap in MLLMs for Geometric Reasoning
- 2025Ground-R1: Incentivizing Grounded Visual Reasoning via Reinforcement Learning
- 2026Decomposed On-Policy Distillation for Vision-Language Reasoning: Steering Gradients for Visual Grounding