BUS: Brain-Inspired Unsupervised Self-Reflection via Backward Prediction for Multimodal Reasoning
On the map: LLM reasoning → Multimodal reasoning
Abstract (arXiv)
Current Vision-Language Models (VLMs) often struggle to handle complex visual tasks that require consistent and fine-grained reasoning. Recent methods aim to train models to facilitate self-reflective reasoning, i.e., reviewing and improving the generated reasoning. However, they require large volumes of annotated data and lack explicit reflective behavior during test time. By contrast, humans perform explicit and efficient self-reflection through mechanisms such as backward prediction, i.e., predicting which current states are likely to precede a given future state. Inspired by neuroscience, this work proposes a novel solution to address these challenges. We first observe and investigate the phenomenon that mainstream VLMs can perform backward prediction, similar to the human brain. A label-free training framework named Brain-inspired Unsupervised Self-reflection (BUS) is proposed to leverage and exploit backward prediction capability to enhance reflective reasoning in complex visual tasks. BUS enables self-verification of reflective reasoning based on backward prediction, providing explicit learning signals under unsupervised conditions. In this way, BUS eliminates reliance on annotated data while improving reasoning performance. Designed as a model-agnostic plug-in, our framework is compatible with popular fine-tuning methods, such as Supervised Fine-Tuning (SFT) and Reinforcement Learning (RL). Initialized from Qwen3-VL-8B, it improves HR-Bench-8K (+8.0%), HR-Bench-4K (+7.7%), V* Bench (+6.3%), and MME-RealWorld-Lite (+5.8%), proving backward prediction is key to advancing reflective reasoning.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 26 of its 51 references that are in the map. First posted on arXiv 8 Jul 2026.
Builds on
26 of 51 references.
Closest ancestors · 11
Same direction, newest first
- 2026AnE: Pushing the Reasoning Frontier of Multimodal LLMs via Anchor Evolution25 May
- 2026Improving Visual Reasoning with Iterative Evidence Refinement14 Mar
- 2026Bridging Modality Disconnect in Self-Reflection via Closed-Loop Visually Grounded Verification21 Feb
- 2026TikArt: Stabilizing Aperture-Guided Fine-Grained Visual Reasoning with Reinforcement Learning16 Feb
- 2026Learning Self-Correction in Vision-Language Models via Rollout Augmentation9 Feb
- 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiency25 Aug
- 2025Thyme: Think Beyond Images15 Aug
- 2025Pixel Reasoner: Incentivizing Pixel-Space Reasoning with Curiosity-Driven Reinforcement Learning21 May
- 2025DeepEyes: Incentivizing "Thinking with Images" via Reinforcement Learning20 May
- 2025SFT or RL? An Early Investigation into Training R1-Like Reasoning Large Vision-Language Models10 Apr
- 2025Vision-R1: Incentivizing Reasoning Capability in Multimodal Large Language Models9 Mar
Other references · 15
- 2025Qwen2.5-VL Technical Reportcited by 5,587
- 2024GPT-4o System Cardcited by 4,588
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,796
- 2025Qwen3-VL Technical Reportcited by 2,793
- 2025InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Modelscited by 1,834
- 2025OpenAI GPT-5 System Cardcited by 989
- 2026Kimi K2.5: Visual Agentic Intelligencecited by 501
- 2025DeepEyesV2: Toward Agentic Multimodal Modelcited by 125
- 2025Agent-R: Training Language Model Agents to Reflect via Iterative Self-Trainingcited by 82
- 2025Traceable Evidence Enhanced Visual Grounded Reasoning: Evaluation and Methodologycited by 69
- 2026Zooming without Zooming: Region-to-Image Distillation for Fine-Grained Multimodal Perceptioncited by 50
- 2026Experiential Reinforcement Learningcited by 22
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025See, Think, Learn: A Self-Taught Multimodal Reasoner
- 2026SVSR: A Self-Verification and Self-Rectification Paradigm for Multimodal Reasoning
- 2026Reflect to Inform: Boosting Multimodal Reasoning via Information-Gain-Driven Verification
- 2026Visually Grounded Self-Reflection for Vision-Language Models via Reinforcement Learning
- 2025Journey Before Destination: On the importance of Visual Faithfulness in Slow Thinking
- 2024Vision-Language Models Can Self-Improve Reasoning via Reflection
- 2025Look-Back: Implicit Visual Re-focusing in MLLM Reasoning
- 2026SwimBird: Eliciting Switchable Reasoning Mode in Hybrid Autoregressive MLLMs