V-ABS: Action-Observer Driven Beam Search for Dynamic Visual Reasoning
On the map: LLM reasoning → Multimodal reasoning
Abstract (arXiv)
Multimodal large language models (MLLMs) have achieved remarkable success in general perception, yet complex multi-step visual reasoning remains a persistent challenge. Although recent agentic approaches incorporate tool use, they often neglect critical execution feedback. Consequently, they suffer from the imagination-action-observer (IAO) bias, a misalignment between prior imagination and observer feedback that undermines reasoning stability and optimality. To bridge this gap, we introduce V-ABS, an action-observer driven beam search framework that enables deliberate reasoning through thinker-actor-observer iterations. We also propose an entropy-based adaptive weighting algorithm to mitigate the IAO bias by dynamically balancing the confidence scores between the policy priors and the observational feedback. Moreover, we construct a large-scale supervised fine-tuning (SFT) dataset comprising over 80k samples to guide the model to assign higher prior confidence to correct action paths. Extensive experiments across eight diverse benchmarks show that V-ABS achieves state-of-the-art performance, delivering an average improvement of 19.7% on the Qwen3-VL-8B baseline and consistent gains across both open-source and proprietary models.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 26 of its 48 references that are in the map. First posted on arXiv 11 May 2026.
Builds on
26 of 48 references.
Closest ancestors · 9
Same direction, newest first
- 2025TIR-Bench: A Comprehensive Benchmark for Agentic Thinking-with-Images Reasoning3 Nov
- 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiency25 Aug
- 2025Thyme: Think Beyond Images15 Aug
- 2025Pixel Reasoner: Incentivizing Pixel-Space Reasoning with Curiosity-Driven Reinforcement Learning21 May
- 2025VisuoThink: Empowering LVLM Reasoning with Multimodal Tree Search12 Apr
- 2024Expanding Performance Boundaries of Open-Source Multimodal Models with Model, Data, and Test-Time Scaling6 Dec
- 2024AtomThink: Multimodal Slow Thinking with Atomic Step Reasoning18 Nov
- 2023MM-REACT: Prompting ChatGPT for Multimodal Reasoning and Action20 Mar
- 2023Multimodal Chain-of-Thought Reasoning in Language Models2 Feb
Other references · 17
- 2023GPT-4 Technical Reportcited by 18,132
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
- 2025Qwen3 Technical Reportcited by 8,195
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,146
- 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,601
- 2024GPT-4o System Cardcited by 4,467
- 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,151
- 2023Qwen Technical Reportcited by 3,273
- 2024Gemini 1.5: Unlocking multimodal understanding across millions of tokens of contextcited by 3,175
- 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,669
- 2024Scaling LLM Test-Time Compute Optimally can be More Effective than Scaling Model Parameterscited by 1,928
- 2024OpenAI o1 System Cardcited by 1,220
5 more
- 2023Alphazero-like Tree-Search can Guide Large Language Model Decoding and Trainingcited by 291
- 2016Sequence-to-Sequence Learning as Beam-Search Optimizationcited by 126
- 2025DeepEyesV2: Toward Agentic Multimodal Modelcited by 119
- 2025Revisiting the Test-Time Scaling of o1-like Models: Do they Truly Possess Test-Time Scaling Capabilities?cited by 69
- 2023TouchStone: Evaluating Vision-Language Models by Language Modelscited by 54
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026ATA: Bridging Implicit Reasoning with Attention-Guided and Action-Guided Inference for Vision-Language Action Models
- 2026Insight-V++: Towards Advanced Long-Chain Visual Reasoning with Multimodal Large Language Models
- 2026VisualThink-VLA: Visual Intermediate Reasoning for Effective and Low-Latency Vision-Language-Action Policies
- 2025Multi-Step Visual Reasoning with Visual Tokens Scaling and Verification
- 2025More Thought, Less Accuracy? On the Dual Nature of Reasoning in Vision-Language Models
- 2026Visual-Seeker: Towards Visual-Native Multimodal Agentic Search via Active Visual Reasoning
- 2025DeepThinkVLA: Enhancing Reasoning Capability of Vision-Language-Action Models
- 2025PhysVLM-AVR: Active Visual Reasoning for Multimodal Large Language Models in Physical Environments