mlsanityData to 14 Oct 2026

Mags-RL: Wearing Multimodal LLMs a Magnifying Glass via Agentic Reinforcement Learning For Complex Scene Reasoning

arXiv 2605.27960 ↗First posted 27 May 2026cs.CVcited by 0

On the map: LLM reasoning → Multimodal reasoning

also in 2 more
Abstract (arXiv)

Despite their popularity and success, Multimodal Large Language Models (MLLMs) often struggle to interpret images accurately, which limits their reasoning capability in complex scenarios (e.g., high object density and complex background clutter). Prior work mainly addresses this limitation by incorporating explicit visual cues like bounding boxes that require extra annotations. In addition, the resulting low-resolution crops often miss fine-grained details that MLLMs require for accurate reasoning. Therefore, we propose Mags-RL, an Agentic Reinforcement Learning (RL) framework that equips MLLMs with an external super-resolution "magnifying glass" agent for high-resolution fine-grained inspection. Specifically, the model performs two-round reasoning: in the first round, it generates an initial rationale and autonomously identifies regions of interest without relying on additional annotations; in the second round, it invokes a super-resolution agent to crop and upscale those regions, then revisits and verifies its earlier reasoning to produce the final answer. We also introduce a novel curriculum learning strategy that enables data-efficient RL training, needing as few as only 40 training samples to achieve reasonable performance. Experiments on VSR, TallyQA, and GQA subsets show its superior performance against recent strong competing methods, demonstrating high-quality reasoning with precise visual grounding. Code and weights will be released soon.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 32 of its 54 references that are in the map. First posted on arXiv 27 May 2026.

Builds on

32 of 54 references.

Closest ancestors · 9

Same direction, newest first

  1. 2025Deep But Reliable: Advancing Multi-turn Reasoning for Thinking with Images19 Dec
  2. 2025From Perception to Cognition: A Survey of Vision-Language Interactive Reasoning in Multimodal Large Language Models29 Sep
  3. 2025Thinking with Images for Multimodal Reasoning: Foundations, Methods, and Future Frontiers30 Jun
  4. 2025GRIT: Teaching MLLMs to Think with Images21 May
  5. 2025Perception, Reason, Think, and Plan: A Survey on Large Multimodal Reasoning Models8 May
  6. 2025Grounded Chain-of-Thought for Multimodal Large Language Models17 Mar
  7. 2024Enhancing the Reasoning Ability of Multimodal Large Language Models via Mixed Preference Optimization15 Nov
  8. 2024Exploring the Reasoning Abilities of Multimodal Large Language Models (MLLMs): A Comprehensive Survey on Emerging Trends in Multimodal Reasoning10 Jan
  9. 2023Multimodal Chain-of-Thought Reasoning in Language Models2 Feb

Other references · 23

  1. 2020Language Models are Few-Shot Learnerscited by 32,419
  2. 2023GPT-4 Technical Reportcited by 18,396
  3. 2017Proximal Policy Optimization Algorithmscited by 15,215
  4. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
  5. 2025Qwen2.5-VL Technical Reportcited by 5,587
  6. 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 3,080
  7. 2025Qwen3-VL Technical Reportcited by 2,793
  8. 2022Do As I Can, Not As I Say: Grounding Language in Robotic Affordancescited by 2,348
  9. 2023PaLM-E: An Embodied Multimodal Language Modelcited by 2,071
  10. 2023Kosmos-2: Grounding Multimodal Large Language Models to the Worldcited by 1,089
  11. 2023Shikra: Unleashing Multimodal LLM's Referential Dialogue Magiccited by 906
  12. 2023Gemini: A Family of Highly Capable Multimodal Modelscited by 872
11 more
  1. 2025The Landscape of Agentic Reinforcement Learning for LLMs: A Surveycited by 205
  2. 2025Reinforcing Spatial Reasoning in Vision-Language Models with Interwoven Thinking and Visual Drawingcited by 136
  3. 2024Advancing Multimodal Medical Capabilities of Geminicited by 90
  4. 2025Agent-R1: A Unified and Modular Framework for Agentic Reinforcement Learningcited by 29
  5. 2025Meta-RL Induces Exploration in Language Agentscited by 21
  6. 2025DRA-GRPO: Your GRPO Needs to Know Diverse Reasoning Paths for Mathematical Reasoningcited by 18
  7. 2025Zoom-Refine: Boosting High-Resolution Multimodal Understanding via Localized Zoom and Self-Refinementcited by 18
  8. 2025LLaDA-MedV: Exploring Large Language Diffusion Models for Biomedical Image Understandingcited by 13
  9. 2025RetinalGPT: A Retinal Clinical Preference Conversational Assistant Powered by Large Vision-Language Modelscited by 10
  10. 2025AI Agent Behavioral Sciencecited by 6
  11. 2025AHA: Aligning Large Audio-Language Models for Reasoning Hallucinations via Counterfactual Hard Negativescited by 6

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Mitigating Visual Context Degradation in Large Multimodal Models: A Training-Free Decoupled Agentic Framework
  2. 2026TikArt: Stabilizing Aperture-Guided Fine-Grained Visual Reasoning with Reinforcement Learning
  3. 2025SenseNova-MARS: Empowering Multimodal Agentic Reasoning and Search via Reinforcement Learning
  4. 2025DeepEyesV2: Toward Agentic Multimodal Model
  5. 2025Observe-R1: Unlocking Reasoning Abilities of MLLMs with Dynamic Progressive Reinforcement Learning
  6. 2024Plug-and-Play Grounding of Reasoning in Multimodal Large Language Models
  7. 2025Seeing and Reasoning with Confidence: Supercharging Multimodal LLMs with an Uncertainty-Aware Agentic Framework
  8. 2025MMRPT: MultiModal Reinforcement Pre-Training via Masked Vision-Dependent Reasoning