mlsanityData to 7 Oct 2026

TikArt: Stabilizing Aperture-Guided Fine-Grained Visual Reasoning with Reinforcement Learning

arXiv 2602.14482 ↗First posted 16 Feb 2026cs.CV cs.AIcited by 4

On the map: LLM reasoning → Multimodal reasoning

also in 1 more
Abstract (arXiv)

Fine-grained visual reasoning in multimodal large language models (MLLMs) is bottlenecked by single-pass global image encoding: key evidence often lies in tiny objects, cluttered regions, subtle markings, or dense charts. We present TikArt (Thinking Aperture), an aperture-guided agent that formulates multimodal reasoning as sequential evidence acquisition over regions of interest. TikArt follows a Think--Aperture--Observe (TAO) loop that interleaves language reasoning with two aperture actions: Zoom, which extracts rectangular crops, and Segment, which invokes an off-the-shelf segmenter to produce object-centric mask-based views for irregular targets. A mandatory Observation step after every aperture action writes local evidence back into text, yielding interpretable aperture trajectories and persistent linguistic memory. Built on Qwen3-VL-8B, TikArt is trained with GRPO-style reinforcement learning under a two-stage curriculum. To stabilize long-horizon tool-integrated learning, we introduce Relative Uncertainty Reduction (RUR), a dense reward computed by a frozen evaluator that favors evidence-building trajectories and mitigates degenerate tool use. Experiments on high-resolution reasoning, general multimodal understanding, and both referring and reasoning-oriented segmentation show consistent gains over the backbone, demonstrating that aperture-guided observation improves fine-grained visual reasoning and transfers naturally to pixel-level grounding.

Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 25 of its 32 references that are in the map. First posted on arXiv 16 Feb 2026.

Builds on

25 of 32 references.

Closest ancestors · 13

Same direction, newest first

  1. 2025Monet: Reasoning in Latent Visual Space Beyond Images and Language26 Nov
  2. 2025RewardMap: Tackling Sparse Rewards in Fine-grained Visual Reasoning via Multi-Stage Reinforcement Learning2 Oct
  3. 2025Latent Visual Reasoning29 Sep
  4. 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiency25 Aug
  5. 2025Thyme: Think Beyond Images15 Aug
  6. 2025Thinking with Images for Multimodal Reasoning: Foundations, Methods, and Future Frontiers30 Jun
  7. 2025Seg-R1: Segmentation Can Be Surprisingly Simple with Reinforcement Learning27 Jun
  8. 2025SAM-R1: Leveraging SAM for Reward Feedback in Multimodal Segmentation via Reinforcement Learning28 May
  9. 2025Pixel Reasoner: Incentivizing Pixel-Space Reasoning with Curiosity-Driven Reinforcement Learning21 May
  10. 2025DeepEyes: Incentivizing "Thinking with Images" via Reinforcement Learning20 May
  11. 2025SoTA with Less: MCTS-Guided Sample Selection for Data-Efficient Visual Reasoning Self-Improvement10 Apr
  12. 2024Visual Sketchpad: Sketching as a Visual Chain of Thought for Multimodal Language Models13 Jun
1 more
  1. 2023MM-REACT: Prompting ChatGPT for Multimodal Reasoning and Action20 Mar

Other references · 12

  1. 2023Segment Anythingcited by 8,158
  2. 2024GPT-4o System Cardcited by 4,467
  3. 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
  4. 2023Qwen Technical Reportcited by 3,273
  5. 2024SAM 2: Segment Anything in Images and Videoscited by 2,784
  6. 2025Qwen3-VL Technical Reportcited by 2,534
  7. 2025DeepEyesV2: Toward Agentic Multimodal Modelcited by 119
  8. 2025Process Reward Models for LLM Agents: Practical Framework and Directionscited by 81
  9. 2025Agentic Reinforcement Learning with Implicit Step Rewardscited by 45
  10. 2025Zoom-Refine: Boosting High-Resolution Multimodal Understanding via Localized Zoom and Self-Refinementcited by 18
  11. 2026Future-KL Regularized GRPO: Process-Level Credit Assignment from f-Divergence Regularizationcited by 11
  12. 2025DIP-R1: Deep Inspection and Perception with RL Looking Through and Understanding Complex Scenescited by 10

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 4.

4 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026LookWise: Knowing When and Where to Look for Fine-Grained Visual Reasoning in Multimodal Large Language Models
  2. 2025Learning Only with Images: Visual Reinforcement Learning with Reasoning, Rendering, and Visual Feedback
  3. 2026Insight-V++: Towards Advanced Long-Chain Visual Reasoning with Multimodal Large Language Models
  4. 2026Distilling Visual Reasoning into Text Space
  5. 2026Thinking with Images as Continuous Actions: Numerical Visual Chain-of-Thought
  6. 2026GLaQ: Grounding Latent Queries in Visual Evidence for Multimodal Reasoning
  7. 2026See It, Say It, Sorted: An Iterative Training-Free Framework for Visually-Grounded Multimodal Reasoning in LVLMs
  8. 2025Point-RFT: Improving Multimodal Reasoning with Visually Grounded Reinforcement Finetuning