mlsanityData to 7 Oct 2026

HART: High-Resolution Annotation-Free Reasoning Technique through a Closed-loop Framework

arXiv 2602.23615 ↗First posted 27 Feb 2026cs.CVcited by 3

On the map: LLM reasoning → Multimodal reasoning

also in 1 more
Abstract (arXiv)

Current Large Multimodal Models (LMMs) struggle with high-resolution visual inputs during the reasoning process, as the number of image tokens increases quadratically with resolution, introducing substantial redundancy and irrelevant information. A common practice is to identify key image regions and refer to their high-resolution counterparts during reasoning, typically trained with external visual supervision. However, such visual supervision cues require costly grounding labels from human annotators. Meanwhile, it remains an open question how to enhance a model's grounding abilities to support reasoning without relying on additional annotations. In this paper, we propose High-resolution Annotation-free Reasoning Technique (HART), a closed-loop framework that enables LMMs to focus on and self-verify key regions of high-resolution visual inputs. HART incorporates a post-training paradigm in which we design Advantage Preference Group Relative Policy Optimization (AP-GRPO) to encourage accurate localization of key regions without external visual annotations. Notably, HART provides explainable reasoning pathways and enables efficient optimization of localization. Extensive experiments on MME-RealWorld-Lite, TreeBench, V* Bench, HR-Bench-4K/8K, and MMStar demonstrate that HART improves performance across a wide range of high-resolution visual tasks, consistently outperforming strong baselines.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 57 of its 63 references that are in the map. First posted on arXiv 27 Feb 2026.

Builds on

57 of 63 references.

Closest ancestors · 20

Same direction, newest first

  1. 2025Self-Rewarding Vision-Language Model via Reasoning Decomposition27 Aug
  2. 2025High-Resolution Visual Reasoning via Multi-Turn Grounding-Based Reinforcement Learning8 Jul
  3. 2025Point-RFT: Improving Multimodal Reasoning with Visually Grounded Reinforcement Finetuning26 May
  4. 2025Pixel Reasoner: Incentivizing Pixel-Space Reasoning with Curiosity-Driven Reinforcement Learning21 May
  5. 2025DeepEyes: Incentivizing "Thinking with Images" via Reinforcement Learning20 May
  6. 2025Observe-R1: Unlocking Reasoning Abilities of MLLMs with Dynamic Progressive Reinforcement Learning18 May
  7. 2025Unsupervised Visual Chain-of-Thought Reasoning via Preference Optimization25 Apr
  8. 2025VL-Rethinker: Incentivizing Self-Reflection of Vision-Language Models with Reinforcement Learning10 Apr
  9. 2025VLM-R1: A Stable and Generalizable R1-style Large Vision-Language Model10 Apr
  10. 2025Multimodal Chain-of-Thought Reasoning: A Comprehensive Survey16 Mar
  11. 2025R1-Onevision: Advancing Generalized Multimodal Reasoning through Cross-Modal Formalization13 Mar
  12. 2025LMM-R1: Empowering 3B LMMs with Strong Reasoning Abilities Through Two-Stage Rule-Based RL10 Mar
8 more
  1. 2025MM-Eureka: Exploring the Frontiers of Multimodal Reasoning with Rule-based Reinforcement Learning10 Mar
  2. 2025Visual-RFT: Visual Reinforcement Fine-Tuning3 Mar
  3. 2025LlamaV-o1: Rethinking Step-by-step Visual Reasoning in LLMs10 Jan
  4. 2024Visual Agents as Fast and Slow Thinkers16 Aug
  5. 2024TextCoT: Zoom In for Enhanced Multimodal Text-Rich Image Understanding15 Apr
  6. 2024Visual CoT: Advancing Multi-Modal Language Models with a Comprehensive Dataset and Benchmark for Chain-of-Thought Reasoning25 Mar
  7. 2024Chain-of-Spot: Interactive Reasoning Improves Large Vision-Language Models19 Mar
  8. 2023MathVista: Evaluating Mathematical Reasoning of Foundation Models in Visual Contexts3 Oct

Other references · 37

  1. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
  2. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,146
  3. 2025Qwen2.5-VL Technical Reportcited by 5,418
  4. 2024GPT-4o System Cardcited by 4,467
  5. 2023Improved Baselines with Visual Instruction Tuningcited by 4,362
  6. 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,151
  7. 2024Gemini 1.5: Unlocking multimodal understanding across millions of tokens of contextcited by 3,175
  8. 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,669
  9. 2025InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Modelscited by 1,769
  10. 2024MiniCPM-V: A GPT-4V Level MLLM on Your Phonecited by 1,061
  11. 2024Are We on the Right Way for Evaluating Large Vision-Language Models?cited by 893
  12. 2024DeepSeek-VL2: Mixture-of-Experts Vision-Language Models for Advanced Multimodal Understandingcited by 559
25 more
  1. 2024BLINK: Multimodal Large Language Models Can See but Not Perceivecited by 529
  2. 2023V*: Guided Visual Search as a Core Mechanism in Multimodal LLMscited by 459
  3. 2023Monkey: Image Resolution and Text Label Are Important Things for Large Multi-modal Modelscited by 356
  4. 2025R1-VL: Learning to Reason with Multimodal Large Language Models via Step-wise Group Relative Policy Optimizationcited by 296
  5. 2024mPLUG-Owl3: Towards Long Image-Sequence Understanding in Multi-Modal Large Language Modelscited by 285
  6. 2024MME-RealWorld: Could Your Multimodal LLM Challenge High-Resolution Real-World Scenarios that are Difficult for Humans?cited by 284
  7. 2024mPLUG-DocOwl 1.5: Unified Structure Learning for OCR-free Document Understandingcited by 220
  8. 2024MANTIS: Interleaved Multi-Image Instruction Tuningcited by 212
  9. 2024LLaVA-UHD: an LMM Perceiving Any Aspect Ratio and High-Resolution Imagescited by 193
  10. 2023LLaVA-Plus: Learning to Use Tools for Creating Multimodal Agentscited by 188
  11. 2024TextMonkey: An OCR-Free Large Multimodal Model for Understanding Documentcited by 173
  12. 2024Oryx MLLM: On-Demand Spatial-Temporal Understanding at Arbitrary Resolutioncited by 157
  13. 2024InternLM-XComposer2-4KHD: A Pioneering Large Vision-Language Model Handling Resolutions from 336 Pixels to 4K HDcited by 156
  14. 2024Divide, Conquer and Combine: A Training-Free Framework for High-Resolution Image Perception in Multimodal Large Language Modelscited by 151
  15. 2024Beyond LLaVA-HD: Diving into High-Resolution Large Multimodal Modelscited by 75
  16. 2025Vision-R1: Evolving Human-Free Alignment in Large Vision-Language Models via Vision-Guided Reinforcement Learningcited by 68
  17. 2025Traceable Evidence Enhanced Visual Grounded Reasoning: Evaluation and Methodologycited by 67
  18. 2024Explainable and Interpretable Multimodal Large Language Models: A Comprehensive Surveycited by 52
  19. 2024HRVDA: High-Resolution Visual Document Assistantcited by 37
  20. 2024Griffon v2: Advancing Multimodal Perception with High-Resolution Scaling and Visual-Language Co-Referringcited by 29
  21. 2025Beyond Two-Stage Training: Cooperative SFT and RL for LLM Reasoningcited by 28
  22. 2025FALCON: Resolving Visual Redundancy and Fragmentation in High-resolution Multimodal Large Language Models via Visual Registerscited by 20
  23. 2024HiRes-LLaVA: Restoring Fragmentation Input in High-Resolution Large Vision-Language Modelscited by 16
  24. 2022YOLO-FaceV2: A Scale and Occlusion Aware Face Detectorcited by 15
  25. 2022A Guide to Image and Video based Small Object Detection using Deep Learning : Case Study of Maritime Surveillancecited by 14

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 3.

3 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026CASHEW: Stabilizing Multimodal Reasoning via Iterative Trajectory Aggregation
  2. 2025v1: Learning to Point Visual Tokens for Multimodal Grounded Reasoning
  3. 2026See It, Say It, Sorted: An Iterative Training-Free Framework for Visually-Grounded Multimodal Reasoning in LVLMs
  4. 2026LookWise: Knowing When and Where to Look for Fine-Grained Visual Reasoning in Multimodal Large Language Models
  5. 2026VisionPulse: Dynamic Visual Sparsity for Efficient Multimodal Reasoning
  6. 2025No Labels, No Problem: Training Visual Reasoners with Multimodal Verifiers
  7. 2025VLM-R3: Region Recognition, Reasoning, and Refinement for Enhanced Multimodal Chain-of-Thought
  8. 2024Plug-and-Play Grounding of Reasoning in Multimodal Large Language Models