mlsanityData to 7 Oct 2026

Zooming without Zooming: Region-to-Image Distillation for Fine-Grained Multimodal Perception

arXiv 2602.11858 ↗First posted 12 Feb 2026cs.CV cs.AI cs.CLcited by 47

On the map: Multimodal LLMs / vision-language models → MLLM training and visual instruction tuning

Abstract (arXiv)

Multimodal Large Language Models (MLLMs) excel at broad visual understanding but still struggle with fine-grained perception, where decisive evidence is small and easily overwhelmed by global context. Recent "Thinking-with-Images" methods alleviate this by iteratively zooming in and out regions of interest during inference, but incur high latency due to repeated tool calls and visual re-encoding. To address this, we propose Region-to-Image Distillation, which transforms zooming from an inference-time tool into a training-time primitive, thereby internalizing the benefits of agentic zooming into a single forward pass of an MLLM. In particular, we first zoom in to micro-cropped regions to let strong teacher models generate high-quality VQA data, and then distill this region-grounded supervision back to the full image. After training on such data, the smaller student model improves "single-glance" fine-grained perception without tool use. To rigorously evaluate this capability, we further present ZoomBench, a hybrid-annotated benchmark of 845 VQA data spanning six fine-grained perceptual dimensions, together with a dual-view protocol that quantifies the global--regional "zooming gap". Experiments show that our models achieve leading performance across multiple fine-grained perception benchmarks, and also improve general multimodal cognition on benchmarks such as visual reasoning and GUI agents. We further discuss when "Thinking-with-Images" is necessary versus when its gains can be distilled into a single forward pass. Our code is available at https://github.com/inclusionAI/Zooming-without-Zooming.

Key facts. Cited by 47 papers in the map (data through 7 Oct 2026). Placed in MLLM training and visual instruction tuning, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 115 of its 125 references that are in the map. First posted on arXiv 12 Feb 2026.

Builds on

115 of 125 references.

Closest ancestors · 18

Same direction, newest first

  1. 2026BabyVision: Visual Reasoning Beyond Language10 Jan
  2. 2025Xiaomi MiMo-VL-Miloco Technical Report19 Dec
  3. 2025Qwen3-VL Technical Report26 Nov
  4. 2025Grasp Any Region: Towards Precise, Contextual Pixel Understanding for Multimodal LLMs21 Oct
  5. 2025HiDe: Rethinking The Zoom-IN method in High Resolution MLLMs via Hierarchical Decoupling28 Sep
  6. 2025MiniCPM-V 4.5: Cooking Efficient MLLMs via Architecture, Data, and Training Recipe16 Sep
  7. 2025Zoom-Refine: Boosting High-Resolution Multimodal Understanding via Localized Zoom and Self-Refinement2 Jun
  8. 2025Evaluating and Steering Modality Preferences in Multimodal Large Language Model27 May
  9. 2025Oasis: One Image is All You Need for Multimodal Instruction Data Synthesis11 Mar
  10. 2025MLLMs Know Where to Look: Training-free Perception of Small Visual Details with Multimodal LLMs24 Feb
  11. 2024ChatRex: Taming Multimodal LLM for Joint Perception and Understanding27 Nov
  12. 2024ZoomEye: Enhancing Multimodal LLMs with Human-Like Zooming Capabilities through Tree-Based Image Exploration25 Nov
6 more
  1. 2024MMEvol: Empowering Multimodal Large Language Models with Evol-Instruct9 Sep
  2. 2024Divide, Conquer and Combine: A Training-Free Framework for High-Resolution Image Perception in Multimodal Large Language Models28 Aug
  3. 2024MME-RealWorld: Could Your Multimodal LLM Challenge High-Resolution Real-World Scenarios that are Difficult for Humans?23 Aug
  4. 2024Cambrian-1: A Fully Open, Vision-Centric Exploration of Multimodal LLMs24 Jun
  5. 2024TextCoT: Zoom In for Enhanced Multimodal Text-Rich Image Understanding15 Apr
  6. 2023Genixer: Empowering Multimodal Large Language Models as a Powerful Data Generator11 Dec

Other references · 97

  1. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
  2. 2025Qwen3 Technical Reportcited by 8,195
  3. 2023Segment Anythingcited by 8,158
  4. 2025Qwen2.5-VL Technical Reportcited by 5,418
  5. 2024GPT-4o System Cardcited by 4,467
  6. 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,131
  7. 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
  8. 2025DAPO: An Open-Source LLM Reinforcement Learning System at Scalecited by 2,678
  9. 2016Visual Genome: Connecting Language and Vision Using Crowdsourced Dense Image Annotationscited by 2,646
  10. 2023MMMU: A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for Expert AGIcited by 2,044
  11. 2021Conceptual 12M: Pushing Web-Scale Image-Text Pre-Training To Recognize Long-Tail Visual Conceptscited by 1,209
  12. 2024Are We on the Right Way for Evaluating Large Vision-Language Models?cited by 893
38 more
  1. 2025Emerging Properties in Unified Multimodal Pretrainingcited by 855
  2. 2025SAM 3: Segment Anything with Conceptscited by 835
  3. 2023V*: Guided Visual Search as a Core Mechanism in Multimodal LLMscited by 459
  4. 2026Kimi K2.5: Visual Agentic Intelligencecited by 449
  5. 2025CoT-VLA: Visual Chain-of-Thought Reasoning for Vision-Language-Action Modelscited by 440
  6. 2025GLM-4.5V and GLM-4.1V-Thinking: Towards Versatile Multimodal Reasoning with Scalable Reinforcement Learningcited by 439
  7. 2025DeepEyes: Incentivizing "Thinking with Images" via Reinforcement Learningcited by 398
  8. 2025Pixel Reasoner: Incentivizing Pixel-Space Reasoning with Curiosity-Driven Reinforcement Learningcited by 267
  9. 2024Visual Sketchpad: Sketching as a Visual Chain of Thought for Multimodal Language Modelscited by 260
  10. 2025ScreenSpot-Pro: GUI Grounding for Professional High-Resolution Computer Usecited by 246
  11. 2025Video models are zero-shot learners and reasonerscited by 208
  12. 2025Thyme: Think Beyond Imagescited by 160
  13. 2025Scaling Computer-Use Grounding via User Interface Decomposition and Synthesiscited by 132
  14. 2025Reinforcing Spatial Reasoning in Vision-Language Models with Interwoven Thinking and Visual Drawingcited by 130
  15. 2025Machine Mental Imagery: Empower Multimodal Reasoning with Latent Visual Tokenscited by 120
  16. 2025MMSearch-R1: Incentivizing LMMs to Searchcited by 120
  17. 2025DeepEyesV2: Toward Agentic Multimodal Modelcited by 119
  18. 2025Mini-o3: Scaling Up Reasoning Patterns and Interaction Turns for Visual Searchcited by 116
  19. 2026Learning to Discover at Test Timecited by 94
  20. 2025ReFocus: Visual Editing as a Chain of Thought for Structured Image Understandingcited by 81
  21. 2025Zebra-CoT: A Dataset for Interleaved Vision Language Reasoningcited by 78
  22. 2025Monet: Reasoning in Latent Visual Space Beyond Images and Languagecited by 75
  23. 2025VGR: Visual Grounded Reasoningcited by 70
  24. 2025Traceable Evidence Enhanced Visual Grounded Reasoning: Evaluation and Methodologycited by 67
  25. 2025Spot the Fake: Large Multimodal Model-Based Synthetic Image Detection with Artifact Explanationcited by 66
  26. 2024Chain-of-Spot: Interactive Reasoning Improves Large Vision-Language Modelscited by 65
  27. 2024Image-of-Thought Prompting for Visual Reasoning Refinement in Multimodal Large Language Modelscited by 64
  28. 2024KAM-CoT: Knowledge Augmented Multimodal Chain-of-Thoughts Reasoningcited by 60
  29. 2025Meta CLIP 2: A Worldwide Scaling Recipecited by 59
  30. 2025Look-Back: Implicit Visual Re-focusing in MLLM Reasoningcited by 54
  31. 2022STPLS3D: A Large-Scale Synthetic and Real Aerial Photogrammetry 3D Point Cloud Datasetcited by 52
  32. 2024LOKI: A Comprehensive Synthetic Data Detection Benchmark using Large Multimodal Modelscited by 51
  33. 2025Seeing but Not Believing: Probing the Disconnect Between Visual Attention and Answer Correctness in VLMscited by 48
  34. 2025VLM-R3: Region Recognition, Reasoning, and Refinement for Enhanced Multimodal Chain-of-Thoughtcited by 47
  35. 2025Advancing Multimodal Reasoning via Reinforcement Learning with Cold Startcited by 41
  36. 2025Reinforced Visual Perception with Toolscited by 38
  37. 2024Diff-eRank: A Novel Rank-Based Metric for Evaluating Large Language Modelscited by 35
  38. 2025SenseNova-MARS: Empowering Multimodal Agentic Reasoning and Search via Reinforcement Learningcited by 31

50 most cited of 97 All 97 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 47.

47 papers.

Sort:

By area:

  1. 2026Vision-OPD: Learning to See Fine Details for Multimodal LLMs via On-Policy Self-Distillationcited by 71
  2. 2026Visual-OPSD: Cross-Modal On-Policy Self-Distillation for Efficient Unified Multimodal Reasoningcited by 15
  3. 2026V-Zero: Answer-Label-Free On-Policy Distillation with Contrastive Evidence Gating for Fine-Grained Visual Reasoningcited by 10
  4. 2026Learn where to Click from Yourself: On-Policy Self-Distillation for GUI Groundingcited by 9
  5. 2026OPD-V: Visual On-Policy Self-Distillation with Modality Balancecited by 7
  6. 2026RP-OPSD: Resolution-Privileged On-Policy Self-Distillation for Multimodal Large Language Modelscited by 6
  7. 2026Self-Supervised Visual On-Policy Distillationcited by 6
  8. 2026Q-Zoom: Query-Aware Adaptive Perception for Efficient Multimodal Large Language Modelscited by 5
  9. 2026S1-VL: Scientific Multimodal Reasoning Model with Thinking-with-Imagescited by 5
  10. 2026VAD: Attributing Visual Evidence for Target Reconstruction in Multimodal On-Policy Distillationcited by 5
  11. 2026Agentic-MME: What Agentic Capability Really Brings to Multimodal Intelligence?cited by 4
  12. 2026MuSEAgent: A Multimodal Reasoning Agent with Stateful Experiencescited by 3
35 more
  1. 2026Perceive-to-Reason: Decoupling Perception and Reasoning for Fine-Grained Visual Reasoningcited by 3
  2. 2026Mitigating Multimodal Hallucination via Phase-wise Self-rewardcited by 2
  3. 2026Sandboxed Coding Agents are Competitive Omni-modal Task Solverscited by 2
  4. 2026PixelEyes: Decoupling Perception and Reasoning for Pinpoint Visual Evidence Seekingcited by 2
  5. 2026Veritas++: Value-aware On-Policy Distillation for Perception-Enhanced AIGI Detectioncited by 2
  6. 2026LUT: Latent Utility Training for Visual Reasoningcited by 2
  7. 2026The Illusion of Visual Tool-Use: A Causal Audit of Thinking with Imagescited by 2
  8. 2026Thinking With Tools, Not With Pixels: Tool Calls as Text Scaffolds for Visual Reasoningcited by 2
  9. 2026Think with Structured Grounding: Perceptual Reinforcement Learning for Chart and Visual-Tabular Understandingcited by 2
  10. 2026Test-time Scaling over Perception: Resolving the Grounding Paradox in Thinking with Imagescited by 1
  11. 2026AutoFocus: Uncertainty-Aware Active Visual Search for GUI Groundingcited by 1
  12. 2026Maestro: Reinforcement Learning to Orchestrate Hierarchical Model-Skill Ensemblescited by 1
  13. 2026Beyond Zooming: Learning Multi-Tool Visual Reasoning for Ultra-High-Resolution Remote Sensingcited by 1
  14. 2026Thinking Once Is Enough: Intermediate-Layer Evidence Routing for High-Resolution VQAcited by 1
  15. 2026LOCUS: Local Visual Cue Search for Enhancing Fine-Grained Perception in Multimodal Large Language Modelscited by 0
  16. 2026Beyond Scene Priors: Fine-Grained Traffic Scene Reasoning with Benchmarking and Query-Guided Small-Object Focuscited by 0
  17. 2026BUS: Brain-Inspired Unsupervised Self-Reflection via Backward Prediction for Multimodal Reasoningcited by 0
  18. 2026Zero-MELO: Test-Time Evidence Calibration with Multimodal LLMs for Zero-Shot Micro-Gesture Recognitioncited by 0
  19. 2026OPD-Aha: From Linguistic Momentum to Visual Reflection in Multimodal On-Policy Distillationcited by 0
  20. 2026Region-Level Policy Optimization for Fine-grained MLLM Perceptioncited by 0
  21. 2026What Should We Ask Next? Retrieval-Aware Question Learning for Interactive ReIDcited by 0
  22. 2026Pay More Attention To Text In High-Resolution MLLMscited by 0
  23. 2026BAS-OPD: Budget-Aware Selective On-Policy Self-Distillation for Fine-Grained Multimodal Perceptioncited by 0
  24. 2026DriveHierarchy: A Benchmark for Diagnosing VLM Driving Capabilities from Open-Loop Understanding to Closed-Loop Executioncited by 0
  25. 2026Progressive-View On-Policy Distillation for Regional-to-Global Transfer in Multimodal LLMscited by 0
  26. 2026Fewer Tokens, More Self-Teaching: On-Policy Self-Distillation for Extreme Visual Token Reductioncited by 0
  27. 2026Resolving State-Representation Mismatch: State-Space Visual Reasoning for Open-Loop VLA Planningcited by 0
  28. 2026Evidence-Aligned Multimodal On-Policy Self-Distillation for Fine-Grained Visual Understandingcited by 0
  29. 2026Visual Parallel Search: Learning to Search High-Resolution Images with Parallel Tile Inspection and Adaptive Zoomcited by 0
  30. 2026EviViT: Evidence-Adaptive Vision Transformers for Fine-Grained Perceptioncited by 0
  31. 2026VISTA: Internalizing Collective Visual Experience via On-Policy Distillation for Active Multimodal Agentscited by 0
  32. 2026Distill the Visual Evidence, Not Just the Answer: Cross-World On-Policy Distillation for Vision-Language Modelscited by 0
  33. 2026Is Better Teacher Supervision Enough? Unlocking Student-side Learning in Multimodal On-Policy Distillationcited by 0
  34. 2026Where-OPD: Spatially Guided On-Policy Self-Distillation of MLLMs with Synthetic Scenescited by 0
  35. 2026VICO: Visual Environments Co-Evolving for Vision-Language Model Reasoningcited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2025Visual Funnel: Resolving Contextual Blindness in Multimodal Large Language Models
  2. 2025Catching the Details: Self-Distilled RoI Predictors for Fine-Grained MLLM Perception
  3. 2025Zoomer: Adaptive Image Focus Optimization for Black-box MLLM
  4. 2025Perceiving Beyond Language Priors: Enhancing Visual Comprehension and Attention in Multimodal Models
  5. 2026Seeing or Knowing? Visual Context Sensitivity in Multimodal Large Language Models
  6. 2026DiCoBench: Benchmarking Multi-Image Fine-Grained Perception via Differential and Commonality Visual Cues
  7. 2026LookWise: Knowing When and Where to Look for Fine-Grained Visual Reasoning in Multimodal Large Language Models
  8. 2025CropVLM: Learning to Zoom for Fine-Grained Vision-Language Perception