mlsanityData to 7 Oct 2026

Latent Noise Mask for Reducing Visual Redundancy in Multimodal Large Language Models

arXiv 2606.30168 ↗First posted 29 Jun 2026cs.CVcited by 0

On the map: LLM reasoning → Multimodal reasoning

also in 1 more
Abstract (arXiv)

Multimodal large language models (MLLMs) often fail in fine-grained visual reasoning, as question-relevant visual cues are diluted by dense and redundant image tokens. Recent multimodal reasoning methods usually extend chain-of-thought from language models into visual or latent spaces, seeking to add intermediate reasoning states while overlooking the negative impact of redundant visual tokens. We propose LatEnt Noise maSk (Lens), a question-conditioned visual evidence purification framework that empowers MLLMs to reason with cleaner visual cues in latent space. Lens introduces a lightweight Lens Evidence Token (LET) to score which visual tokens support the current question and preserve them during decoding. Guided by the LET scores, it injects adaptive latent noise into low-relevance tokens, softly suppressing distractors without changing the model backbone or token sequence. With only one temporary learnable control token and a lightweight noise generator, Lens adds minimal overhead while improving the base MLLM by 2.4-6.4 points on most VQA datasets and by 4.1-6.4 points on grounding tasks. These results show that multimodal reasoning can benefit more directly from cleaner question-relevant visual evidence than from simply extending the reasoning trace.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 41 of its 47 references that are in the map. First posted on arXiv 29 Jun 2026.

Builds on

41 of 47 references.

Closest ancestors · 22

Same direction, newest first

  1. 2025Reasoning Within the Mind: Dynamic Multimodal Interleaving in Latent Space14 Dec
  2. 2025Chain-of-Visual-Thought: Teaching VLMs to See and Think Better with Continuous Visual Tokens24 Nov
  3. 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiency25 Aug
  4. 2025Perception-Aware Policy Optimization for Multimodal Reasoning8 Jul
  5. 2025Machine Mental Imagery: Empower Multimodal Reasoning with Latent Visual Tokens20 Jun
  6. 2025MINT-CoT: Enabling Interleaved Visual Tokens in Mathematical Chain-of-Thought Reasoning5 Jun
  7. 2025Pixel Reasoner: Incentivizing Pixel-Space Reasoning with Curiosity-Driven Reinforcement Learning21 May
  8. 2025GRIT: Teaching MLLMs to Think with Images21 May
  9. 2025DeepEyes: Incentivizing "Thinking with Images" via Reinforcement Learning20 May
  10. 2025OpenThinkIMG: Learning to Think with Images via Visual Tool Reinforcement Learning13 May
  11. 2025VLM-R1: A Stable and Generalizable R1-style Large Vision-Language Model10 Apr
  12. 2025Vision-R1: Incentivizing Reasoning Capability in Multimodal Large Language Models9 Mar
10 more
  1. 2025Visual-RFT: Visual Reinforcement Fine-Tuning3 Mar
  2. 2025Imagine while Reasoning in Space: Multimodal Visualization-of-Thought13 Jan
  3. 2025ReFocus: Visual Editing as a Chain of Thought for Structured Image Understanding9 Jan
  4. 2024Perception Tokens Enhance Visual Reasoning in Multimodal Language Models4 Dec
  5. 2024Interleaved-Modal Chain-of-Thought29 Nov
  6. 2024Visual Sketchpad: Sketching as a Visual Chain of Thought for Multimodal Language Models13 Jun
  7. 2024Visual CoT: Advancing Multi-Modal Language Models with a Comprehensive Dataset and Benchmark for Chain-of-Thought Reasoning25 Mar
  8. 2024KAM-CoT: Knowledge Augmented Multimodal Chain-of-Thoughts Reasoning23 Jan
  9. 2023Compositional Chain-of-Thought Prompting for Large Multimodal Models27 Nov
  10. 2023Multimodal Chain-of-Thought Reasoning in Language Models2 Feb

Other references · 19

  1. 2014Microsoft COCO: Common Objects in Contextcited by 17,498
  2. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
  3. 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,669
  4. 2025Qwen3-VL Technical Reportcited by 2,534
  5. 2024Training Large Language Models to Reason in a Continuous Latent Spacecited by 763
  6. 2024MathVerse: Does Your Multi-modal LLM Truly See the Diagrams in Visual Math Problems?cited by 573
  7. 2022Visual Spatial Reasoningcited by 288
  8. 2020Detection and Tracking Meet Drones Challengecited by 261
  9. 2021ICDAR2019 Competition on Scanned Receipt OCR and Information Extractioncited by 254
  10. 2025PyVision: Agentic Vision with Dynamic Toolingcited by 71
  11. 2024Scaffolding Coordinates to Promote Vision-Language Coordination in Large Multi-Modal Modelscited by 56
  12. 2025Seek in the Dark: Reasoning via Test-Time Instance-Level Policy Gradient in Latent Spacecited by 40
7 more
  1. 2023Variational Positive-incentive Noise: How Noise Benefits Modelscited by 38
  2. 2025VisMem: Latent Vision Memory Unlocks Potential of Vision-Language Modelscited by 31
  3. 2025Introducing Visual Perception Token into Multimodal Large Language Modelcited by 26
  4. 2025Mixture of Noise for Pre-Trained Model-Based Class-Incremental Learningcited by 14
  5. 2025Explore How to Inject Beneficial Noise in MLLMscited by 10
  6. 2025Rectified Noise: A Generative Model Using Positive-incentive Noisecited by 7
  7. 2025Multimodal Continual Learning with MLLMs from Multi-scenario Perspectivescited by 4

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Look Where It Counts: A Free, Label-Free Visual Evidence Signal for Fine-Grained Vision-Language Reasoning
  2. 2026Decompose, Look, and Reason: Reinforced Latent Reasoning for VLMs
  3. 2026Rethinking Latent Visual Reasoning: Grounding Latent Reasoning in Visual Evidence
  4. 2026SLVR: Structured Latent Visual Reasoning via Human-like Reasoning Flows
  5. 2025LENS: Multi-level Evaluation of Multimodal Reasoning with Large Language Models
  6. 2025Latent Visual Reasoning
  7. 2026Visual Latents Know More Than They Say: Unsilencing Latent Reasoning in MLLMs
  8. 2026Fill the GAP: A Granular Alignment Paradigm for Visual Reasoning in Multimodal Large Language Models