mlsanityData to 7 Oct 2026

Semantic-Enriched Latent Visual Reasoning

arXiv 2605.19342 ↗First posted 19 May 2026cs.CVcited by 3

On the map: LLM reasoning → Multimodal reasoning

Abstract (arXiv)

Multimodal latent-space reasoning aims to replace explicit thinking with images by performing visual reasoning directly in a compact latent space. However, existing approaches largely rely on visual supervision and produce latent representations that lack sufficient semantic richness, limiting their ability to support diverse region-level reasoning tasks. In this work, we introduce Semantic-Enriched Latent Visual Reasoning (SLVR), a two-stage learning framework that enriches latent representations with attribute-level visual semantics and aligns them with diverse reasoning objectives. In the first stage, SLVR learns semantically enriched region-centric latents under fine-grained attribute supervision. In the second stage, we design Multi-query Group Relative Policy Optimization (M-GRPO) to align latent representations across multiple queries grounded in the same region. To support this framework, we construct SLV-Set, comprising approximately 400K region-level attribute annotations and 800K multi-query question answering samples, and introduce SV-QA, a benchmark that evaluates latent reasoning under semantic variation. Experiments demonstrate that SLVR improves the robustness and semantic consistency of latent visual reasoning compared to existing baselines.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 32 of its 46 references that are in the map. First posted on arXiv 19 May 2026.

Builds on

32 of 46 references.

Closest ancestors · 16

Same direction, newest first

  1. 2025Reasoning Within the Mind: Dynamic Multimodal Interleaving in Latent Space14 Dec
  2. 2025Monet: Reasoning in Latent Visual Space Beyond Images and Language26 Nov
  3. 2025Latent Sketchpad: Sketching Visual Thoughts to Elicit Multimodal Reasoning in MLLMs28 Oct
  4. 2025Latent Visual Reasoning29 Sep
  5. 2025DeFacto: Counterfactual Thinking with Images for Enforcing Evidence-Grounded and Faithful Reasoning25 Sep
  6. 2025Self-Rewarding Vision-Language Model via Reasoning Decomposition27 Aug
  7. 2025Machine Mental Imagery: Empower Multimodal Reasoning with Latent Visual Tokens20 Jun
  8. 2025Pixel Reasoner: Incentivizing Pixel-Space Reasoning with Curiosity-Driven Reinforcement Learning21 May
  9. 2025GRIT: Teaching MLLMs to Think with Images21 May
  10. 2025Adaptive Chain-of-Focus Reasoning via Dynamic Visual Search and Zooming for Efficient VLMs21 May
  11. 2025DeepEyes: Incentivizing "Thinking with Images" via Reinforcement Learning20 May
  12. 2025VisionReasoner: Unified Reasoning-Integrated Visual Perception via Reinforcement Learning17 May
4 more
  1. 2025VisualPuzzles: Decoupling Multimodal Reasoning Evaluation from Domain Knowledge14 Apr
  2. 2025Visual-RFT: Visual Reinforcement Fine-Tuning3 Mar
  3. 2024CogCoM: A Visual Language Model with Chain-of-Manipulations Reasoning6 Feb
  4. 2022ChartQA: A Benchmark for Question Answering about Charts with Visual and Logical Reasoning19 Mar

Other references · 16

  1. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,146
  2. 2025Qwen2.5-VL Technical Reportcited by 5,418
  3. 2023Qwen Technical Reportcited by 3,273
  4. 2023MiniGPT-4: Enhancing Vision-Language Understanding with Advanced Large Language Modelscited by 2,689
  5. 2025Qwen3-VL Technical Reportcited by 2,534
  6. 2025Qwen3 Embedding: Advancing Text Embedding and Reranking Through Foundation Modelscited by 1,175
  7. 2023Kosmos-2: Grounding Multimodal Large Language Models to the Worldcited by 1,075
  8. 2023Gemini: A Family of Highly Capable Multimodal Modelscited by 810
  9. 2024Training Large Language Models to Reason in a Continuous Latent Spacecited by 763
  10. 2025MLLMs Know Where to Look: Training-free Perception of Small Visual Details with Multimodal LLMscited by 172
  11. 2025SIM-CoT: Supervised Implicit Chain-of-Thoughtcited by 63
  12. 2025Inner Thinking Transformer: Leveraging Dynamic Depth Scaling to Foster Adaptive Internal Thinkingcited by 56
4 more
  1. 2025LLM Latent Reasoning as Chain of Superpositioncited by 37
  2. 2025System-1.5 Reasoning: Traversal in Language and Latent Spaces with Dynamic Shortcutscited by 23
  3. 2025Mull-Tokens: Modality-Agnostic Latent Thinkingcited by 15
  4. 2026Act Wisely: Cultivating Meta-Cognitive Tool Use in Agentic Multimodal Modelscited by 13

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 3.

3 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026SLVR: Structured Latent Visual Reasoning via Human-like Reasoning Flows
  2. 2026Visual Latents Know More Than They Say: Unsilencing Latent Reasoning in MLLMs
  3. 2026Retrieve, Integrate, and Synthesize: Spatial-Semantic Grounded Latent Visual Reasoning
  4. 2026Decompose, Look, and Reason: Reinforced Latent Reasoning for VLMs
  5. 2026DeepLatent: Think with Images via Parallel Latent Visual Reasoning
  6. 2026Vision-aligned Latent Reasoning for Multi-modal Large Language Model
  7. 2026MoLE: Mixture of Latent Experts for Complementary Visual Reasoning
  8. 2026CoLVR: Enhancing Exploratory Latent Visual Reasoning via Contrastive Optimization