mlsanityData to 7 Oct 2026

LUT: Latent Utility Training for Visual Reasoning

arXiv 2608.00743 ↗First posted 1 Aug 2026cs.CVcited by 2

On the map: LLM reasoning → Multimodal reasoning

also in 1 more
Abstract (arXiv)

Multimodal large language models have advanced visual understanding, yet perception-intensive reasoning remains challenging. Recent latent visual reasoning methods introduce hidden-space computation before answering, but they often rely on costly intermediate supervision, such as bounding boxes, sketches, or interleaved rationales. These strategies focus on how latent states should be shaped, but do not explicitly assess whether the latent is useful for the final answer. We propose LUT, a latent reasoning framework trained with only standard VQA pairs. LUT centers training on Latent Utility at two levels. At the trajectory level, we propose Utility-Aware Latent Distillation SFT, which explores answer-relevant latent trajectories, selects qualified trajectories by their information gain, and distills more reliable and learnable supervision through curriculum learning. At the step level, we propose Latent Attribution Policy Optimization, which uses answer-to-latent attribution to differentially optimize latent steps during reinforcement learning. Experiments on perception-intensive visual reasoning benchmarks show that LUT outperforms previous latent reasoning methods and remains competitive with latent-text interleaved methods with lower annotation cost.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 38 of its 51 references that are in the map. First posted on arXiv 1 Aug 2026.

Builds on

38 of 51 references.

Closest ancestors · 26

Same direction, newest first

  1. 2026ProLaViT: Learning Progressive Latent Visual Thoughts in Structured Latent Space3 Jul
  2. 2026Multimodal Continuous Reasoning via Asymmetric Mutual Variational Learning1 Jul
  3. 2026Fill the GAP: A Granular Alignment Paradigm for Visual Reasoning in Multimodal Large Language Models12 May
  4. 2026Self-Consistent Latent Reasoning: Long Latent Sequence Reasoning for Vision-Language Model12 May
  5. 2026UniVLR: Unifying Text and Vision in Visual Latent Reasoning for Multimodal LLMs12 May
  6. 2026HyLaR: Hybrid Latent Reasoning with Decoupled Policy Optimization22 Apr
  7. 2026Multimodal Latent Reasoning via Predictive Embeddings9 Apr
  8. 2026Vision-aligned Latent Reasoning for Multi-modal Large Language Model4 Feb
  9. 2026Forest Before Trees: Latent Superposition for Efficient Visual Reasoning11 Jan
  10. 2025Latent Implicit Visual Reasoning24 Dec
  11. 2025Sketch-in-Latents: Eliciting Unified Reasoning in MLLMs18 Dec
  12. 2025Monet: Reasoning in Latent Visual Space Beyond Images and Language26 Nov
14 more
  1. 2025Reasoning in the Dark: Interleaved Vision-Text Reasoning in Latent Space14 Oct
  2. 2025Latent Visual Reasoning29 Sep
  3. 2025Multimodal Chain of Continuous Thought for Latent-Space Reasoning in Vision-Language Models18 Aug
  4. 2025Thyme: Think Beyond Images15 Aug
  5. 2025GLM-4.5V and GLM-4.1V-Thinking: Towards Versatile Multimodal Reasoning with Scalable Reinforcement Learning1 Jul
  6. 2025Machine Mental Imagery: Empower Multimodal Reasoning with Latent Visual Tokens20 Jun
  7. 2025Evidence-Grounded Trustworthy Multimodal Reasoning and Evaluation Benchmark in Complex Urban Scenes11 Jun
  8. 2025Thinking with Generated Images28 May
  9. 2025Advancing Multimodal Reasoning via Reinforcement Learning with Cold Start28 May
  10. 2025Pixel Reasoner: Incentivizing Pixel-Space Reasoning with Curiosity-Driven Reinforcement Learning21 May
  11. 2025DeepEyes: Incentivizing "Thinking with Images" via Reinforcement Learning20 May
  12. 2025VisualPuzzles: Decoupling Multimodal Reasoning Evaluation from Domain Knowledge14 Apr
  13. 2025Vision-R1: Incentivizing Reasoning Capability in Multimodal Large Language Models9 Mar
  14. 2023Multimodal Chain-of-Thought Reasoning in Language Models2 Feb

Other references · 12

  1. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
  2. 2025Qwen2.5-VL Technical Reportcited by 5,418
  3. 2024GPT-4o System Cardcited by 4,467
  4. 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
  5. 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,669
  6. 2025InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Modelscited by 1,769
  7. 2024Training Large Language Models to Reason in a Continuous Latent Spacecited by 763
  8. 2025Visual Planning: Let's Think Only with Imagescited by 85
  9. 2026Zooming without Zooming: Region-to-Image Distillation for Fine-Grained Multimodal Perceptioncited by 47
  10. 2026LaViT: Aligning Latent Visual Thoughts for Multi-modal Reasoningcited by 13
  11. 2026From Chatbot to Digital Colleague: The Paradigm Shift Toward Persistent Autonomous AIcited by 6
  12. 2025Guiding the Inner Eye: A Framework for Hierarchical and Flexible Visual Grounded Reasoningcited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Leveraging Latent Visual Reasoning in Silence
  2. 2026SLVR: Structured Latent Visual Reasoning via Human-like Reasoning Flows
  3. 2026Scaffolding Minds: Optimizing Latent Visual Target Representations for Multimodal Reasoning
  4. 2026Visual Latents Know More Than They Say: Unsilencing Latent Reasoning in MLLMs
  5. 2026DeepLatent: Think with Images via Parallel Latent Visual Reasoning
  6. 2026GLaQ: Grounding Latent Queries in Visual Evidence for Multimodal Reasoning
  7. 2026LanteRn: Latent Visual Structured Reasoning
  8. 2026Semantic-Enriched Latent Visual Reasoning