mlsanityData to 14 Oct 2026

Uni-LaDiR: Latent Diffusion Unifies Multimodal Reasoning

arXiv 2609.19878 ↗First posted 17 Sep 2026cs.LG cs.CLcited by 0

On the map: LLM reasoning → Multimodal reasoning

also in 1 more
Abstract (arXiv)

Multimodal models increasingly think with different modalities such as images, 3D point clouds, and robot states, not just text. Yet each modality is still encoded into its own representation space, creating a modality-switching gap whenever reasoning moves from one modality to another. In this paper, we introduce Uni-LaDiR (Unified Latent Diffusion Reasoner), a framework that unifies different modalities into a shared latent space for multimodal reasoning. A unified encoder maps teacher reasoning steps from different modalities into latent thought tokens in a shared space, trained to extract the information needed for later reasoning steps and the final output. A diffusion reasoner, trained jointly with the encoder, generates these tokens at inference without teacher reasoning steps. Across eleven vision-language model (VLM) benchmarks and two vision-language-action (VLA) suites, Uni-LaDiR achieves relative gains over the strongest baselines of 7.3% on four mathematical and logical VLM benchmarks and 6.1% on RLBench manipulation tasks. Controlled comparisons show increasing gains as more teacher modalities are unified. These results suggest that unification improves multimodal reasoning by weaving it into a single thread, where the model predicts successive thoughts in a common representation space.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 146 of its 151 references that are in the map. First posted on arXiv 17 Sep 2026.

Builds on

146 of 151 references.

Closest ancestors · 47

Same direction, newest first

  1. 2026Scaffolding Minds: Optimizing Latent Visual Target Representations for Multimodal Reasoning20 Aug
  2. 2026CoLT: Teaching Multi-Modal Models to Think with Chain of Latent Thoughts30 Jun
  3. 2026Visual-OPSD: Cross-Modal On-Policy Self-Distillation for Efficient Unified Multimodal Reasoning17 Jun
  4. 2026Semantic-Enriched Latent Visual Reasoning19 May
  5. 2026What's Holding Back Latent Visual Reasoning?18 May
  6. 2026LanteRn: Latent Visual Structured Reasoning26 Mar
  7. 2026Vision-aligned Latent Reasoning for Multi-modal Large Language Model4 Feb
  8. 2026Learning Modal-Mixed Chain-of-Thought Reasoning with Latent Embeddings31 Jan
  9. 2025Latent Implicit Visual Reasoning24 Dec
  10. 2025Interleaved Latent Visual Reasoning with Selective Perceptual Modeling5 Dec
  11. 2025Monet: Reasoning in Latent Visual Space Beyond Images and Language26 Nov
  12. 2025Chain-of-Visual-Thought: Teaching VLMs to See and Think Better with Continuous Visual Tokens24 Nov
35 more
  1. 2025ThinkMorph: Emergent Properties in Multimodal Interleaved Chain-of-Thought Reasoning30 Oct
  2. 2025Reasoning in the Dark: Interleaved Vision-Text Reasoning in Latent Space14 Oct
  3. 2025Latent Visual Reasoning29 Sep
  4. 2025Multimodal Chain of Continuous Thought for Latent-Space Reasoning in Vision-Language Models18 Aug
  5. 2025Uni-cot: Towards Unified Chain-of-Thought Reasoning Across Text and Vision7 Aug
  6. 2025Zebra-CoT: A Dataset for Interleaved Vision Language Reasoning22 Jul
  7. 2025Open Vision Reasoner: Transferring Linguistic Cognitive Behavior for Visual Reasoning7 Jul
  8. 2025Machine Mental Imagery: Empower Multimodal Reasoning with Latent Visual Tokens20 Jun
  9. 2025Pixel Reasoner: Incentivizing Pixel-Space Reasoning with Curiosity-Driven Reinforcement Learning21 May
  10. 2025DeepEyes: Incentivizing "Thinking with Images" via Reinforcement Learning20 May
  11. 2025VisuLogic: A Benchmark for Evaluating Visual Reasoning in Multi-modal Large Language Models21 Apr
  12. 2025VisualPuzzles: Decoupling Multimodal Reasoning Evaluation from Domain Knowledge14 Apr
  13. 2025Vision-R1: Incentivizing Reasoning Capability in Multimodal Large Language Models9 Mar
  14. 2025GFlowVLM: Enhancing Multi-step Reasoning in Vision-Language Models with Generative Flow Networks9 Mar
  15. 2025Imagine while Reasoning in Space: Multimodal Visualization-of-Thought13 Jan
  16. 2025Can MLLMs Reason in Multimodality? EMMA: An Enhanced MultiModal ReAsoning Benchmark9 Jan
  17. 2024MAmmoTH-VL: Eliciting Multimodal Reasoning with Instruction Tuning at Scale6 Dec
  18. 2024Interleaved-Modal Chain-of-Thought29 Nov
  19. 2024Insight-V: Exploring Long-Chain Visual Reasoning with Multimodal Large Language Models21 Nov
  20. 2024LLaVA-CoT: Let Vision Language Models Reason Step-by-Step15 Nov
  21. 2024Visual Sketchpad: Sketching as a Visual Chain of Thought for Multimodal Language Models13 Jun
  22. 2024Image-of-Thought Prompting for Visual Reasoning Refinement in Multimodal Large Language Models22 May
  23. 2024Measuring Multimodal Mathematical Reasoning with MATH-Vision Dataset22 Feb
  24. 2023Multi-modal Latent Space Learning for Chain-of-Thought Reasoning in Language Models14 Dec
  25. 2023Visual Program Distillation: Distilling Tools and Programmatic Reasoning into Vision-Language Models5 Dec
  26. 2023MathVista: Evaluating Mathematical Reasoning of Foundation Models in Visual Contexts3 Oct
  27. 2023Unified Language-Vision Pretraining in LLM with Dynamic Discrete Visual Tokenization9 Sep
  28. 2023Visual Chain of Thought: Bridging Logical Gaps with Multimodal Infillings3 May
  29. 2023MM-REACT: Prompting ChatGPT for Multimodal Reasoning and Action20 Mar
  30. 2023ViperGPT: Visual Inference via Python Execution for Reasoning14 Mar
  31. 2023Visual ChatGPT: Talking, Drawing and Editing with Visual Foundation Models8 Mar
  32. 2023Multimodal Chain-of-Thought Reasoning in Language Models2 Feb
  33. 2022Visual Programming: Compositional visual reasoning without training18 Nov
  34. 2022Learn to Explain: Multimodal Reasoning via Thought Chains for Science Question Answering20 Sep
  35. 2022ChartQA: A Benchmark for Question Answering about Charts with Visual and Logical Reasoning19 Mar

Other references · 99

  1. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  3. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
  4. 2022Flow Matching for Generative Modelingcited by 5,702
  5. 2025Qwen2.5-VL Technical Reportcited by 5,587
  6. 2022Flamingo: a Visual Language Model for Few-Shot Learningcited by 4,386
  7. 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 3,080
  8. 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,887
  9. 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusioncited by 2,838
  10. 2025Qwen3-VL Technical Reportcited by 2,793
  11. 2022Do As I Can, Not As I Say: Grounding Language in Robotic Affordancescited by 2,348
  12. 2023PaLM-E: An Embodied Multimodal Language Modelcited by 2,071
38 more
  1. 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,761
  2. 2019Dream to Control: Learning Behaviors by Latent Imaginationcited by 1,653
  3. 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,410
  4. 2018Learning Latent Dynamics for Planning from Pixelscited by 1,264
  5. 2023Kosmos-2: Grounding Multimodal Large Language Models to the Worldcited by 1,089
  6. 2022Inner Monologue: Embodied Reasoning through Planning with Language Modelscited by 1,081
  7. 2022STaR: Bootstrapping Reasoning With Reasoningcited by 940
  8. 2024Chameleon: Mixed-Modal Early-Fusion Foundation Modelscited by 927
  9. 2025Emerging Properties in Unified Multimodal Pretrainingcited by 897
  10. 2025Fine-Tuning Vision-Language-Action Models: Optimizing Speed and Successcited by 883
  11. 2024Cambrian-1: A Fully Open, Vision-Centric Exploration of Multimodal LLMscited by 838
  12. 2025Janus-Pro: Unified Multimodal Understanding and Generation with Data and Model Scalingcited by 812
  13. 2022A Generalist Agentcited by 808
  14. 2024Training Large Language Models to Reason in a Continuous Latent Spacecited by 797
  15. 2024Emu3: Next-Token Prediction is All You Needcited by 781
  16. 2022PaLI: A Jointly-Scaled Multilingual Language-Image Modelcited by 766
  17. 2024Show-o: One Single Transformer to Unify Multimodal Understanding and Generationcited by 752
  18. 2025Qwen2.5-Omni Technical Reportcited by 736
  19. 2024Eyes Wide Shut? Exploring the Visual Shortcomings of Multimodal LLMscited by 735
  20. 2024SpatialVLM: Endowing Vision-Language Models with Spatial Reasoning Capabilitiescited by 706
  21. 2019RLBench: The Robot Learning Benchmark & Learning Environmentcited by 689
  22. 2018Universal Transformerscited by 647
  23. 2023NExT-GPT: Any-to-Any Multimodal LLMcited by 615
  24. 2024BLINK: Multimodal Large Language Models Can See but Not Perceivecited by 550
  25. 2023Language Is Not All You Need: Aligning Perception with Language Modelscited by 543
  26. 2025SpatialVLA: Exploring Spatial Representations for Visual-Language-Action Modelcited by 519
  27. 2024Transfusion: Predict the Next Token and Diffuse Images with One Multi-Modal Modelcited by 483
  28. 2023V*: Guided Visual Search as a Core Mechanism in Multimodal LLMscited by 482
  29. 2024Janus: Decoupling Visual Encoding for Unified Multimodal Understanding and Generationcited by 457
  30. 2025CoT-VLA: Visual Chain-of-Thought Reasoning for Vision-Language-Action Modelscited by 451
  31. 2023Generative Multimodal Models are In-Context Learnerscited by 446
  32. 2024CogACT: A Foundational Vision-Language-Action Model for Synergizing Cognition and Action in Robotic Manipulationcited by 422
  33. 2022Unified-IO: A Unified Model for Vision, Language, and Multi-Modal Taskscited by 421
  34. 2025UniVLA: Learning to Act Anywhere with Task-centric Latent Actionscited by 410
  35. 2022VIMA: General Robot Manipulation with Multimodal Promptscited by 407
  36. 2025WorldVLA: Towards Autoregressive Action World Modelcited by 367
  37. 2023Vision-Language Foundation Models as Effective Robot Imitatorscited by 349
  38. 20243D-VLA: A 3D Vision-Language-Action Generative World Modelcited by 328

50 most cited of 99 All 99 (JSON)

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Reasoning Within the Mind: Dynamic Multimodal Interleaving in Latent Space
  2. 2025See, Think, Learn: A Self-Taught Multimodal Reasoner
  3. 2026UniVLR: Unifying Text and Vision in Visual Latent Reasoning for Multimodal LLMs
  4. 2026DLWM: Diverse Latent World Models for Efficient Multimodal Reasoning
  5. 2026Thinking Diffusion: Penalize and Guide Visual-Grounded Reasoning in Diffusion Multimodal Language Models
  6. 2025DiffThinker: Towards Generative Multimodal Reasoning with Diffusion Models
  7. 2026SLVR: Structured Latent Visual Reasoning via Human-like Reasoning Flows
  8. 2026Retrieve, Integrate, and Synthesize: Spatial-Semantic Grounded Latent Visual Reasoning