Uni-LaDiR: Latent Diffusion Unifies Multimodal Reasoning
On the map: LLM reasoning → Multimodal reasoning
also in 1 more
Abstract (arXiv)
Multimodal models increasingly think with different modalities such as images, 3D point clouds, and robot states, not just text. Yet each modality is still encoded into its own representation space, creating a modality-switching gap whenever reasoning moves from one modality to another. In this paper, we introduce Uni-LaDiR (Unified Latent Diffusion Reasoner), a framework that unifies different modalities into a shared latent space for multimodal reasoning. A unified encoder maps teacher reasoning steps from different modalities into latent thought tokens in a shared space, trained to extract the information needed for later reasoning steps and the final output. A diffusion reasoner, trained jointly with the encoder, generates these tokens at inference without teacher reasoning steps. Across eleven vision-language model (VLM) benchmarks and two vision-language-action (VLA) suites, Uni-LaDiR achieves relative gains over the strongest baselines of 7.3% on four mathematical and logical VLM benchmarks and 6.1% on RLBench manipulation tasks. Controlled comparisons show increasing gains as more teacher modalities are unified. These results suggest that unification improves multimodal reasoning by weaving it into a single thread, where the model predicts successive thoughts in a common representation space.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 146 of its 151 references that are in the map. First posted on arXiv 17 Sep 2026.
Builds on
146 of 151 references.
Closest ancestors · 47
Same direction, newest first
- 2026Scaffolding Minds: Optimizing Latent Visual Target Representations for Multimodal Reasoning20 Aug
- 2026CoLT: Teaching Multi-Modal Models to Think with Chain of Latent Thoughts30 Jun
- 2026Visual-OPSD: Cross-Modal On-Policy Self-Distillation for Efficient Unified Multimodal Reasoning17 Jun
- 2026Semantic-Enriched Latent Visual Reasoning19 May
- 2026What's Holding Back Latent Visual Reasoning?18 May
- 2026LanteRn: Latent Visual Structured Reasoning26 Mar
- 2026Vision-aligned Latent Reasoning for Multi-modal Large Language Model4 Feb
- 2026Learning Modal-Mixed Chain-of-Thought Reasoning with Latent Embeddings31 Jan
- 2025Latent Implicit Visual Reasoning24 Dec
- 2025Interleaved Latent Visual Reasoning with Selective Perceptual Modeling5 Dec
- 2025Monet: Reasoning in Latent Visual Space Beyond Images and Language26 Nov
- 2025Chain-of-Visual-Thought: Teaching VLMs to See and Think Better with Continuous Visual Tokens24 Nov
35 more
- 2025ThinkMorph: Emergent Properties in Multimodal Interleaved Chain-of-Thought Reasoning30 Oct
- 2025Reasoning in the Dark: Interleaved Vision-Text Reasoning in Latent Space14 Oct
- 2025Latent Visual Reasoning29 Sep
- 2025Multimodal Chain of Continuous Thought for Latent-Space Reasoning in Vision-Language Models18 Aug
- 2025Uni-cot: Towards Unified Chain-of-Thought Reasoning Across Text and Vision7 Aug
- 2025Zebra-CoT: A Dataset for Interleaved Vision Language Reasoning22 Jul
- 2025Open Vision Reasoner: Transferring Linguistic Cognitive Behavior for Visual Reasoning7 Jul
- 2025Machine Mental Imagery: Empower Multimodal Reasoning with Latent Visual Tokens20 Jun
- 2025Pixel Reasoner: Incentivizing Pixel-Space Reasoning with Curiosity-Driven Reinforcement Learning21 May
- 2025DeepEyes: Incentivizing "Thinking with Images" via Reinforcement Learning20 May
- 2025VisuLogic: A Benchmark for Evaluating Visual Reasoning in Multi-modal Large Language Models21 Apr
- 2025VisualPuzzles: Decoupling Multimodal Reasoning Evaluation from Domain Knowledge14 Apr
- 2025Vision-R1: Incentivizing Reasoning Capability in Multimodal Large Language Models9 Mar
- 2025GFlowVLM: Enhancing Multi-step Reasoning in Vision-Language Models with Generative Flow Networks9 Mar
- 2025Imagine while Reasoning in Space: Multimodal Visualization-of-Thought13 Jan
- 2025Can MLLMs Reason in Multimodality? EMMA: An Enhanced MultiModal ReAsoning Benchmark9 Jan
- 2024MAmmoTH-VL: Eliciting Multimodal Reasoning with Instruction Tuning at Scale6 Dec
- 2024Interleaved-Modal Chain-of-Thought29 Nov
- 2024Insight-V: Exploring Long-Chain Visual Reasoning with Multimodal Large Language Models21 Nov
- 2024LLaVA-CoT: Let Vision Language Models Reason Step-by-Step15 Nov
- 2024Visual Sketchpad: Sketching as a Visual Chain of Thought for Multimodal Language Models13 Jun
- 2024Image-of-Thought Prompting for Visual Reasoning Refinement in Multimodal Large Language Models22 May
- 2024Measuring Multimodal Mathematical Reasoning with MATH-Vision Dataset22 Feb
- 2023Multi-modal Latent Space Learning for Chain-of-Thought Reasoning in Language Models14 Dec
- 2023Visual Program Distillation: Distilling Tools and Programmatic Reasoning into Vision-Language Models5 Dec
- 2023MathVista: Evaluating Mathematical Reasoning of Foundation Models in Visual Contexts3 Oct
- 2023Unified Language-Vision Pretraining in LLM with Dynamic Discrete Visual Tokenization9 Sep
- 2023Visual Chain of Thought: Bridging Logical Gaps with Multimodal Infillings3 May
- 2023MM-REACT: Prompting ChatGPT for Multimodal Reasoning and Action20 Mar
- 2023ViperGPT: Visual Inference via Python Execution for Reasoning14 Mar
- 2023Visual ChatGPT: Talking, Drawing and Editing with Visual Foundation Models8 Mar
- 2023Multimodal Chain-of-Thought Reasoning in Language Models2 Feb
- 2022Visual Programming: Compositional visual reasoning without training18 Nov
- 2022Learn to Explain: Multimodal Reasoning via Thought Chains for Science Question Answering20 Sep
- 2022ChartQA: A Benchmark for Question Answering about Charts with Visual and Logical Reasoning19 Mar
Other references · 99
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
- 2022Flow Matching for Generative Modelingcited by 5,702
- 2025Qwen2.5-VL Technical Reportcited by 5,587
- 2022Flamingo: a Visual Language Model for Few-Shot Learningcited by 4,386
- 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 3,080
- 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,887
- 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusioncited by 2,838
- 2025Qwen3-VL Technical Reportcited by 2,793
- 2022Do As I Can, Not As I Say: Grounding Language in Robotic Affordancescited by 2,348
- 2023PaLM-E: An Embodied Multimodal Language Modelcited by 2,071
38 more
- 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,761
- 2019Dream to Control: Learning Behaviors by Latent Imaginationcited by 1,653
- 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,410
- 2018Learning Latent Dynamics for Planning from Pixelscited by 1,264
- 2023Kosmos-2: Grounding Multimodal Large Language Models to the Worldcited by 1,089
- 2022Inner Monologue: Embodied Reasoning through Planning with Language Modelscited by 1,081
- 2022STaR: Bootstrapping Reasoning With Reasoningcited by 940
- 2024Chameleon: Mixed-Modal Early-Fusion Foundation Modelscited by 927
- 2025Emerging Properties in Unified Multimodal Pretrainingcited by 897
- 2025Fine-Tuning Vision-Language-Action Models: Optimizing Speed and Successcited by 883
- 2024Cambrian-1: A Fully Open, Vision-Centric Exploration of Multimodal LLMscited by 838
- 2025Janus-Pro: Unified Multimodal Understanding and Generation with Data and Model Scalingcited by 812
- 2022A Generalist Agentcited by 808
- 2024Training Large Language Models to Reason in a Continuous Latent Spacecited by 797
- 2024Emu3: Next-Token Prediction is All You Needcited by 781
- 2022PaLI: A Jointly-Scaled Multilingual Language-Image Modelcited by 766
- 2024Show-o: One Single Transformer to Unify Multimodal Understanding and Generationcited by 752
- 2025Qwen2.5-Omni Technical Reportcited by 736
- 2024Eyes Wide Shut? Exploring the Visual Shortcomings of Multimodal LLMscited by 735
- 2024SpatialVLM: Endowing Vision-Language Models with Spatial Reasoning Capabilitiescited by 706
- 2019RLBench: The Robot Learning Benchmark & Learning Environmentcited by 689
- 2018Universal Transformerscited by 647
- 2023NExT-GPT: Any-to-Any Multimodal LLMcited by 615
- 2024BLINK: Multimodal Large Language Models Can See but Not Perceivecited by 550
- 2023Language Is Not All You Need: Aligning Perception with Language Modelscited by 543
- 2025SpatialVLA: Exploring Spatial Representations for Visual-Language-Action Modelcited by 519
- 2024Transfusion: Predict the Next Token and Diffuse Images with One Multi-Modal Modelcited by 483
- 2023V*: Guided Visual Search as a Core Mechanism in Multimodal LLMscited by 482
- 2024Janus: Decoupling Visual Encoding for Unified Multimodal Understanding and Generationcited by 457
- 2025CoT-VLA: Visual Chain-of-Thought Reasoning for Vision-Language-Action Modelscited by 451
- 2023Generative Multimodal Models are In-Context Learnerscited by 446
- 2024CogACT: A Foundational Vision-Language-Action Model for Synergizing Cognition and Action in Robotic Manipulationcited by 422
- 2022Unified-IO: A Unified Model for Vision, Language, and Multi-Modal Taskscited by 421
- 2025UniVLA: Learning to Act Anywhere with Task-centric Latent Actionscited by 410
- 2022VIMA: General Robot Manipulation with Multimodal Promptscited by 407
- 2025WorldVLA: Towards Autoregressive Action World Modelcited by 367
- 2023Vision-Language Foundation Models as Effective Robot Imitatorscited by 349
- 20243D-VLA: A 3D Vision-Language-Action Generative World Modelcited by 328
50 most cited of 99 All 99 (JSON)
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Reasoning Within the Mind: Dynamic Multimodal Interleaving in Latent Space
- 2025See, Think, Learn: A Self-Taught Multimodal Reasoner
- 2026UniVLR: Unifying Text and Vision in Visual Latent Reasoning for Multimodal LLMs
- 2026DLWM: Diverse Latent World Models for Efficient Multimodal Reasoning
- 2026Thinking Diffusion: Penalize and Guide Visual-Grounded Reasoning in Diffusion Multimodal Language Models
- 2025DiffThinker: Towards Generative Multimodal Reasoning with Diffusion Models
- 2026SLVR: Structured Latent Visual Reasoning via Human-like Reasoning Flows
- 2026Retrieve, Integrate, and Synthesize: Spatial-Semantic Grounded Latent Visual Reasoning