COOPER: A Unified Model for Cooperative Perception and Reasoning in Spatial Intelligence
On the map: LLM reasoning → Spatial and embodied reasoning
Abstract (arXiv)
Visual Spatial Reasoning is crucial for enabling Multimodal Large Language Models (MLLMs) to understand object properties and spatial relationships, yet current models still struggle with 3D-aware reasoning. Existing approaches typically enhance either perception, by augmenting RGB inputs with auxiliary modalities such as depth and segmentation, or reasoning, by training on spatial VQA datasets and applying reinforcement learning, and thus treat these two aspects in isolation. In this work, we investigate whether a unified MLLM can develop an intrinsic ability to enhance spatial perception and, through adaptive interleaved reasoning, achieve stronger spatial intelligence. We propose COOPER, a unified MLLM that leverages depth and segmentation as auxiliary modalities and is trained in two stages to acquire auxiliary modality generation and adaptive, interleaved reasoning capabilities. COOPER achieves an average 6.91% improvement in spatial reasoning while maintaining general performance. Moreover, even a variant trained only for auxiliary modality generation attains a 7.92% gain on distance and size estimation, suggesting that learning to generate auxiliary modalities helps internalize spatial knowledge and strengthen spatial understanding.
Key facts. Cited by 9 papers in the map (data through 7 Oct 2026). Placed in Spatial and embodied reasoning, one of 17 directions in LLM reasoning. Builds on 64 of its 95 references that are in the map. First posted on arXiv 4 Dec 2025.
Builds on
64 of 95 references.
Closest ancestors · 11
Same direction, newest first
- 2025How Far are VLMs from Visual Spatial Intelligence? A Benchmark-Driven Perspective23 Sep
- 2025M2-Reasoning: Empowering MLLMs with Unified General and Spatial Reasoning11 Jul
- 2025Reinforcing Spatial Reasoning in Vision-Language Models with Interwoven Thinking and Visual Drawing11 Jun
- 2025RoboRefer: Towards Spatial Referring with Reasoning in Vision-Language Models for Robotics4 Jun
- 2025SVQA-R1: Reinforcing Spatial Reasoning in MLLMs via View-Consistent Reward Optimization2 Jun
- 2025SSR: Enhancing Depth Perception in Vision-Language Models via Rationale-Guided Spatial Reasoning18 May
- 2025SpatialReasoner: Towards Explicit and Generalizable 3D Spatial Reasoning28 Apr
- 2025SpaceR: Reinforcing MLLMs in Video Spatial Reasoning2 Apr
- 2025Improved Visual-Spatial Reasoning via R1-Zero-Like Training1 Apr
- 2025SpatialCoT: Advancing Spatial Reasoning through Coordinate Alignment and Chain-of-Thought for Embodied Task Planning17 Jan
- 2024Reasoning Paths with Reference Objects Elicit Quantitative Spatial Reasoning in Large Vision-Language Models15 Sep
Other references · 53
- 2022Flow Matching for Generative Modelingcited by 5,426
- 2025Qwen2.5-VL Technical Reportcited by 5,418
- 2024GPT-4o System Cardcited by 4,467
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
- 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,550
- 2022RT-1: Robotics Transformer for Real-World Control at Scalecited by 2,007
- 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiencycited by 1,419
- 2023MM-Vet: Evaluating Large Multimodal Models for Integrated Capabilitiescited by 1,221
- 2025SigLIP 2: Multilingual Vision-Language Encoders with Improved Semantic Understanding, Localization, and Dense Featurescited by 1,127
- 2025Qwen-Image Technical Reportcited by 973
- 2022Building Normalizing Flows with Stochastic Interpolantscited by 964
- 2024Chameleon: Mixed-Modal Early-Fusion Foundation Modelscited by 904
38 more
- 2025Emerging Properties in Unified Multimodal Pretrainingcited by 855
- 2025Janus-Pro: Unified Multimodal Understanding and Generation with Data and Model Scalingcited by 787
- 2024Emu3: Next-Token Prediction is All You Needcited by 761
- 2024Show-o: One Single Transformer to Unify Multimodal Understanding and Generationcited by 734
- 2024DeepSeek-V3 Technical Reportcited by 724
- 2025Flow-GRPO: Training Flow Matching Models via Online RLcited by 605
- 2024DriveVLM: The Convergence of Autonomous Driving and Large Vision-Language Modelscited by 482
- 2025DeepEyes: Incentivizing "Thinking with Images" via Reinforcement Learningcited by 398
- 2025Seed1.5-VL Technical Reportcited by 367
- 2020Virtual KITTI 2cited by 345
- 2024VILA-U: a Unified Foundation Model Integrating Visual Understanding and Generationcited by 290
- 2025Pixel Reasoner: Incentivizing Pixel-Space Reasoning with Curiosity-Driven Reinforcement Learningcited by 267
- 2025VideoChat-R1: Enhancing Spatio-Temporal Perception via Reinforcement Fine-Tuningcited by 248
- 2025Spatial-MLLM: Boosting MLLM Capabilities in Visual-based Spatial Intelligencecited by 206
- 2025Imagine while Reasoning in Space: Multimodal Visualization-of-Thoughtcited by 204
- 2025Thinking with Images for Multimodal Reasoning: Foundations, Methods, and Future Frontierscited by 193
- 2025Multimodal Chain-of-Thought Reasoning: A Comprehensive Surveycited by 176
- 2025Thyme: Think Beyond Imagescited by 160
- 2025VLM-3R: Vision-Language Models Augmented with Instruction-Aligned 3D Reconstructioncited by 154
- 2025Machine Mental Imagery: Empower Multimodal Reasoning with Latent Visual Tokenscited by 120
- 2024ANOLE: An Open, Autoregressive, Native Large Multimodal Models for Interleaved Image-Text Generationcited by 112
- 2024SAT: Dynamic Spatial Aptitude Training for Multimodal Language Modelscited by 111
- 2025Learning from Videos for 3D World: Enhancing MLLMs with 3D Vision Geometry Priorscited by 111
- 2025TempFlow-GRPO: When Timing Matters for GRPO in Flow Modelscited by 93
- 2025Pref-GRPO: Pairwise Preference Reward-based GRPO for Stable Text-to-Image Reinforcement Learningcited by 88
- 2025Unified Multimodal Understanding and Generation Models: Advances, Challenges, and Opportunitiescited by 81
- 2025Zebra-CoT: A Dataset for Interleaved Vision Language Reasoningcited by 78
- 2025STI-Bench: Are MLLMs Ready for Precise Spatial-Temporal World Understanding?cited by 74
- 2025RewardDance: Reward Scaling in Visual Generationcited by 63
- 2024Liquid: Language Models are Scalable and Unified Multi-modal Generatorscited by 62
- 2025ThinkMorph: Emergent Properties in Multimodal Interleaved Chain-of-Thought Reasoningcited by 55
- 2025Reinforced Visual Perception with Toolscited by 38
- 2025DICEPTION: A Generalist Diffusion Model for Visual Perceptual Taskscited by 37
- 2025MathCanvas: Intrinsic Visual Chain-of-Thought for Multimodal Mathematical Reasoningcited by 35
- 2025MindOmni: Unleashing Reasoning Generation in Vision Language Models with RGPOcited by 30
- 2025Mind with Eyes: from Language Reasoning to Multimodal Reasoningcited by 22
- 2025AR-GRPO: Training Autoregressive Image Generation Models via Reinforcement Learningcited by 22
- 2024LATTE: Learning to Think with Vision Specialistscited by 13
50 most cited of 53 All 53 (JSON)
Built on by
Citing papers per year: 2026: 9.
9 papers.
- 2026Zooming without Zooming: Region-to-Image Distillation for Fine-Grained Multimodal Perceptioncited by 47
- 2026ExpSeek: Self-Triggered Experience Seeking for Web Agentscited by 23
- 2026PASs-MoE: Mitigating Misaligned Co-drift among Router and Experts via Pathway Activation Subspaces for Continual Learningcited by 4
- 2026Thinking with Imagination: Agentic Visual Spatial Reasoning with World Simulatorscited by 4
- 2026Bridging Interleaved Multi-Modal Reasoning as a Unified Decision Processcited by 4
- 2026TwiFF (Think With Future Frames): A Large-Scale Dataset for Dynamic Visual Reasoningcited by 3
- 2026Sparse Growing Transformer: Training-Time Sparse Depth Allocation via Progressive Attention Loopingcited by 3
- 2026Advances in GRPO for Generation Models: A Surveycited by 1
- 2026CLEAR: Unlocking Generative Potential for Degraded Image Understanding in Unified Multimodal Modelscited by 1
- 2026Bridging Interleaved Multi-Modal Reasoning as a Unified Decision Process4 Jul 2026
- 2026Thinking with Imagination: Agentic Visual Spatial Reasoning with World Simulators4 Jun 2026
- 2026CLEAR: Unlocking Generative Potential for Degraded Image Understanding in Unified Multimodal Models6 Apr 2026
- 2026Sparse Growing Transformer: Training-Time Sparse Depth Allocation via Progressive Attention Looping25 Mar 2026
- 2026Advances in GRPO for Generation Models: A Survey21 Feb 2026
- 2026Zooming without Zooming: Region-to-Image Distillation for Fine-Grained Multimodal Perception12 Feb 2026
- 2026TwiFF (Think With Future Frames): A Large-Scale Dataset for Dynamic Visual Reasoning11 Feb 2026
- 2026PASs-MoE: Mitigating Misaligned Co-drift among Router and Experts via Pathway Activation Subspaces for Continual Learning19 Jan 2026
- 2026ExpSeek: Self-Triggered Experience Seeking for Web Agents13 Jan 2026
Similar, not cited
Close in wording, no citation either way
- 2025Scaling and Beyond: Advancing Spatial Reasoning in MLLMs Requires New Recipes
- 2025Spatial Reasoning in Multimodal Large Language Models: A Survey of Tasks, Benchmarks and Methods
- 2025Multimodal Spatial Reasoning in the Large Model Era: A Survey and Benchmarks
- 2024SpatialRGPT: Grounded Spatial Reasoning in Vision Language Models
- 2025Imagine in Space: Exploring the Frontier of Spatial Intelligence and Reasoning Efficiency in Vision Language Models
- 2024Is A Picture Worth A Thousand Words? Delving Into Spatial Reasoning for Vision Language Models
- 2025SpatialThinker: Reinforcing Scene Graph-Grounded Spatial Reasoning via Dense Rewards
- 2026EgoMind: Activating Spatial Cognition through Linguistic Reasoning in MLLMs