Seeing Together: Multi-Robot Cooperative Egocentric Spatial Reasoning with Multimodal Large Language Models
On the map: LLM reasoning → Spatial and embodied reasoning
Abstract (arXiv)
Multimodal Large Language Models (MLLMs) have made substantial progress in egocentric video understanding, but their ability to reason cooperatively from multiple embodied viewpoints remains largely unexplored. We study this problem through multi-robot cooperative dynamic spatial reasoning, where a model must answer spatial, temporal, visibility, and coordination questions by integrating synchronized egocentric videos from a team of moving robots. To support this setting, we introduce CoopSR, the first benchmark for this task, together with EgoTeam, a multi-robot egocentric QA dataset. EgoTeam contains 114,227 QA pairs spanning 19 question types, four difficulty tiers, and three team sizes in Habitat and iGibson, along with a real-world test set of around 2,326 QAs collected using two quadruped robots. We further propose SP-CoR (Spectral and Physics-Informed Cooperative Reasoner), an MLLM framework for fine-grained cooperative spatial reasoning. SP-CoR combines dynamics-aware multi-robot frame sampling, spectral- and physics-guided view fusion, and physics-aligned prompt distillation, enabling the model to benefit from privileged robot-pose supervision during training while requiring only egocentric videos at test time. Across 22 MLLM baselines, SP-CoR consistently improves cooperative reasoning, outperforming the strongest fine-tuned baseline by +3.87% on Habitat and +7.12% on iGibson. It also shows stronger generalization to unseen team sizes and real-world robot tests. Code can be found at https://github.com/KPeng9510/seeing-together.git.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Placed in Spatial and embodied reasoning, one of 17 directions in LLM reasoning. Builds on 24 of its 75 references that are in the map. First posted on arXiv 18 May 2026.
Builds on
24 of 75 references.
Closest ancestors · 2
Same direction, newest first
- 2026OmniVLN: Omnidirectional 3D Perception and Token-Efficient LLM Reasoning for Visual-Language Navigation across Air and Ground Platforms18 Mar
- 2024PARTNR: A Benchmark for Planning and Reasoning in Embodied Multi-agent Tasks31 Oct
Other references · 22
- 2025Qwen2.5-VL Technical Reportcited by 5,587
- 2025Qwen3-VL Technical Reportcited by 2,793
- 2017Decoupled Weight Decay Regularizationcited by 1,831
- 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiencycited by 1,510
- 2024Qwen2.5-Coder Technical Reportcited by 1,203
- 2025OpenAI GPT-5 System Cardcited by 989
- 2025VideoLLaMA 3: Frontier Multimodal Foundation Models for Image and Video Understandingcited by 518
- 2023Habitat 3.0: A Co-Habitat for Humans, Avatars and Robotscited by 228
- 2026Solaris: Building a Multiplayer Video World Model in Minecraftcited by 47
- 2024MM-Ego: Towards Building Egocentric Multimodal LLMs for Video QAcited by 24
- 2025EgoExoBench: A Benchmark for First- and Third-person View Video Understanding in MLLMscited by 23
- 2026MultiWorld: Scalable Multi-Agent Multi-View Video World Modelscited by 23
10 more
- 2024TeamCraft: A Benchmark for Multi-Modal Multi-Agent Systems in Minecraftcited by 21
- 2025Empowering Multi-Robot Cooperation via Sequential World Modelscited by 9
- 2023Co-NavGPT: Multi-Robot Cooperative Visual Semantic Navigation Using Vision Language Modelscited by 8
- 2025EgoMe: A New Dataset and Challenge for Following Me via Egocentric View in Real Worldcited by 8
- 2026KTV: Keyframes and Key Tokens Selection for Efficient Training-Free Video LLMscited by 6
- 2025EgoExo-Con: Exploring View-Invariant Video Temporal Understandingcited by 5
- 2026MA-EgoQA: Question Answering over Egocentric Videos from Multiple Embodied Agentscited by 5
- 2026CoMaTrack: Competitive Multi-Agent Game-Theoretic Tracking with Vision-Language-Action Modelscited by 5
- 2026DeCoNav: Dialog enhanced Long-Horizon Collaborative Vision-Language Navigationcited by 5
- 2026Can a Robot Walk the Robotic Dog: Triple-Zero Collaborative Navigation for Heterogeneous Multi-Agent Systemscited by 3
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026RoboFind: Multi-Agent Personalized Object Search for People Who Are Blind or Have Low Visioncited by 0
- 2026SpatialSkill: Self-Evolving Skills for Cross-View Spatial Reasoningcited by 0
- 2026Does Local Video Understanding Transfer Across Encounters? The EgoGears Benchmarkcited by 0
- 2026Multics: Generative Multi-Player World Model with Hierarchical Communicationcited by 0
- 2026Multics: Generative Multi-Player World Model with Hierarchical Communication12 Oct 2026
- 2026Does Local Video Understanding Transfer Across Encounters? The EgoGears Benchmark29 Sep 2026
- 2026SpatialSkill: Self-Evolving Skills for Cross-View Spatial Reasoning28 Sep 2026
- 2026RoboFind: Multi-Agent Personalized Object Search for People Who Are Blind or Have Low Vision17 Sep 2026
Similar, not cited
Close in wording, no citation either way
- 2025Multimodal Spatial Reasoning in the Large Model Era: A Survey and Benchmarks
- 2025ST-Think: How Multimodal Large Language Models Reason About 4D Worlds from Ego-Centric Videos
- 2025EgoThinker: Unveiling Egocentric Reasoning with Spatio-Temporal CoT
- 2026EgoMind: Activating Spatial Cognition through Linguistic Reasoning in MLLMs
- 2026EgoProx: Evaluating MLLMs on Egocentric 3D Proximity Reasoning Across a Cognitive Hierarchy
- 2026Multi-Turn Multi-Agent Dialogue for Collaborative Reconstruction Improves VLM Performance on Spatial Reasoning, But Only Barely
- 2025Spatial Reasoning with Vision-Language Models in Ego-Centric Multi-View Scenes
- 2026Unleashing Spatial Reasoning in Multimodal Large Language Models via Textual Representation Guided Reasoning