CrossView Suite: Harnessing Cross-view Spatial Intelligence of MLLMs with Dataset, Model and Benchmark
On the map: Multimodal LLMs / vision-language models → Embodied and 3D vision-language models
Abstract (arXiv)
Spatial intelligence requires multimodal large language models (MLLMs) to move beyond single-view perception and reason consistently about objects, visibility, geometry, and interactions across multiple viewpoints. However, progress in cross-view reasoning remains limited by three major gaps: the scarcity of large-scale well-annotated training data, the lack of comprehensive benchmarks for systematic evaluation, and the absence of explicit alignment mechanisms that establish object-level consistency across views. To address these gaps, we thoroughly develop CrossView Suite across three coordinated components: CrossViewSet, CrossViewBench, and CrossViewer. Firstly, we introduce a multi-agent data engine to meticulously curate a large-scale, high-quality cross-view instruction dataset, termed CrossViewSet, covering 17 fine-grained task types with 1.6M samples. Second, we meticulously create a scene-disjoint CrossViewBench to comprehensively assess the cross-view spatial understanding capability of an MLLM, evaluating it across various aspects. Finally, we propose CrossViewer, a progressive three-stage framework for cross-view spatial reasoning in MLLMs, following a Perception -> Alignment -> Reasoning paradigm. Our method equips an adaptive spatial region tokenizer to capture fine-grained object representations, and then aligns the multi-view objects explicitly, and thus fuses aligned features for boosting the cross-view inference capacity for MLLMs. Extensive experiments and analyses show that large-scale training data, systematic evaluation, and explicit cross-view alignment are all critical for advancing MLLMs from single-view perception toward real-world spatial intelligence. The project page is available at https://github.com/Thinkirin/Crossview-Suite.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Embodied and 3D vision-language models, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 28 of its 48 references that are in the map. First posted on arXiv 18 May 2026.
Builds on
28 of 48 references.
Closest ancestors · 4
Same direction, newest first
- 2025Learning from Videos for 3D World: Enhancing MLLMs with 3D Vision Geometry Priors30 May
- 2025MLLM-For3D: Adapting Multimodal Large Language Model for 3D Reasoning Segmentation23 Mar
- 2025MM-Spatial: Exploring 3D Spatial Understanding in Multimodal LLMs17 Mar
- 2024SpatialVLM: Endowing Vision-Language Models with Spatial Reasoning Capabilities22 Jan
Other references · 24
- 2023InstructBLIP: Towards General-purpose Vision-Language Models with Instruction Tuningcited by 2,855
- 2023InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Taskscited by 2,534
- 2019SuperGlue: Learning Feature Matching with Graph Neural Networkscited by 1,437
- 2021LoFTR: Detector-Free Local Feature Matching with Transformerscited by 974
- 2024Eyes Wide Shut? Exploring the Visual Shortcomings of Multimodal LLMscited by 719
- 2023Ferret: Refer and Ground Anything Anywhere at Any Granularitycited by 498
- 2023Ego-Exo4D: Understanding Skilled Human Activity from First- and Third-Person Perspectivescited by 477
- 2023GLaMM: Pixel Grounding Large Multimodal Modelcited by 447
- 2023Osprey: Pixel Understanding with Visual Instruction Tuningcited by 158
- 2025HealthGPT: A Medical Large Vision-Language Model for Unifying Comprehension and Generation via Heterogeneous Knowledge Adaptationcited by 112
- 2024VideoRefer Suite: Advancing Spatial-Temporal Object Understanding with Video LLMcited by 71
- 2023EgoHumans: An Egocentric 3D Multi-Human Benchmarkcited by 58
12 more
- 2022BoostMIS: Boosting Medical Image Semi-supervised Learning with Adaptive Pseudo Labeling and Informative Active Annotationcited by 54
- 2024Multi-modal Instruction Tuned LLMs with Fine-grained Visual Perceptioncited by 39
- 2021MMPTRACK: Large-scale Densely Annotated Multi-camera Multiple People Tracking Benchmarkcited by 28
- 2024ObjectRelator: Enabling Cross-View Object Relation Understanding Across Ego-Centric and Exo-Centric Perspectivescited by 26
- 2025PixelRefer: A Unified Framework for Spatio-Temporal Object Referring with Arbitrary Granularitycited by 21
- 2023Learning in Imperfect Environment: Multi-Label Classification with Long-Tailed Distribution and Partial Labelscited by 17
- 2025Are They the Same? Exploring Visual Correspondence Shortcomings of Multimodal LLMscited by 16
- 2020MessyTable: Instance Association in Multiple Camera Viewscited by 13
- 2025IDMR: Towards Instance-Driven Precise Visual Correspondence in Multimodal Retrievalcited by 8
- 2025Advancing 3D Scene Understanding with MV-ScanQA Multi-View Reasoning Evaluation and TripAlign Pre-training Datasetcited by 8
- 2026LMMs Meet Object-Centric Vision: Understanding, Segmentation, Editing and Generationcited by 6
- 2025VICI: VLM-Instructed Cross-view Image-localisationcited by 3
Built on by
Citing papers per year: 2026: 1.
1 paper.
- 2026InstructSAM: Segment Any Instance with Any Instructionscited by 6
- 2026InstructSAM: Segment Any Instance with Any Instructions25 May 2026
Similar, not cited
Close in wording, no citation either way
- 2026CVSBench: A Comprehensive Benchmark for Cross-view Spatial Reasoning and Dreaming
- 2025SpatialMosaic: A Multiview VLM Dataset for Partial Visibility
- 2025InternSpatial: A Comprehensive Dataset for Spatial Reasoning in Vision-Language Models
- 2025Reasoning Path and Latent State Analysis for Multi-view Visual Spatial Reasoning: A Cognitive Science Perspective
- 2026From Correspondence to Actions: Human-Like Multi-Image Spatial Reasoning in Multi-modal Large Language Models
- 2025MMSI-Bench: A Benchmark for Multi-Image Spatial Intelligence
- 2025Seeing from Another Perspective: Evaluating Multi-View Understanding in MLLMs
- 2025Scaling and Beyond: Advancing Spatial Reasoning in MLLMs Requires New Recipes