Towards Cross-View Point Correspondence in Vision-Language Models
On the map: Multimodal LLMs / vision-language models → Embodied and 3D vision-language models
Abstract (arXiv)
Cross-view correspondence is a fundamental capability for spatial understanding and embodied AI. However, it is still far from being realized in Vision-Language Models (VLMs), especially in achieving precise point-level correspondence, which is crucial for precise affordance interaction. So we propose the Cross-View Point Correspondence (CVPC) task and CrossPoint-Bench, a comprehensive benchmark with hierarchical design, inspired by the human cognitive process of "perceive", "reason", and "correspond". Our evaluation shows the state-of-the-art models (e.g., Gemini-2.5-Pro) still fall far behind humans, with a gap of over 54.65% in overall accuracy, exposing a challenge in transitioning from coarse-grained judgement to fine-grained coordinate prediction. To address this problem, we construct CrossPoint-378K, a dataset with 378K question-answering pairs across 900 scenes, focused on actionable affordance regions that better reflect real-world manipulation and interaction scenarios. Furthermore, we propose CroPond that trained on the CrossPoint-378K dataset. Our CroPond achieves state-of-the-art performance on CrossPoint-Bench, surpassing Gemini-2.5-Pro by 39.7% accuracy, which offers a foundation for advancing future work on cross-view correspondence. The benchmark, dataset, and model are publicly available at https://github.com/WangYipu2002/CrossPoint.
Key facts. Cited by 12 papers in the map (data through 7 Oct 2026). Placed in Embodied and 3D vision-language models, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 76 of its 95 references that are in the map. First posted on arXiv 4 Dec 2025.
Builds on
76 of 95 references.
Closest ancestors · 17
Same direction, newest first
- 2025Why Do MLLMs Struggle with Spatial Understanding? A Systematic Analysis from Data to Architecture2 Sep
- 2025VisualTrans: A Benchmark for Real-World Visual Transformation Reasoning6 Aug
- 2025R-VLM: Region-Aware Vision Language Model for Precise GUI Grounding8 Jul
- 2025RoboBrain 2.0 Technical Report2 Jul
- 2025RoboRefer: Towards Spatial Referring with Reasoning in Vision-Language Models for Robotics4 Jun
- 2025MMSI-Bench: A Benchmark for Multi-Image Spatial Intelligence29 May
- 2025Robo2VLM: Visual Question Answering from Large-Scale In-the-Wild Robot Manipulation Datasets21 May
- 2025From Flatland to Space: Teaching Vision-Language Models to Perceive and Reason in 3D29 Mar
- 2025CoT-VLA: Visual Chain-of-Thought Reasoning for Vision-Language-Action Models27 Mar
- 2025Reason-RFT: Reinforcement Fine-Tuning for Visual Reasoning of Vision Language Models26 Mar
- 2025RoboBrain: A Unified Brain Model for Robotic Manipulation from Abstract to Concrete28 Feb
- 2024Thinking in Space: How Multimodal Large Language Models See, Remember, and Recall Spaces18 Dec
5 more
- 2024SPHERE: Unveiling Spatial Blind Spots in Vision-Language Models Through Hierarchical Evaluation17 Dec
- 2024SAT: Dynamic Spatial Aptitude Training for Multimodal Language Models10 Dec
- 2024RoboPoint: A Vision-Language Model for Spatial Affordance Prediction for Robotics15 Jun
- 2024SpatialVLM: Endowing Vision-Language Models with Spatial Reasoning Capabilities22 Jan
- 2023ManipLLM: Embodied Multimodal Large Language Model for Object-Centric Robotic Manipulation24 Dec
Other references · 59
- 2025Qwen3 Technical Reportcited by 8,195
- 2025Qwen2.5-VL Technical Reportcited by 5,418
- 2023Improved Baselines with Visual Instruction Tuningcited by 4,362
- 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,274
- 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,088
- 2024SAM 2: Segment Anything in Images and Videoscited by 2,784
- 2023MMBench: Is Your Multi-modal Model an All-around Player?cited by 2,105
- 2023MMMU: A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for Expert AGIcited by 2,044
- 2022Learn to Explain: Multimodal Reasoning via Thought Chains for Science Question Answeringcited by 1,881
- 2019Towards VQA Models That Can Readcited by 1,696
- 2023Evaluating Object Hallucination in Large Vision-Language Modelscited by 1,696
- 2023MME: A Comprehensive Evaluation Benchmark for Multimodal Large Language Modelscited by 1,624
38 more
- 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,526
- 2025VGGT: Visual Geometry Grounded Transformercited by 1,475
- 2019OK-VQA: A Visual Question Answering Benchmark Requiring External Knowledgecited by 1,114
- 2024Are We on the Right Way for Evaluating Large Vision-Language Models?cited by 893
- 2024Cambrian-1: A Fully Open, Vision-Centric Exploration of Multimodal LLMscited by 822
- 2016A Diagram Is Worth A Dozen Imagescited by 793
- 2023ScanNet++: A High-Fidelity Dataset of 3D Indoor Scenescited by 747
- 2024BLINK: Multimodal Large Language Models Can See but Not Perceivecited by 529
- 2024MMMU-Pro: A More Robust Multi-discipline Multimodal Understanding Benchmarkcited by 494
- 2023Ego-Exo4D: Understanding Skilled Human Activity from First- and Third-Person Perspectivescited by 477
- 2021ARKitScenes: A Diverse Real-World Dataset For 3D Indoor Scene Understanding Using Mobile RGB-D Datacited by 442
- 2024Molmo and PixMo: Open Weights and Open Data for State-of-the-Art Vision-Language Modelscited by 321
- 2025LLaVA-OneVision-1.5: Fully Open Framework for Democratized Multimodal Trainingcited by 233
- 2020University-1652: A Multi-view Multi-source Benchmark for Drone-based Geo-localizationcited by 152
- 2024Scaling Proprioceptive-Visual Learning with Heterogeneous Pre-trained Transformerscited by 145
- 2025MUSt3R: Multi-view Network for Stereo 3D Reconstructioncited by 139
- 20244Diffusion: Multi-view Video Diffusion Model for 4D Generationcited by 104
- 2025MEt3R: Measuring Multi-View Consistency in Generated Imagescited by 91
- 2025Your Large Vision-Language Model Only Needs A Few Attention Heads For Visual Groundingcited by 78
- 2024Large Spatial Model: End-to-end Unposed Images to Semantic 3Dcited by 73
- 2024GROUNDHOG: Grounding Large Language Models to Holistic Segmentationcited by 70
- 2023BenchLMM: Benchmarking Cross-style Visual Capability of Large Multimodal Modelscited by 41
- 2024MC-Bench: A Benchmark for Multi-Context Visual Grounding in the Era of MLLMscited by 38
- 2025Towards a Unified Understanding of Robot Manipulation: A Comprehensive Surveycited by 32
- 2024MVInpainter: Learning Multi-View Consistent Inpainting to Bridge 2D and 3D Editingcited by 30
- 2024Cross-View Completion Models are Zero-shot Correspondence Estimatorscited by 30
- 2025Digital Twin Catalog: A Large-Scale Photorealistic 3D Object Digital Twin Datasetcited by 29
- 2025RoboOS: A Hierarchical Embodied Framework for Cross-Embodiment and Multi-Agent Collaborationcited by 28
- 2024Multi-Sensor Object Anomaly Detection: Unifying Appearance, Geometry, and Internal Propertiescited by 26
- 2025Geolocation with Real Human Gameplay Data: A Large-Scale Dataset and Human-Like Reasoning Frameworkcited by 23
- 2024Hazards in Daily Life? Enabling Robots to Proactively Detect and Resolve Anomaliescited by 19
- 2023Improved Visual Grounding through Self-Consistent Explanationscited by 17
- 2024Real-Time Simulated Avatar from Head-Mounted Sensorscited by 17
- 2025EgoSim: An Egocentric Multi-view Simulator and Real Dataset for Body-worn Cameras during Motion and Activitycited by 15
- 2025REWIND: Real-Time Egocentric Whole-Body Motion Diffusion with Exemplar-Based Identity Conditioningcited by 14
- 2023Rapid Motor Adaptation for Robotic Manipulator Armscited by 13
- 2025CoopTrack: Exploring End-to-End Learning for Efficient Cooperative Sequential Perceptioncited by 12
- 2025FaceBench: A Multi-View Multi-Level Facial Attribute VQA Dataset for Benchmarking Face Perception MLLMscited by 11
50 most cited of 59 All 59 (JSON)
Built on by
Citing papers per year: 2025: 2; 2026: 10.
12 papers.
- 2025Towards Spatial Trace with Reasoning in Vision-Language Models for Roboticscited by 12
- 2026Wall-OSS-0.5 Technical Reportcited by 11
- 2025Scaling Up AI-Generated Image Detection with Generator-Aware Prototypescited by 8
- 2026PRM-as-a-Judge: A Dense Evaluation Paradigm for Fine-Grained Robotic Auditingcited by 8
- 2026Mage-VL: An Efficient Codec-Native Streaming Multimodal Foundation Modelcited by 8
- 2026Vesta: A Generalist Embodied Reasoning Modelcited by 5
- 2026Action-Sketcher: From Reasoning to Action via Visual Sketches for Long-Horizon Robotic Manipulationcited by 4
- 2026How and What to Imagine? Visual Thinking in Unified Multimodal Models for Cross-View Spatial Reasoningcited by 2
- 2026RoboPIN: Grounded Embodied Reasoning via Pinned Chain-of-Thoughtcited by 0
- 2026CrossProjection: Geometric Grounding Beyond Viewpoint Change in Architectural Drawingscited by 0
- 2026MV-STRIDE: Enabling MLLMs to Master Multi-View Spatial Reasoning via Hierarchical Capability Modelingcited by 0
- 2026EmbodiedMind: Adaptive Data Curation and Prefix-Tree Reinforcement Learning for Efficient Embodied Intelligencecited by 0
- 2026EmbodiedMind: Adaptive Data Curation and Prefix-Tree Reinforcement Learning for Efficient Embodied Intelligence17 Sep 2026
- 2026MV-STRIDE: Enabling MLLMs to Master Multi-View Spatial Reasoning via Hierarchical Capability Modeling7 Sep 2026
- 2026CrossProjection: Geometric Grounding Beyond Viewpoint Change in Architectural Drawings1 Aug 2026
- 2026Mage-VL: An Efficient Codec-Native Streaming Multimodal Foundation Model27 Jul 2026
- 2026Vesta: A Generalist Embodied Reasoning Model18 Jun 2026
- 2026RoboPIN: Grounded Embodied Reasoning via Pinned Chain-of-Thought14 Jun 2026
- 2026Wall-OSS-0.5 Technical Report29 May 2026
- 2026How and What to Imagine? Visual Thinking in Unified Multimodal Models for Cross-View Spatial Reasoning26 May 2026
- 2026PRM-as-a-Judge: A Dense Evaluation Paradigm for Fine-Grained Robotic Auditing23 Mar 2026
- 2026Action-Sketcher: From Reasoning to Action via Visual Sketches for Long-Horizon Robotic Manipulation4 Jan 2026
- 2025Towards Spatial Trace with Reasoning in Vision-Language Models for Robotics15 Dec 2025
- 2025Scaling Up AI-Generated Image Detection with Generator-Aware Prototypes15 Dec 2025
Similar, not cited
Close in wording, no citation either way
- 2026From Correspondence to Actions: Human-Like Multi-Image Spatial Reasoning in Multi-modal Large Language Models
- 2025Point-It-Out: Benchmarking Embodied Reasoning for Vision Language Models in Multi-Stage Visual Grounding
- 2026CVSBench: A Comprehensive Benchmark for Cross-view Spatial Reasoning and Dreaming
- 2026CrossView Suite: Harnessing Cross-view Spatial Intelligence of MLLMs with Dataset, Model and Benchmark
- 2025Seeing from Another Perspective: Evaluating Multi-View Understanding in MLLMs
- 2026Learning Multi-View Spatial Reasoning from Cross-View Relations
- 2025TRACE: Textual Reasoning for Affordance Coordinate Extraction
- 2026EPIC-Bench: A Perception-Centric Benchmark for Fine-Grained Embodied Visual Grounding in Vision-Language Models