mlsanityData to 7 Oct 2026

Towards Cross-View Point Correspondence in Vision-Language Models

arXiv 2512.04686 ↗First posted 4 Dec 2025cs.CVcited by 12

On the map: Multimodal LLMs / vision-language models → Embodied and 3D vision-language models

Abstract (arXiv)

Cross-view correspondence is a fundamental capability for spatial understanding and embodied AI. However, it is still far from being realized in Vision-Language Models (VLMs), especially in achieving precise point-level correspondence, which is crucial for precise affordance interaction. So we propose the Cross-View Point Correspondence (CVPC) task and CrossPoint-Bench, a comprehensive benchmark with hierarchical design, inspired by the human cognitive process of "perceive", "reason", and "correspond". Our evaluation shows the state-of-the-art models (e.g., Gemini-2.5-Pro) still fall far behind humans, with a gap of over 54.65% in overall accuracy, exposing a challenge in transitioning from coarse-grained judgement to fine-grained coordinate prediction. To address this problem, we construct CrossPoint-378K, a dataset with 378K question-answering pairs across 900 scenes, focused on actionable affordance regions that better reflect real-world manipulation and interaction scenarios. Furthermore, we propose CroPond that trained on the CrossPoint-378K dataset. Our CroPond achieves state-of-the-art performance on CrossPoint-Bench, surpassing Gemini-2.5-Pro by 39.7% accuracy, which offers a foundation for advancing future work on cross-view correspondence. The benchmark, dataset, and model are publicly available at https://github.com/WangYipu2002/CrossPoint.

Key facts. Cited by 12 papers in the map (data through 7 Oct 2026). Placed in Embodied and 3D vision-language models, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 76 of its 95 references that are in the map. First posted on arXiv 4 Dec 2025.

Builds on

76 of 95 references.

Closest ancestors · 17

Same direction, newest first

  1. 2025Why Do MLLMs Struggle with Spatial Understanding? A Systematic Analysis from Data to Architecture2 Sep
  2. 2025VisualTrans: A Benchmark for Real-World Visual Transformation Reasoning6 Aug
  3. 2025R-VLM: Region-Aware Vision Language Model for Precise GUI Grounding8 Jul
  4. 2025RoboBrain 2.0 Technical Report2 Jul
  5. 2025RoboRefer: Towards Spatial Referring with Reasoning in Vision-Language Models for Robotics4 Jun
  6. 2025MMSI-Bench: A Benchmark for Multi-Image Spatial Intelligence29 May
  7. 2025Robo2VLM: Visual Question Answering from Large-Scale In-the-Wild Robot Manipulation Datasets21 May
  8. 2025From Flatland to Space: Teaching Vision-Language Models to Perceive and Reason in 3D29 Mar
  9. 2025CoT-VLA: Visual Chain-of-Thought Reasoning for Vision-Language-Action Models27 Mar
  10. 2025Reason-RFT: Reinforcement Fine-Tuning for Visual Reasoning of Vision Language Models26 Mar
  11. 2025RoboBrain: A Unified Brain Model for Robotic Manipulation from Abstract to Concrete28 Feb
  12. 2024Thinking in Space: How Multimodal Large Language Models See, Remember, and Recall Spaces18 Dec
5 more
  1. 2024SPHERE: Unveiling Spatial Blind Spots in Vision-Language Models Through Hierarchical Evaluation17 Dec
  2. 2024SAT: Dynamic Spatial Aptitude Training for Multimodal Language Models10 Dec
  3. 2024RoboPoint: A Vision-Language Model for Spatial Affordance Prediction for Robotics15 Jun
  4. 2024SpatialVLM: Endowing Vision-Language Models with Spatial Reasoning Capabilities22 Jan
  5. 2023ManipLLM: Embodied Multimodal Large Language Model for Object-Centric Robotic Manipulation24 Dec

Other references · 59

  1. 2025Qwen3 Technical Reportcited by 8,195
  2. 2025Qwen2.5-VL Technical Reportcited by 5,418
  3. 2023Improved Baselines with Visual Instruction Tuningcited by 4,362
  4. 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,274
  5. 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,088
  6. 2024SAM 2: Segment Anything in Images and Videoscited by 2,784
  7. 2023MMBench: Is Your Multi-modal Model an All-around Player?cited by 2,105
  8. 2023MMMU: A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for Expert AGIcited by 2,044
  9. 2022Learn to Explain: Multimodal Reasoning via Thought Chains for Science Question Answeringcited by 1,881
  10. 2019Towards VQA Models That Can Readcited by 1,696
  11. 2023Evaluating Object Hallucination in Large Vision-Language Modelscited by 1,696
  12. 2023MME: A Comprehensive Evaluation Benchmark for Multimodal Large Language Modelscited by 1,624
38 more
  1. 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,526
  2. 2025VGGT: Visual Geometry Grounded Transformercited by 1,475
  3. 2019OK-VQA: A Visual Question Answering Benchmark Requiring External Knowledgecited by 1,114
  4. 2024Are We on the Right Way for Evaluating Large Vision-Language Models?cited by 893
  5. 2024Cambrian-1: A Fully Open, Vision-Centric Exploration of Multimodal LLMscited by 822
  6. 2016A Diagram Is Worth A Dozen Imagescited by 793
  7. 2023ScanNet++: A High-Fidelity Dataset of 3D Indoor Scenescited by 747
  8. 2024BLINK: Multimodal Large Language Models Can See but Not Perceivecited by 529
  9. 2024MMMU-Pro: A More Robust Multi-discipline Multimodal Understanding Benchmarkcited by 494
  10. 2023Ego-Exo4D: Understanding Skilled Human Activity from First- and Third-Person Perspectivescited by 477
  11. 2021ARKitScenes: A Diverse Real-World Dataset For 3D Indoor Scene Understanding Using Mobile RGB-D Datacited by 442
  12. 2024Molmo and PixMo: Open Weights and Open Data for State-of-the-Art Vision-Language Modelscited by 321
  13. 2025LLaVA-OneVision-1.5: Fully Open Framework for Democratized Multimodal Trainingcited by 233
  14. 2020University-1652: A Multi-view Multi-source Benchmark for Drone-based Geo-localizationcited by 152
  15. 2024Scaling Proprioceptive-Visual Learning with Heterogeneous Pre-trained Transformerscited by 145
  16. 2025MUSt3R: Multi-view Network for Stereo 3D Reconstructioncited by 139
  17. 20244Diffusion: Multi-view Video Diffusion Model for 4D Generationcited by 104
  18. 2025MEt3R: Measuring Multi-View Consistency in Generated Imagescited by 91
  19. 2025Your Large Vision-Language Model Only Needs A Few Attention Heads For Visual Groundingcited by 78
  20. 2024Large Spatial Model: End-to-end Unposed Images to Semantic 3Dcited by 73
  21. 2024GROUNDHOG: Grounding Large Language Models to Holistic Segmentationcited by 70
  22. 2023BenchLMM: Benchmarking Cross-style Visual Capability of Large Multimodal Modelscited by 41
  23. 2024MC-Bench: A Benchmark for Multi-Context Visual Grounding in the Era of MLLMscited by 38
  24. 2025Towards a Unified Understanding of Robot Manipulation: A Comprehensive Surveycited by 32
  25. 2024MVInpainter: Learning Multi-View Consistent Inpainting to Bridge 2D and 3D Editingcited by 30
  26. 2024Cross-View Completion Models are Zero-shot Correspondence Estimatorscited by 30
  27. 2025Digital Twin Catalog: A Large-Scale Photorealistic 3D Object Digital Twin Datasetcited by 29
  28. 2025RoboOS: A Hierarchical Embodied Framework for Cross-Embodiment and Multi-Agent Collaborationcited by 28
  29. 2024Multi-Sensor Object Anomaly Detection: Unifying Appearance, Geometry, and Internal Propertiescited by 26
  30. 2025Geolocation with Real Human Gameplay Data: A Large-Scale Dataset and Human-Like Reasoning Frameworkcited by 23
  31. 2024Hazards in Daily Life? Enabling Robots to Proactively Detect and Resolve Anomaliescited by 19
  32. 2023Improved Visual Grounding through Self-Consistent Explanationscited by 17
  33. 2024Real-Time Simulated Avatar from Head-Mounted Sensorscited by 17
  34. 2025EgoSim: An Egocentric Multi-view Simulator and Real Dataset for Body-worn Cameras during Motion and Activitycited by 15
  35. 2025REWIND: Real-Time Egocentric Whole-Body Motion Diffusion with Exemplar-Based Identity Conditioningcited by 14
  36. 2023Rapid Motor Adaptation for Robotic Manipulator Armscited by 13
  37. 2025CoopTrack: Exploring End-to-End Learning for Efficient Cooperative Sequential Perceptioncited by 12
  38. 2025FaceBench: A Multi-View Multi-Level Facial Attribute VQA Dataset for Benchmarking Face Perception MLLMscited by 11

50 most cited of 59 All 59 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 2; 2026: 10.

12 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026From Correspondence to Actions: Human-Like Multi-Image Spatial Reasoning in Multi-modal Large Language Models
  2. 2025Point-It-Out: Benchmarking Embodied Reasoning for Vision Language Models in Multi-Stage Visual Grounding
  3. 2026CVSBench: A Comprehensive Benchmark for Cross-view Spatial Reasoning and Dreaming
  4. 2026CrossView Suite: Harnessing Cross-view Spatial Intelligence of MLLMs with Dataset, Model and Benchmark
  5. 2025Seeing from Another Perspective: Evaluating Multi-View Understanding in MLLMs
  6. 2026Learning Multi-View Spatial Reasoning from Cross-View Relations
  7. 2025TRACE: Textual Reasoning for Affordance Coordinate Extraction
  8. 2026EPIC-Bench: A Perception-Centric Benchmark for Fine-Grained Embodied Visual Grounding in Vision-Language Models