mlsanityData to 7 Oct 2026

From Correspondence to Actions: Human-Like Multi-Image Spatial Reasoning in Multi-modal Large Language Models

arXiv 2602.08735 ↗First posted 9 Feb 2026cs.CVcited by 2

On the map: LLM reasoning → Spatial and embodied reasoning

also in 1 more
Abstract (arXiv)

While multimodal large language models (MLLMs) have made substantial progress in single-image spatial reasoning, multi-image spatial reasoning, which requires integration of information from multiple viewpoints, remains challenging. Cognitive studies suggest that humans address such tasks through two mechanisms: cross-view correspondence, which identifies regions across different views that correspond to the same physical locations, and stepwise viewpoint transformation, which composes relative viewpoint changes sequentially. However, existing studies incorporate these mechanisms only partially and often implicitly, without explicit supervision for both. We propose Human-Aware Training for Cross-view correspondence and viewpoint cHange (HATCH), a training framework with two complementary objectives: (1) Patch-Level Spatial Alignment, which encourages patch representations to align across views for spatially corresponding regions, and (2) Action-then-Answer Reasoning, which requires the model to generate explicit viewpoint transition actions before predicting the final answer. Experiments on three benchmarks demonstrate that HATCH consistently outperforms baselines of comparable size by a clear margin and achieves competitive results against much larger models, while preserving single-image reasoning capabilities.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Placed in Spatial and embodied reasoning, one of 17 directions in LLM reasoning. Builds on 49 of its 64 references that are in the map. First posted on arXiv 9 Feb 2026.

Builds on

49 of 64 references.

Closest ancestors · 15

Same direction, newest first

  1. 2025G2VLM: Geometry Grounded Vision Language Model with Unified 3D Reconstruction and Spatial Reasoning26 Nov
  2. 2025Think with 3D: Geometric Imagination Grounded Spatial Reasoning from Limited Views21 Oct
  3. 2025SpatialLadder: Progressive Training for Spatial Reasoning in Vision-Language Models9 Oct
  4. 2025Spatial Reasoning with Vision-Language Models in Ego-Centric Multi-View Scenes8 Sep
  5. 2025Reinforcing Spatial Reasoning in Vision-Language Models with Interwoven Thinking and Visual Drawing11 Jun
  6. 20253DRS: MLLMs Need 3D-Aware Representation Supervision for Scene Understanding2 Jun
  7. 2025MMSI-Bench: A Benchmark for Multi-Image Spatial Intelligence29 May
  8. 2025SSR: Enhancing Depth Perception in Vision-Language Models via Rationale-Guided Spatial Reasoning18 May
  9. 2025Perspective-Aware Reasoning in Vision-Language Models via Mental Imagery Simulation24 Apr
  10. 2025SpaceR: Reinforcing MLLMs in Video Spatial Reasoning2 Apr
  11. 2025Improved Visual-Spatial Reasoning via R1-Zero-Like Training1 Apr
  12. 2024LayoutVLM: Differentiable Optimization of 3D Layout via Vision-Language Models3 Dec
3 more
  1. 2024Coarse Correspondences Boost Spatial-Temporal Reasoning in Multimodal Language Model1 Aug
  2. 2024SpatialRGPT: Grounded Spatial Reasoning in Vision Language Models3 Jun
  3. 2024SpatialVLM: Endowing Vision-Language Models with Spatial Reasoning Capabilities22 Jan

Other references · 34

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
  3. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
  4. 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,893
  5. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,146
  6. 2025Qwen2.5-VL Technical Reportcited by 5,418
  7. 2022Large Language Models are Zero-Shot Reasonerscited by 4,323
  8. 2021Scaling Up Visual and Vision-Language Representation Learning With Noisy Text Supervisioncited by 3,848
  9. 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,155
  10. 2023Sigmoid Loss for Language Image Pre-Trainingcited by 3,048
  11. 2024Expanding Performance Boundaries of Open-Source Multimodal Models with Model, Data, and Test-Time Scalingcited by 1,573
  12. 2021Grounded Language-Image Pre-trainingcited by 1,147
22 more
  1. 2021Open-vocabulary Object Detection via Vision and Language Knowledge Distillationcited by 903
  2. 2021iBOT: Image BERT Pre-Training with Online Tokenizercited by 891
  3. 2024Cambrian-1: A Fully Open, Vision-Centric Exploration of Multimodal LLMscited by 822
  4. 2023Large Language Modelscited by 774
  5. 2025Depth Anything 3: Recovering the Visual Space from Any Viewscited by 626
  6. 2021RegionCLIP: Region-based Language-Image Pretrainingcited by 612
  7. 2020Dense Contrastive Learning for Self-Supervised Visual Pre-Trainingcited by 512
  8. 2025Video-R1: Reinforcing Video Reasoning in MLLMscited by 464
  9. 2020Propagate Yourself: Exploring Pixel-Level Consistency for Unsupervised Visual Representation Learningcited by 297
  10. 2025LLaVA-OneVision-1.5: Fully Open Framework for Democratized Multimodal Trainingcited by 233
  11. 2025Spatial-MLLM: Boosting MLLM Capabilities in Visual-based Spatial Intelligencecited by 206
  12. 2022CroCo: Self-Supervised Pre-training for 3D Vision Tasks by Cross-View Completioncited by 158
  13. 2025VLM-3R: Vision-Language Models Augmented with Instruction-Aligned 3D Reconstructioncited by 154
  14. 2024SpatialBot: Precise Spatial Understanding with Vision Language Modelscited by 146
  15. 2024RoboSpatial: Teaching Spatial Understanding to 2D and 3D Vision-Language Models for Roboticscited by 133
  16. 2025From Flatland to Space: Teaching Vision-Language Models to Perceive and Reason in 3Dcited by 127
  17. 2024SAT: Dynamic Spatial Aptitude Training for Multimodal Language Modelscited by 111
  18. 2025MindCube: Spatial Mental Modeling from Limited Viewscited by 91
  19. 2025MM-Spatial: Exploring 3D Spatial Understanding in Multimodal LLMscited by 72
  20. 2025Multi-SpatialMLLM: Multi-Frame Spatial Understanding with Multi-Modal Large Language Modelscited by 52
  21. 2025SD-VLM: Spatial Measuring and Understanding with Depth-Encoded Vision-Language Modelscited by 24
  22. 2025SpatialScore: Towards Comprehensive Evaluation for Spatial Intelligencecited by 19

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Spatial Reasoning in Multimodal Large Language Models: A Survey of Tasks, Benchmarks and Methods
  2. 2025Multimodal Spatial Reasoning in the Large Model Era: A Survey and Benchmarks
  3. 2026OrientSAM: Mitigating Camera-Centric Shortcut in Multimodal Spatial Reasoning via Orientation-Aware Spatial Alignment
  4. 2025Actial: Activate Spatial Reasoning Ability of Multimodal Large Language Models
  5. 2025Seeing from Another Perspective: Evaluating Multi-View Understanding in MLLMs
  6. 2024Is A Picture Worth A Thousand Words? Delving Into Spatial Reasoning for Vision Language Models
  7. 2026GraFT: A Training-Free Framework for Spatial Reasoning in Multimodal Large Language Models via 3D Scene Graphs
  8. 2026LAST: Leveraging Tools as Hints to Enhance Spatial Reasoning for Multimodal Large Language Models