mlsanityData to 7 Oct 2026

Transfer Learning with Synthetic Corpora for Spatial Role Labeling and Reasoning

arXiv 2210.16952 ↗First posted 30 Oct 2022cs.CLcited by 32

On the map: LLM reasoning → Spatial and embodied reasoning

also in 1 more
Abstract (arXiv)

Recent research shows synthetic data as a source of supervision helps pretrained language models (PLM) transfer learning to new target tasks/domains. However, this idea is less explored for spatial language. We provide two new data resources on multiple spatial language processing tasks. The first dataset is synthesized for transfer learning on spatial question answering (SQA) and spatial role labeling (SpRL). Compared to previous SQA datasets, we include a larger variety of spatial relation types and spatial expressions. Our data generation process is easily extendable with new spatial expression lexicons. The second one is a real-world SQA dataset with human-generated questions built on an existing corpus with SPRL annotations. This dataset can be used to evaluate spatial language processing models in realistic situations. We show pretraining with automatically generated data significantly improves the SOTA results on several SQA and SPRL benchmarks, particularly when the training data in the target domain is small.

Key facts. Cited by 32 papers in the map (data through 7 Oct 2026). Placed in Spatial and embodied reasoning, one of 17 directions in LLM reasoning. Builds on 20 of its 51 references that are in the map. First posted on arXiv 30 Oct 2022.

Builds on

20 of 51 references.

Closest ancestors · 1

Same direction, newest first

  1. 2022StepGame: A New Benchmark for Robust Multi-Hop Spatial Reasoning in Texts18 Apr

Other references · 19

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2020UnifiedQA: Crossing Format Boundaries With a Single QA Systemcited by 475
  3. 2019KG-BERT: BERT for Knowledge Graph Completioncited by 323
  4. 2015Towards AI-Complete Question Answering: A Set of Prerequisite Toy Taskscited by 309
  5. 2020ProofWriter: Generating Implications, Proofs, and Abductive Statements over Natural Languagecited by 309
  6. 2020Transformers as Soft Reasoners over Languagecited by 265
  7. 2018Touchdown: Natural Language Navigation and Spatial Reasoning in Visual Street Environmentscited by 238
  8. 2022Impact of Pretraining Term Frequencies on Few-Shot Reasoningcited by 142
  9. 2020Syntactic Data Augmentation Increases Robustness to Inference Heuristicscited by 85
  10. 2021SpartQA: : A Textual Question Answering Benchmark for Spatial Reasoningcited by 75
  11. 2019A Logic-Driven Framework for Consistency of Neural Modelscited by 64
  12. 2021Semi-Supervised Variational Reasoning for Medical Dialogue Generationcited by 30
7 more
  1. 2015Do We Need More Training Data?cited by 26
  2. 2021RuleBert: Teaching Soft Rules to Pre-trained Language Modelscited by 25
  3. 2020Spatial Reasoning from Natural Language Instructions for Robot Manipulationcited by 16
  4. 2021Towards Navigation by Reasoning over Spatial Configurationscited by 14
  5. 2019Understanding Spatial Language in Radiology: Representation Framework, Annotation, and Spatial Relation Extraction from Chest X-ray Reports using Deep Learningcited by 12
  6. 2019Semi-Supervised Learning using Differentiable Reasoningcited by 6
  7. 2016Deep Embedding for Spatial Role Labelingcited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 5; 2024: 16; 2025: 8; 2026: 3.

32 papers.

Sort:

By area:

  1. 2023A Multitask, Multilingual, Multimodal Evaluation of ChatGPT on Reasoning, Hallucination, and Interactivitycited by 888
  2. 2023FLASK: Fine-grained Language Model Evaluation based on Alignment Skill Setscited by 198
  3. 2024Mind's Eye of LLMs: Visualization-of-Thought Elicits Spatial Reasoning in Large Language Modelscited by 65
  4. 2024Demystifying Chains, Trees, and Graphs of Thoughtscited by 63
  5. 2023Coupling Large Language Models with Logic Programming for Robust and General Reasoning from Textcited by 59
  6. 2024Do Vision-Language Models Represent Space and How? Evaluating Spatial Frame of Reference Under Ambiguitiescited by 58
  7. 2024TopViewRS: Vision-Language Models as Top-View Spatial Reasonerscited by 48
  8. 2024A Survey of Prompt Engineering Methods in Large Language Models for Different NLP Taskscited by 46
  9. 2024CityGPT: Empowering Urban Spatial Cognition of Large Language Modelscited by 29
  10. 2024Advancing Spatial Reasoning in Large Language Models: An In-Depth Evaluation and Enhancement Using the StepGame Benchmarkcited by 26
  11. 2025Scaling and Beyond: Advancing Spatial Reasoning in MLLMs Requires New Recipescited by 22
  12. 2024Limits of Deep Learning: Sequence Modeling through the Lens of Complexity Theorycited by 19
20 more
  1. 2024A Review of the Applications of Deep Learning-Based Emergent Communicationcited by 17
  2. 2024Reframing Spatial Reasoning Evaluation in Language Models: A Real-World Simulation Benchmark for Qualitative Reasoningcited by 16
  3. 2024A Survey on Compositional Learning of AI Models: Theoretical and Experimental Practicescited by 15
  4. 2024STBench: Assessing the Ability of Large Language Models in Spatio-Temporal Analysiscited by 11
  5. 2025MazeEval: A Benchmark for Testing Sequential Decision-Making in Language Modelscited by 8
  6. 2023Chain-of-Symbol Prompting Elicits Planning in Large Langauge Modelscited by 6
  7. 2024Dspy-based Neural-Symbolic Pipeline to Enhance Spatial Reasoning in LLMscited by 6
  8. 2024SpaRC and SpaRP: Spatial Reasoning Characterization and Path Generation for Understanding Spatial Reasoning Capability of Large Language Modelscited by 5
  9. 2025USTBench: Benchmarking and Dissecting Spatiotemporal Reasoning of LLMs as Urban Agentscited by 5
  10. 2024A LLM Benchmark based on the Minecraft Builder Dialog Agent Taskcited by 4
  11. 2023DepWiGNN: A Depth-wise Graph Neural Network for Multi-hop Spatial Reasoning in Textcited by 3
  12. 2025Navigating Motion Agents in Dynamic and Cluttered Environments through LLM Reasoningcited by 2
  13. 2025seqBench: A Tunable Benchmark to Quantify Sequential Reasoning Limits of LLMscited by 2
  14. 2024Grounding Spatial Relations in Text-Only Language Modelscited by 1
  15. 2025MobQA: A Benchmark Dataset for Semantic Understanding of Human Mobility Data through Question Answeringcited by 1
  16. 2025FoR-SALE: Frame of Reference-guided Spatial Adjustment in LLM-based Diffusion Editingcited by 1
  17. 2025From Building Blocks to Planning: Multi-Step Spatial Reasoning in LLMs with Reinforcement Learningcited by 1
  18. 2026Spatial Reasoning via Modality Switching Between Language and Symbolic Representationscited by 0
  19. 2026OmniLayout: A Schematic-Coupled Multimodal Benchmark for Constraint-Aware Geometric Reasoning in PCB Layoutcited by 0
  20. 2026GeoBenchLLM: A Comprehensive Benchmark for Evaluating LLMs on Geo-Related Taskscited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2026Ouroboros-Spatial: Closing the Data-Model Loop for Spatial Reasoning
  2. 2025SpaRE: Enhancing Spatial Reasoning in Vision-Language Models with Synthetic Data
  3. 2025SpatialScore: Towards Comprehensive Evaluation for Spatial Intelligence
  4. 2025FoREST: Frame of Reference Evaluation in Spatial Reasoning Tasks
  5. 2024Evaluating Large Language Models on Spatial Tasks: A Multi-Task Benchmarking Study
  6. 2023SpaceNLI: Evaluating the Consistency of Predicting Inferences in Space
  7. 2024Neuro-symbolic Training for Reasoning over Spatial Language
  8. 2025ColLab: A Collaborative Spatial Progressive Data Engine for Referring Expression Comprehension and Generation