mlsanityData to 14 Oct 2026

NeSyGeo: A Neuro-Symbolic Framework for Multimodal Geometric Reasoning Data Generation

arXiv 2505.17121 ↗First posted 21 May 2025cs.CL cs.AIcited by 10

On the map: LLM reasoning → Spatial and embodied reasoning

also in 1 more
Abstract (arXiv)

Obtaining large-scale, high-quality reasoning data is crucial for improving the geometric reasoning capabilities of multi-modal large language models (MLLMs). However, existing data generation methods, whether based on predefined tem plates or constrained symbolic provers, inevitably face diversity and numerical generalization limitations. To address these limitations, we propose NeSyGeo, a novel neuro-symbolic framework for generating geometric reasoning data. First, we propose a domain-specific language grounded in the entity-attributes-relations paradigm to comprehensively represent all components of plane geometry, along with generative actions defined within this symbolic space. We then design a symbolic-visual-text pipeline that synthesizes symbolic sequences, maps them to visual and textual representations and generates reasoning path with reverse search and forward validation. Based on this framework, we construct NeSyGeo CoT and NeSyGeo-Caption datasets, containing 100k samples, and release a new benchmark NeSyGeo-Test for evaluating geometric reasoning abilities in MLLMs. Experiments demonstrate that the proposal significantly and consistently improves the performance of multiple MLLMs under both reinforcement and supervised fine-tuning. With only 4k samples and two epochs of reinforcement fine-tuning, base models achieve improvements of up to +15.8% on MathVision, +8.4% on MathVerse, and +7.3% on GeoQA. Notably, a 4B model can be improved to outperform an 8B model from the same series on geometric reasoning tasks.s

Key facts. Cited by 10 papers in the map (data through 14 Oct 2026). Placed in Spatial and embodied reasoning, one of 17 directions in LLM reasoning. Builds on 33 of its 41 references that are in the map. First posted on arXiv 21 May 2025.

Builds on

33 of 41 references.

Closest ancestors · 4

Same direction, newest first

  1. 2025GeoSense: Evaluating Identification and Application of Geometric Principles in Multimodal Reasoning17 Apr
  2. 2024Theorem-Validated Reverse Chain-of-Thought Problem Generation for Geometric Reasoning23 Oct
  3. 2024AutoGeo: Automating Geometric Image Dataset Creation for Enhanced Geometry Understanding28 Aug
  4. 2023GeomVerse: A Systematic Evaluation of Large Models for Geometric Reasoning19 Dec

Other references · 29

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2023GPT-4 Technical Reportcited by 18,396
  3. 2023Visual Instruction Tuningcited by 7,869
  4. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
  5. 2025Qwen2.5-VL Technical Reportcited by 5,587
  6. 2022Flamingo: a Visual Language Model for Few-Shot Learningcited by 4,386
  7. 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,234
  8. 2023InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Taskscited by 2,565
  9. 2021Align before Fuse: Vision and Language Representation Learning with Momentum Distillationcited by 1,619
  10. 2024LlamaFactory: Unified Efficient Fine-Tuning of 100+ Language Modelscited by 1,464
  11. 2024MathVerse: Does Your Multi-modal LLM Truly See the Diagrams in Visual Math Problems?cited by 586
  12. 2024Measuring Multimodal Mathematical Reasoning with MATH-Vision Datasetcited by 526
17 more
  1. 2025VLM-R1: A Stable and Generalizable R1-style Large Vision-Language Modelcited by 526
  2. 2024VLMEvalKit: An Open-Source Toolkit for Evaluating Large Multi-Modality Modelscited by 455
  3. 2021Inter-GPS: Interpretable Geometry Problem Solving with Formal Language and Symbolic Reasoningcited by 383
  4. 2021GeoQA: A Geometric Question Answering Benchmark Towards Multimodal Numerical Reasoningcited by 228
  5. 2023G-LLaVA: Solving Geometric Problem with Multi-Modal Large Language Modelcited by 210
  6. 2025MLLMs Know Where to Look: Training-free Perception of Small Visual Details with Multimodal LLMscited by 176
  7. 2024Draw-and-Understand: Leveraging Visual Prompts to Enable MLLMs to Comprehend What You Wantcited by 101
  8. 2024A Survey of Mathematical Reasoning in the Era of Multimodal Large Language Model: Benchmark, Method & Challengescited by 55
  9. 2024GeoEval: Benchmark for Evaluating LLMs and Multi-Modal Models on Geometry Problem-Solvingcited by 45
  10. 2024ControlMLLM: Training-Free Visual Prompt Learning for Multimodal Large Language Modelscited by 33
  11. 2025Position: Multimodal Large Language Models Can Significantly Advance Scientific Reasoningcited by 33
  12. 2024MARVEL: Multidimensional Abstraction and Reasoning through Visual Evaluation and Learningcited by 30
  13. 2022Plane Geometry Diagram Parsingcited by 20
  14. 2024Leveraging Visual Tokens for Extended Text Contexts in Multi-Modal Learningcited by 17
  15. 2024Euclid: Supercharging Multimodal LLMs with Synthetic High-Fidelity Visual Descriptionscited by 13
  16. 2025Pi-GPS: Enhancing Geometry Problem Solving by Unleashing the Power of Diagrammatic Informationcited by 10
  17. 2020Automatically Building Diagrams for Olympiad Geometry Problemscited by 8

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 2; 2026: 8.

10 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Enhancing the Geometric Problem-Solving Ability of Multimodal LLMs via Symbolic-Neural Integration
  2. 2026NoReGeo: Non-Reasoning Geometry Benchmark
  3. 2026GeoChallenge: A Multi-Answer Multiple-Choice Benchmark for Geometric Reasoning with Diagrams
  4. 2025GeoSketch: A Neural-Symbolic Approach to Geometric Multimodal Reasoning with Auxiliary Line Construction and Affine Transformation
  5. 2026LatentGeo: Learnable Auxiliary Constructions in Latent Space for Multimodal Geometric Reasoning
  6. 2026Distilling Neuro-Symbolic Programs into 3D Multi-modal LLMs
  7. 2025DynaSolidGeo: A Dynamic Benchmark for Genuine Spatial Mathematical Reasoning of VLMs in Solid Geometry
  8. 2025GeoThought: A Dataset for Enhancing Mathematical Geometry Reasoning in Vision-Language Models