NeSyGeo: A Neuro-Symbolic Framework for Multimodal Geometric Reasoning Data Generation
On the map: LLM reasoning → Spatial and embodied reasoning
Abstract (arXiv)
Obtaining large-scale, high-quality reasoning data is crucial for improving the geometric reasoning capabilities of multi-modal large language models (MLLMs). However, existing data generation methods, whether based on predefined tem plates or constrained symbolic provers, inevitably face diversity and numerical generalization limitations. To address these limitations, we propose NeSyGeo, a novel neuro-symbolic framework for generating geometric reasoning data. First, we propose a domain-specific language grounded in the entity-attributes-relations paradigm to comprehensively represent all components of plane geometry, along with generative actions defined within this symbolic space. We then design a symbolic-visual-text pipeline that synthesizes symbolic sequences, maps them to visual and textual representations and generates reasoning path with reverse search and forward validation. Based on this framework, we construct NeSyGeo CoT and NeSyGeo-Caption datasets, containing 100k samples, and release a new benchmark NeSyGeo-Test for evaluating geometric reasoning abilities in MLLMs. Experiments demonstrate that the proposal significantly and consistently improves the performance of multiple MLLMs under both reinforcement and supervised fine-tuning. With only 4k samples and two epochs of reinforcement fine-tuning, base models achieve improvements of up to +15.8% on MathVision, +8.4% on MathVerse, and +7.3% on GeoQA. Notably, a 4B model can be improved to outperform an 8B model from the same series on geometric reasoning tasks.s
Key facts. Cited by 10 papers in the map (data through 14 Oct 2026). Placed in Spatial and embodied reasoning, one of 17 directions in LLM reasoning. Builds on 33 of its 41 references that are in the map. First posted on arXiv 21 May 2025.
Builds on
33 of 41 references.
Closest ancestors · 4
Same direction, newest first
- 2025GeoSense: Evaluating Identification and Application of Geometric Principles in Multimodal Reasoning17 Apr
- 2024Theorem-Validated Reverse Chain-of-Thought Problem Generation for Geometric Reasoning23 Oct
- 2024AutoGeo: Automating Geometric Image Dataset Creation for Enhanced Geometry Understanding28 Aug
- 2023GeomVerse: A Systematic Evaluation of Large Models for Geometric Reasoning19 Dec
Other references · 29
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2023GPT-4 Technical Reportcited by 18,396
- 2023Visual Instruction Tuningcited by 7,869
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
- 2025Qwen2.5-VL Technical Reportcited by 5,587
- 2022Flamingo: a Visual Language Model for Few-Shot Learningcited by 4,386
- 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,234
- 2023InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Taskscited by 2,565
- 2021Align before Fuse: Vision and Language Representation Learning with Momentum Distillationcited by 1,619
- 2024LlamaFactory: Unified Efficient Fine-Tuning of 100+ Language Modelscited by 1,464
- 2024MathVerse: Does Your Multi-modal LLM Truly See the Diagrams in Visual Math Problems?cited by 586
- 2024Measuring Multimodal Mathematical Reasoning with MATH-Vision Datasetcited by 526
17 more
- 2025VLM-R1: A Stable and Generalizable R1-style Large Vision-Language Modelcited by 526
- 2024VLMEvalKit: An Open-Source Toolkit for Evaluating Large Multi-Modality Modelscited by 455
- 2021Inter-GPS: Interpretable Geometry Problem Solving with Formal Language and Symbolic Reasoningcited by 383
- 2021GeoQA: A Geometric Question Answering Benchmark Towards Multimodal Numerical Reasoningcited by 228
- 2023G-LLaVA: Solving Geometric Problem with Multi-Modal Large Language Modelcited by 210
- 2025MLLMs Know Where to Look: Training-free Perception of Small Visual Details with Multimodal LLMscited by 176
- 2024Draw-and-Understand: Leveraging Visual Prompts to Enable MLLMs to Comprehend What You Wantcited by 101
- 2024A Survey of Mathematical Reasoning in the Era of Multimodal Large Language Model: Benchmark, Method & Challengescited by 55
- 2024GeoEval: Benchmark for Evaluating LLMs and Multi-Modal Models on Geometry Problem-Solvingcited by 45
- 2024ControlMLLM: Training-Free Visual Prompt Learning for Multimodal Large Language Modelscited by 33
- 2025Position: Multimodal Large Language Models Can Significantly Advance Scientific Reasoningcited by 33
- 2024MARVEL: Multidimensional Abstraction and Reasoning through Visual Evaluation and Learningcited by 30
- 2022Plane Geometry Diagram Parsingcited by 20
- 2024Leveraging Visual Tokens for Extended Text Contexts in Multi-Modal Learningcited by 17
- 2024Euclid: Supercharging Multimodal LLMs with Synthetic High-Fidelity Visual Descriptionscited by 13
- 2025Pi-GPS: Enhancing Geometry Problem Solving by Unleashing the Power of Diagrammatic Informationcited by 10
- 2020Automatically Building Diagrams for Olympiad Geometry Problemscited by 8
Built on by
Citing papers per year: 2025: 2; 2026: 8.
10 papers.
- 2025AutoGPS: Automated Geometry Problem Solving via Multimodal Formalization and Deductive Reasoningcited by 14
- 2025GenesisGeo: Technical Reportcited by 2
- 2026How RL Unlocks the Aha Moment in Geometric Interleaved Reasoningcited by 2
- 2026Reasoning Core: A Scalable Procedural Data Generation Suite for Symbolic Pre-training and Post-Trainingcited by 2
- 2026Hilbert-Geo: Solving Solid Geometric Problems by Neural-Symbolic Reasoningcited by 2
- 2026GeoSym127K: Scalable Symbolically-verifiable Synthesis for Multimodal Geometric Reasoningcited by 1
- 2026A Progressive Visual-Logic-Aligned Framework for Ride-Hailing Adjudicationcited by 0
- 2026Draw2Think: Harnessing Geometry Reasoning through Constraint Engine Interactioncited by 0
- 2026Euclid-Omni : A Unified Neuro-Symbolic Framework for Plane Geometrycited by 0
- 2026From Symbolic Perception to Logical Deduction: A Framework for Guiding Language Models in Geometric Reasoningcited by 0
- 2026From Symbolic Perception to Logical Deduction: A Framework for Guiding Language Models in Geometric Reasoning9 Sep 2026
- 2026Euclid-Omni : A Unified Neuro-Symbolic Framework for Plane Geometry17 Jun 2026
- 2026Draw2Think: Harnessing Geometry Reasoning through Constraint Engine Interaction20 May 2026
- 2026Hilbert-Geo: Solving Solid Geometric Problems by Neural-Symbolic Reasoning11 May 2026
- 2026GeoSym127K: Scalable Symbolically-verifiable Synthesis for Multimodal Geometric Reasoning10 May 2026
- 2026A Progressive Visual-Logic-Aligned Framework for Ride-Hailing Adjudication18 Mar 2026
- 2026Reasoning Core: A Scalable Procedural Data Generation Suite for Symbolic Pre-training and Post-Training2 Mar 2026
- 2026How RL Unlocks the Aha Moment in Geometric Interleaved Reasoning1 Mar 2026
- 2025GenesisGeo: Technical Report26 Sep 2025
- 2025AutoGPS: Automated Geometry Problem Solving via Multimodal Formalization and Deductive Reasoning29 May 2025
Similar, not cited
Close in wording, no citation either way
- 2025Enhancing the Geometric Problem-Solving Ability of Multimodal LLMs via Symbolic-Neural Integration
- 2026NoReGeo: Non-Reasoning Geometry Benchmark
- 2026GeoChallenge: A Multi-Answer Multiple-Choice Benchmark for Geometric Reasoning with Diagrams
- 2025GeoSketch: A Neural-Symbolic Approach to Geometric Multimodal Reasoning with Auxiliary Line Construction and Affine Transformation
- 2026LatentGeo: Learnable Auxiliary Constructions in Latent Space for Multimodal Geometric Reasoning
- 2026Distilling Neuro-Symbolic Programs into 3D Multi-modal LLMs
- 2025DynaSolidGeo: A Dynamic Benchmark for Genuine Spatial Mathematical Reasoning of VLMs in Solid Geometry
- 2025GeoThought: A Dataset for Enhancing Mathematical Geometry Reasoning in Vision-Language Models