GeoSym127K: Scalable Symbolically-verifiable Synthesis for Multimodal Geometric Reasoning
On the map: LLM reasoning → Spatial and embodied reasoning
Abstract (arXiv)
Large Multimodal Models (LMMs) often struggle with geometric reasoning due to visual hallucinations and a lack of mathematically precise Chain-of-Thought (CoT) data. To address this, we propose the GeoSym Engine, an automated and scalable neuro-symbolic framework. By leveraging a type-conditional grammar and an analytic SymGT Solver, it derives exact symbolic ground truths and seamlessly integrates with a robust rendering pipeline to produce high-precision geometric diagrams. Using this engine, we construct GeoSym127K, a difficulty-stratified dataset featuring 51K high-resolution images, 127K questions with symbolic ground truths, and 55K answer-verified CoT QA pairs. We also introduce GeoSym-Bench, an expert-curated suite of 511 complex samples for rigorous evaluation. Through extensive supervised fine-tuning (SFT), we demonstrate that GeoSym drives concentrated improvements specifically on diagram-dependent and multi-step geometry tasks. Our Qwen3-VL-8B model gains an absolute +22.21% on the MathVerse Vision-Only subset and reaches 61.52% (+6.19% improvement) on WeMath, mitigating long-horizon logic fragmentation and outperforming advanced closed-source models like Doubao-1.8. Furthermore, applying Reinforcement Learning with Verifiable Rewards (RLVR) via GRPO reveals that initializing from structural SFT checkpoints substantially elevates the performance ceiling over zero-shot RL. Driven by deterministic exact-match signals, this showcases the robust scaling potential of our verifiable reasoning synthesis. Datasets and code are available at https://huggingface.co/datasets/Tomie0506/GeoSym127K and https://github.com/Tomie56/GeoSym127K.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Spatial and embodied reasoning, one of 17 directions in LLM reasoning. Builds on 21 of its 37 references that are in the map. First posted on arXiv 10 May 2026.
Builds on
21 of 37 references.
Closest ancestors · 6
Same direction, newest first
- 2025GeoBench: Rethinking Multimodal Geometric Problem-Solving via Hierarchical Evaluation30 Dec
- 2025GeoFM: Enhancing Geometric Reasoning of MLLMs via Synthetic Data Generation through Formal Language31 Oct
- 2025NeSyGeo: A Neuro-Symbolic Framework for Multimodal Geometric Reasoning Data Generation21 May
- 2025TrustGeoGen: Formal-Verified Data Engine for Trustworthy Multi-modal Geometric Problem Solving22 Apr
- 2024Theorem-Validated Reverse Chain-of-Thought Problem Generation for Geometric Reasoning23 Oct
- 2024AutoGeo: Automating Geometric Image Dataset Creation for Enhanced Geometry Understanding28 Aug
Other references · 15
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
- 2025Qwen2.5-VL Technical Reportcited by 5,418
- 2025Qwen3-VL Technical Reportcited by 2,534
- 2025OpenAI GPT-5 System Cardcited by 910
- 2025Vision-R1: Incentivizing Reasoning Capability in Multimodal Large Language Modelscited by 653
- 2023WizardMath: Empowering Mathematical Reasoning for Large Language Models via Reinforced Evol-Instructcited by 618
- 2024VLMEvalKit: An Open-Source Toolkit for Evaluating Large Multi-Modality Modelscited by 443
- 2021Inter-GPS: Interpretable Geometry Problem Solving with Formal Language and Symbolic Reasoningcited by 376
- 2024We-Math: Does Your Large Multimodal Model Achieve Human-like Mathematical Reasoning?cited by 281
- 2026Seed1.8 Model Card: Towards Generalized Real-World Agencycited by 47
- 2024GeoGPT4V: Towards Geometric Multi-modal Large Language Models with Geometric Image Generationcited by 31
- 2025Math Blind: Failures in Diagram Understanding Undermine Reasoning in MLLMscited by 15
3 more
- 2025NVIDIA Nemotron Nano V2 VLcited by 15
- 2025Do Large Language Models Truly Understand Geometric Structures?cited by 7
- 2025GeoSDF: Plane Geometry Diagram Synthesis via Signed Distance Fieldcited by 4
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2025Enhancing the Geometric Problem-Solving Ability of Multimodal LLMs via Symbolic-Neural Integration
- 2025GeoSketch: A Neural-Symbolic Approach to Geometric Multimodal Reasoning with Auxiliary Line Construction and Affine Transformation
- 2026Synthesizing Multimodal Geometry Datasets from Scratch and Enabling Visual Alignment via Plotting Code
- 2026GeoChallenge: A Multi-Answer Multiple-Choice Benchmark for Geometric Reasoning with Diagrams
- 2025Geoint-R1: Formalizing Multimodal Geometric Reasoning with Dynamic Auxiliary Constructions
- 2025GeoThought: A Dataset for Enhancing Mathematical Geometry Reasoning in Vision-Language Models
- 2025GeoSense: Evaluating Identification and Application of Geometric Principles in Multimodal Reasoning
- 2026From Symbolic Perception to Logical Deduction: A Framework for Guiding Language Models in Geometric Reasoning