mlsanityData to 7 Oct 2026

TrustGeoGen: Formal-Verified Data Engine for Trustworthy Multi-modal Geometric Problem Solving

arXiv 2504.15780 ↗First posted 22 Apr 2025cs.AI cs.CLcited by 13

On the map: LLM reasoning → Spatial and embodied reasoning

Abstract (arXiv)

Geometric problem solving (GPS) requires precise multimodal understanding and rigorous, step-by-step logical reasoning. However, developing capable Multimodal Large Language Models (MLLMs) for GPS is heavily bottlenecked by the scarcity of high-quality, verifiable data. Existing data acquisition paradigms either suffer from modality incompleteness and unverified logical gaps ("leaps-of-faith"), or rely on formal engines that generate rigid, structurally homogeneous data, failing to produce high-difficulty problems or foster genuine natural-language reasoning. To overcome these limitations, we introduce TrustGeoGen, an autonomous and formalized geometric data generation engine. TrustGeoGen strictly guarantees reasoning trustworthiness through formal verification while generating multimodally integrated data, including premises, visual diagrams, and solutions. To systematically scale problem difficulty, we incorporates difficulty-aware filtering and iterative bootstrapping mechanism. Furthermore, we propose "connection thinking" to bridge the semantic gap between rigid formal logic and fluent human-like reasoning, ensuring coherent logical transitions. We also introduce the GeoExplore family of sampling algorithms to extract diverse problem-solving trajectories based on various thinking templates. Extensive experiments demonstrate that training models on our synthesized dataset, GeoTrust, substantially enhances deep geometric reasoning capabilities and yields significant performance gains across out-of-distribution (OOD) benchmarks, including GeoQA, Geometry3K, and OlympiadBench.Our code and data can be found at https://github.com/InternScience/TrustGeoGen

Key facts. Cited by 13 papers in the map (data through 7 Oct 2026). Placed in Spatial and embodied reasoning, one of 17 directions in LLM reasoning. Builds on 38 of its 59 references that are in the map. First posted on arXiv 22 Apr 2025.

Builds on

38 of 59 references.

Closest ancestors · 4

Same direction, newest first

  1. 2024Proposing and solving olympiad geometry with guided tree search14 Dec
  2. 2024AutoGeo: Automating Geometric Image Dataset Creation for Enhanced Geometry Understanding28 Aug
  3. 2023A Multi-Modal Neural Geometric Solver with Textual Clauses Parsed from Diagram22 Feb
  4. 2022UniGeo: Unifying Geometry Logical Reasoning via Reformulating Mathematical Expression6 Dec

Other references · 34

  1. 2023GPT-4 Technical Reportcited by 18,132
  2. 2022Training language models to follow instructions with human feedbackcited by 15,712
  3. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
  4. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
  5. 2023Visual Instruction Tuningcited by 7,792
  6. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,146
  7. 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,069
  8. 2025Qwen2.5-VL Technical Reportcited by 5,418
  9. 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,151
  10. 2024Gemini 1.5: Unlocking multimodal understanding across millions of tokens of contextcited by 3,175
  11. 2023MME: A Comprehensive Evaluation Benchmark for Multimodal Large Language Modelscited by 1,624
  12. 2023MathVista: Evaluating Mathematical Reasoning of Foundation Models in Visual Contextscited by 1,582
22 more
  1. 2024OlympiadBench: A Challenging Benchmark for Promoting AGI with Olympiad-Level Bilingual Multimodal Scientific Problemscited by 1,099
  2. 2024How Far Are We to GPT-4V? Closing the Gap to Commercial Multimodal Models with Open-Source Suitescited by 1,033
  3. 2024DeepSeek-VL: Towards Real-World Vision-Language Understandingcited by 718
  4. 2024MathVerse: Does Your Multi-modal LLM Truly See the Diagrams in Visual Math Problems?cited by 573
  5. 2024DeepSeek-VL2: Mixture-of-Experts Vision-Language Models for Advanced Multimodal Understandingcited by 559
  6. 2025LIMO: Less is More for Reasoningcited by 488
  7. 2021Inter-GPS: Interpretable Geometry Problem Solving with Formal Language and Symbolic Reasoningcited by 376
  8. 2025Accelerating scientific discovery with Co-Scientistcited by 353
  9. 2024InternLM-XComposer2: Mastering Free-form Text-Image Composition and Comprehension in Vision-Language Large Modelcited by 326
  10. 2021GeoQA: A Geometric Question Answering Benchmark Towards Multimodal Numerical Reasoningcited by 224
  11. 2023G-LLaVA: Solving Geometric Problem with Multi-Modal Large Language Modelcited by 208
  12. 2024InternLM-XComposer2-4KHD: A Pioneering Large Vision-Language Model Handling Resolutions from 336 Pixels to 4K HDcited by 156
  13. 2024Math-LLaVA: Bootstrapping Mathematical Reasoning for Multimodal Large Language Modelscited by 133
  14. 2025MME-CoT: Benchmarking Chain-of-Thought in Large Multimodal Models for Reasoning Quality, Robustness, and Efficiencycited by 123
  15. 2025Gold-medalist Performance in Solving Olympiad Geometry with AlphaGeometry2cited by 95
  16. 2025ReasonFlux: Hierarchical LLM Reasoning via Scaling Thought Templatescited by 62
  17. 2024GeoEval: Benchmark for Evaluating LLMs and Multi-Modal Models on Geometry Problem-Solvingcited by 44
  18. 2024DocGenome: An Open Large-scale Scientific Document Benchmark for Training and Testing Multi-modal Large Language Modelscited by 34
  19. 2024GeoX: Geometric Problem Solving Through Unified Formalized Vision-Language Pre-trainingcited by 23
  20. 2022PGDP5K: A Diagram Parsing Dataset for Plane Geometry Problemscited by 14
  21. 2024Chimera: Improving Generalist Model with Domain-Specific Expertscited by 11
  22. 2024Newclid: A User-Friendly Replacement for AlphaGeometrycited by 9

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 6; 2026: 7.

13 papers.

Sort:

By area:

Similar, not cited

Close in wording, no citation either way

  1. 2025Geoint-R1: Formalizing Multimodal Geometric Reasoning with Dynamic Auxiliary Constructions
  2. 2026VeriGeo: Controllable Geometry Question Generation with Numerical and Analytical Verification
  3. 2025GeoFM: Enhancing Geometric Reasoning of MLLMs via Synthetic Data Generation through Formal Language
  4. 2025AutoGPS: Automated Geometry Problem Solving via Multimodal Formalization and Deductive Reasoning
  5. 2026Beyond Symbolic Solving: Multi Chain-of-Thought Voting for Geometric Reasoning in Large Language Models
  6. 2025Enhancing the Geometric Problem-Solving Ability of Multimodal LLMs via Symbolic-Neural Integration
  7. 2025GeoSense: Evaluating Identification and Application of Geometric Principles in Multimodal Reasoning
  8. 2024Theorem-Validated Reverse Chain-of-Thought Problem Generation for Geometric Reasoning