mlsanityData to 14 Oct 2026

GeoMathCode: Understanding Interleaved Math-Code Reasoning for Geometry Problem Solving

arXiv 2605.25384 ↗First posted 25 May 2026cs.CLcited by 0

On the map: LLM reasoning → Spatial and embodied reasoning

Abstract (arXiv)

Mathematical reasoning is a hallmark of human intelligence, requiring logical deduction, symbolic manipulation, and abstract thinking. Recent multimodal large language models (MLLMs) have demonstrated strong performance on geometry problems through multi-step reasoning. To better emulate human problem-solving, intermediate steps can incorporate auxiliary visual constructions, such as additional lines or points, which improve geometric interpretation and educational clarity. In this work, we introduce the GeoMathCode, where programmatic representations serve as intermediate visual outputs. We further conduct an in-depth analysis of the underlying reasoning geometry. Experimental results show that reasoning and code generation steps can be disentangled in the latent space, while supervised fine-tuning (SFT) makes the reasoning manifold more structured and informative. Moreover, hierarchical syntactic code structures emerge as disentangled latent subspaces, and contain more mathematical symbolic information than visual representations.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Spatial and embodied reasoning, one of 17 directions in LLM reasoning. Builds on 22 of its 50 references that are in the map. First posted on arXiv 25 May 2026.

Builds on

22 of 50 references.

References · 22

  1. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
  2. 2025Qwen3 Technical Reportcited by 8,820
  3. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
  4. 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiencycited by 1,510
  5. 2024LlamaFactory: Unified Efficient Fine-Tuning of 100+ Language Modelscited by 1,464
  6. 2023Steering Language Models With Activation Engineeringcited by 922
  7. 2025Emerging Properties in Unified Multimodal Pretrainingcited by 897
  8. 2024LLaVA-NeXT-Interleave: Tackling Multi-image, Video, and 3D in Large Multimodal Modelscited by 584
  9. 2022Transformer Feed-Forward Layers Build Predictions by Promoting Concepts in the Vocabulary Spacecited by 532
  10. 2022Emergent World Representations: Exploring a Sequence Model Trained on a Synthetic Taskcited by 431
  11. 2024The Platonic Representation Hypothesiscited by 382
  12. 2023Emergent Linear Representations in World Models of Self-Supervised Sequence Modelscited by 319
10 more
  1. 2023Linearity of Relation Decoding in Transformer Language Modelscited by 200
  2. 2025Reinforcement Learning for Long-Horizon Interactive LLM Agentscited by 108
  3. 2023Language Models Implement Simple Word2Vec-style Vector Arithmeticcited by 98
  4. 2022The Geometry of Multilingual Language Model Representationscited by 95
  5. 2020On the Sentence Embeddings from Pre-trained Language Modelscited by 83
  6. 2021BERT is to NLP what AlexNet is to CV: Can Pre-Trained Language Models Identify Analogies?cited by 56
  7. 2024Loss Landscape Degeneracy and Stagewise Development in Transformerscited by 40
  8. 2025MathCanvas: Intrinsic Visual Chain-of-Thought for Multimodal Mathematical Reasoningcited by 35
  9. 2025Thinking with Visual Abstract: Enhancing Multimodal Reasoning via Visual Abstractioncited by 15
  10. 2026What Really Improves Mathematical Reasoning: Structured Reasoning Signals Beyond Pure Codecited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025GeoThought: A Dataset for Enhancing Mathematical Geometry Reasoning in Vision-Language Models
  2. 2026SpatialMath: Spatial Comprehension-Infused Symbolic Reasoning for Mathematical Problem-Solving
  3. 2025GeoBench: Rethinking Multimodal Geometric Problem-Solving via Hierarchical Evaluation
  4. 2025GeoSense: Evaluating Identification and Application of Geometric Principles in Multimodal Reasoning
  5. 2025Towards Geometry Problem Solving in the Large Model Era: A Survey
  6. 2024Beyond Lines and Circles: Unveiling the Geometric Reasoning Gap in Large Language Models
  7. 2025Geoint-R1: Formalizing Multimodal Geometric Reasoning with Dynamic Auxiliary Constructions
  8. 2024GeoCoder: Solving Geometry Problems by Generating Modular Code through Vision-Language Models