mlsanityData to 7 Oct 2026

Non-Parametric Structural Priors for Geometry Theorem Prediction

arXiv 2603.04852 ↗First posted 5 Mar 2026cs.AI cs.CVcited by 1

Not on the map. Why?

Abstract (arXiv)

Multi-step theorem prediction is a central challenge in geometry problem solving. Existing neural-symbolic approaches rely heavily on supervised parametric models, which exhibit limited generalization to evolving theorem libraries. In this work, we explore training-free theorem prediction through the lens of in-context learning (ICL). We identify a critical scalability bottleneck, termed Structural Drift: as reasoning depth increases, the performance of vanilla ICL degrades sharply, often collapsing to near zero. We attribute this failure to the LLM's inability to recover latent topological dependencies, leading to unstructured exploration. To address this issue, we propose Theorem Precedence Graphs, which encode temporal dependencies from historical solution traces as directed graphs, and impose explicit topological constraints that effectively prune the search space during inference. Coupled with retrieval-augmented graph construction and a stepwise symbolic executor, our approach enables LLMs to act as structured planners without any gradient-based optimization. Experiments on the FormalGeo7k benchmark show that our method achieves 89.29% accuracy, substantially outperforming ICL baselines and matching state-of-the-art supervised models. These results indicate that explicit structural priors offer a promising direction for scaling LLM-based symbolic reasoning.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 29 of its 52 references that are in the map. First posted on arXiv 5 Mar 2026.

Builds on

29 of 52 references.

References · 29

  1. 2020Language Models are Few-Shot Learnerscited by 32,199
  2. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
  3. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
  4. 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,383
  5. 2025Qwen3-VL Technical Reportcited by 2,534
  6. 2020REALM: Retrieval-Augmented Language Model Pre-Trainingcited by 2,126
  7. 2024From Local to Global: A Graph RAG Approach to Query-Focused Summarizationcited by 1,411
  8. 2025DeepSeek-V3.2: Pushing the Frontier of Open Large Language Modelscited by 755
  9. 2024RAPTOR: Recursive Abstractive Processing for Tree-Organized Retrievalcited by 519
  10. 2023Faith and Fate: Limits of Transformers on Compositionalitycited by 496
  11. 2023LeanDojo: Theorem Proving with Retrieval-Augmented Language Modelscited by 414
  12. 2023The Reversal Curse: LLMs trained on "A is B" fail to learn "B is A"cited by 399
17 more
  1. 2021Inter-GPS: Interpretable Geometry Problem Solving with Formal Language and Symbolic Reasoningcited by 376
  2. 2023On the Planning Abilities of Large Language Models : A Critical Investigationcited by 308
  3. 2024HippoRAG: Neurobiologically Inspired Long-Term Memory for Large Language Modelscited by 273
  4. 2024DeepSeek-Prover: Advancing Theorem Proving in LLMs through Large-Scale Synthetic Datacited by 225
  5. 2021GeoQA: A Geometric Question Answering Benchmark Towards Multimodal Numerical Reasoningcited by 224
  6. 2022HyperTree Proof Search for Neural Theorem Provingcited by 192
  7. 2025Gold-medalist Performance in Solving Olympiad Geometry with AlphaGeometry2cited by 95
  8. 2016DeepMath - Deep Sequence Models for Premise Selectioncited by 80
  9. 2025jina-embeddings-v4: Universal Embeddings for Multimodal Multilingual Retrievalcited by 72
  10. 2024What Makes Multimodal In-Context Learning Work?cited by 54
  11. 2023LANS: A Layout-Aware Neural Solver for Plane Geometry Problemcited by 23
  12. 2024GeoX: Geometric Problem Solving Through Unified Formalized Vision-Language Pre-trainingcited by 23
  13. 2023A Symbolic Character-Aware Model for Solving Geometry Problemscited by 20
  14. 2025AutoGPS: Automated Geometry Problem Solving via Multimodal Formalization and Deductive Reasoningcited by 14
  15. 2024FGeo-HyperGNet: Geometric Problem Solving Integrating FormalGeo Symbolic System and Hypergraph Neural Networkcited by 7
  16. 2025Logic-RAG: Augmenting Large Multimodal Models with Visual-Spatial Knowledge for Road Scene Understandingcited by 6
  17. 2024FGeo-DRL: Deductive Reasoning for Geometric Problems through Deep Reinforcement Learningcited by 4

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026Dense Neuro-Symbolic Reasoning in a Unified Geometry State
  2. 2026Euclid-Omni : A Unified Neuro-Symbolic Framework for Plane Geometry
  3. 2026Verifiable Geometry Problem Solving: Solver-Driven Autoformalization and Theorem Proposing
  4. 2024A Context-Enhanced Framework for Sequential Graph Reasoning
  5. 2025Reliable Proof Generation with LLMs via Analogical Retrieval and Symbolic Verification: A Case Study in Euclidean Geometry
  6. 2026TopoBench: Benchmarking LLMs on Hard Topological Reasoning
  7. 2025GenesisGeo: Technical Report
  8. 2025Pi-GPS: Enhancing Geometry Problem Solving by Unleashing the Power of Diagrammatic Information