mlsanityData to 14 Oct 2026

Symbolic Intermediaries as a Linguistic-Numerical Interface for LLM-Driven Geometric Reasoning

arXiv 2505.17607 ↗First posted 23 May 2025cs.AI cs.CLcited by 2

On the map: LLM reasoning → Spatial and embodied reasoning

Abstract (arXiv)

Large Language Models (LLMs) display reasoning capabilities over linguistic and symbolic objects but have limited capabilities to directly interpret the continuous numerical outputs of physics simulators, e.g., distances, curvatures, and trajectories that resist discrete tokenisation. Across spatially grounded engineering reasoning tasks, from mechanism design to motion planning, this defines a fundamental gap, which limits the wider application of LLMs within broader geometrical domains, for exmaple interfacing with physics simulators. We propose symbolic intermediaries, compact analytical expressions discovered via symbolic regression, as a structured interface that translates a simulator's numerical traces into a symbolic form, which language models can interpret, compare, and critique while preserving the original geometric semantics. Around this interface we build an agentic coordination-and-refinement loop: a design agent maps natural-language specifications to executable simulation code, a critique agent reasons over the shared symbolic vocabulary, and a revision step turns this feedback into grounded refinement decisions, enabling inference-time generalization without parameter updates. On the MSynth benchmark for planar mechanism synthesis, all three evaluated LLM agents outperform a budget-matched genetic-algorithm baseline by 19-53% (up to 63% lower median error with feedback), and analysis of the critique entries across three model architectures shows that the interface shifts reasoning from generic structural commentary to grounded geometric verification. The principle of translating continuous simulation outputs into symbolic forms generalises to any domain where simulator behaviour must be interpreted linguistically.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Placed in Spatial and embodied reasoning, one of 17 directions in LLM reasoning. Builds on 30 of its 66 references that are in the map. First posted on arXiv 23 May 2025.

Builds on

30 of 66 references.

References · 30

  1. 2020Language Models are Few-Shot Learnerscited by 32,419
  2. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
  3. 2017Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networkscited by 4,897
  4. 2022Large Language Models are Zero-Shot Reasonerscited by 4,374
  5. 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,276
  6. 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,182
  7. 2023Let's Verify Step by Stepcited by 3,789
  8. 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,442
  9. 2023A Survey on Large Language Model based Autonomous Agentscited by 2,242
  10. 2023ToolLLM: Facilitating Large Language Models to Master 16000+ Real-world APIscited by 1,947
  11. 2022Rethinking the Role of Demonstrations: What Makes In-Context Learning Work?cited by 1,434
  12. 2023CAMEL: Communicative Agents for "Mind" Exploration of Large Language Model Societycited by 1,395
18 more
  1. 2022What Can Transformers Learn In-Context? A Case Study of Simple Function Classescited by 715
  2. 2019AI Feynman: a Physics-Inspired Method for Symbolic Regressioncited by 548
  3. 2019Deep symbolic regression: Recovering mathematical expressions from data via risk-seeking policy gradientscited by 309
  4. 2023SayPlan: Grounding Large Language Models using 3D Scene Graphs for Scalable Robot Task Planningcited by 294
  5. 2021Contemporary Symbolic Regression Methods and their Relative Performancecited by 215
  6. 2022End-to-end symbolic regression with transformerscited by 203
  7. 2024AgentSquare: Automatic LLM Agent Search in Modular Design Spacecited by 155
  8. 2023Transformer-based Planning for Symbolic Regressioncited by 79
  9. 2023SNIP: Bridging Mathematical Symbolic and Numeric Realms with Unified Pre-trainingcited by 47
  10. 2018The RBO Dataset of Articulated Objects and Interactionscited by 34
  11. 2024LimSim++: A Closed-Loop Platform for Deploying Multimodal LLMs in Autonomous Drivingcited by 33
  12. 2024Grounding LLMs For Robot Task Planning Using Closed-loop State Feedbackcited by 25
  13. 2024Towards Cognitive AI Systems: a Survey and Prospective on Neuro-Symbolic AIcited by 24
  14. 2024AgentKit: Structured LLM Reasoning with Dynamic Graphscited by 13
  15. 2025Retrospex: Language Agent Meets Offline Reinforcement Learning Criticcited by 12
  16. 2022LINKS: A dataset of a hundred million planar linkage mechanisms for data-driven kinematic designcited by 9
  17. 2024LInK: Learning Joint Representations of Design and Performance Spaces through Contrastive Learning for Mechanism Synthesiscited by 7
  18. 2018Learning Kinematic Descriptions using SPARE: Simulated and Physical ARticulated Extendable datasetcited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2024Beyond Lines and Circles: Unveiling the Geometric Reasoning Gap in Large Language Models
  2. 2025Enhancing the Geometric Problem-Solving Ability of Multimodal LLMs via Symbolic-Neural Integration
  3. 2026From Symbolic to Geometric: Enabling Spatial Reasoning in Large Language Models
  4. 2026GeoChallenge: A Multi-Answer Multiple-Choice Benchmark for Geometric Reasoning with Diagrams
  5. 2026Beyond Scalars: Evaluating and Understanding LLM Reasoning via Geometric Progress and Stability
  6. 2026PhysMent: An Interactive Approach For LLM Reasoning In Physics Problems
  7. 2025The Geometry of Reasoning: Flowing Logics in Representation Space
  8. 2026Euclid-Omni : A Unified Neuro-Symbolic Framework for Plane Geometry