mlsanityData to 7 Oct 2026

KG-Augmented Executable CoT for Mathematical Coding

arXiv 2508.04072 ↗First posted 6 Aug 2025cs.AIcited by 1

On the map: LLM reasoning → Mathematical reasoning

Abstract (arXiv)

In recent years, large language models (LLMs) have excelled in natural language processing tasks but face significant challenges in complex reasoning tasks such as mathematical reasoning and code generation. To address these limitations, we propose KG-Augmented Executable Chain-of-Thought (KGA-ECoT), a novel framework that enhances code generation through knowledge graphs and improves mathematical reasoning via executable code. KGA-ECoT decomposes problems into a Structured Task Graph, leverages efficient GraphRAG for precise knowledge retrieval from mathematical libraries, and generates verifiable code to ensure computational accuracy. Evaluations on multiple mathematical reasoning benchmarks demonstrate that KGA-ECoT significantly outperforms existing prompting methods, achieving absolute accuracy improvements ranging from several to over ten percentage points. Further analysis confirms the critical roles of GraphRAG in enhancing code quality and external code execution in ensuring precision. These findings collectively establish KGA-ECoT as a robust and highly generalizable framework for complex mathematical reasoning tasks.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Mathematical reasoning, one of 17 directions in LLM reasoning. Builds on 27 of its 34 references that are in the map. First posted on arXiv 6 Aug 2025.

Builds on

27 of 34 references.

References · 27

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2020Language Models are Few-Shot Learnerscited by 32,199
  3. 2022Training language models to follow instructions with human feedbackcited by 15,712
  4. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
  5. 2021Training Verifiers to Solve Math Word Problemscited by 9,743
  6. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
  7. 2016SQuAD: 100,000+ Questions for Machine Comprehension of Textcited by 4,115
  8. 2023Let's Verify Step by Stepcited by 3,598
  9. 2024From Local to Global: A Graph RAG Approach to Query-Focused Summarizationcited by 1,411
  10. 2023Graph of Thoughts: Solving Elaborate Problems with Large Language Modelscited by 873
  11. 2021Show Your Work: Scratchpads for Intermediate Computation with Language Modelscited by 871
  12. 2021Are NLP Models really able to Solve Simple Math Word Problems?cited by 861
15 more
  1. 2023ExpeL: LLM Agents Are Experiential Learnerscited by 814
  2. 2023Plan-and-Solve Prompting: Improving Zero-Shot Chain-of-Thought Reasoning by Large Language Modelscited by 550
  3. 2023Understanding the Effects of RLHF on LLM Generalisation and Diversitycited by 386
  4. 2023A Survey on Large Language Model (LLM) Security and Privacy: The Good, the Bad, and the Uglycited by 380
  5. 2018From Louvain to Leiden: guaranteeing well-connected communitiescited by 379
  6. 2024Graph Retrieval-Augmented Generation: A Surveycited by 320
  7. 2023LLM-Adapters: An Adapter Family for Parameter-Efficient Fine-Tuning of Large Language Modelscited by 317
  8. 2024To CoT or not to CoT? Chain-of-thought helps mainly on math and symbolic reasoningcited by 257
  9. 2023Can ChatGPT Defend its Belief in Truth? Evaluating LLM Reasoning via Debatecited by 92
  10. 2023Knowledge Graphs: Opportunities and Challengescited by 70
  11. 2020Co-embedding of Nodes and Edges with Graph Neural Networkscited by 30
  12. 2024Unlocking Reasoning Potential in Large Langauge Models by Scaling Code-form Planningcited by 24
  13. 2024Latent Reward: LLM-Empowered Credit Assignment in Episodic Reinforcement Learningcited by 22
  14. 2024Robust Pronoun Fidelity with English LLMs: Are they Reasoning, Repeating, or Just Biased?cited by 17
  15. 2024Autonomous LLM-Enhanced Adversarial Attack for Text-to-Motioncited by 7

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2024CoMAT: Chain of Mathematically Annotated Thought Improves Mathematical Reasoning
  2. 2025Scaling Code-Assisted Chain-of-Thoughts and Instructions for Model Reasoning
  3. 2023Evaluating and Improving Tool-Augmented Computation-Intensive Math Reasoning
  4. 2023MathCoder: Seamless Code Integration in LLMs for Enhanced Mathematical Reasoning
  5. 2025Evaluating Intermediate Reasoning of Code-Assisted Large Language Models for Mathematics
  6. 2025Scaling Natural-Language Graph-Based Test Time Compute for Automated Theorem Proving
  7. 2025MedRule-KG: A Knowledge-Graph--Steered Scaffold for Mathematical Reasoning with a Lightweight Verifier
  8. 2025Premise-Augmented Reasoning Chains Improve Error Identification in Math reasoning with LLMs