mlsanityData to 7 Oct 2026

Graph Reasoning Paradigm: Structured and Symbolic Reasoning with Topology-Aware Reinforcement Learning for Large Language Models

arXiv 2601.12995 ↗First posted 19 Jan 2026cs.CLcited by 0

On the map: LLM reasoning → Knowledge- and tool-augmented reasoning

Abstract (arXiv)

Long Chain-of-Thought (LCoT), achieved by Reinforcement Learning with Verifiable Rewards (RLVR), has proven effective in enhancing the reasoning capabilities of Large Language Models (LLMs). However, reasoning in current LLMs is primarily generated as plain text, where performing semantic evaluation on such unstructured data creates a computational bottleneck during training. Despite RLVR-based optimization, existing methods still suffer from coarse-grained supervision, reward hacking, high training costs, and poor generalization. To address these issues, we propose the Graph Reasoning Paradigm (GRP), which realizes structured and symbolic reasoning, implemented via graph-structured representations with step-level cognitive labels. Building upon GRP, we further design Process-Aware Stratified Clipping Group Relative Policy Optimization (PASC-GRPO), which leverages structured evaluation to replace semantic evaluation, achieves process-aware verification through graph-structured outcome rewards, and mitigates reward hacking via stratified clipping advantage estimation. Experiments demonstrate significant improvements across mathematical reasoning and code generation tasks. Data, models, and code will be released later.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Knowledge- and tool-augmented reasoning, one of 17 directions in LLM reasoning. Builds on 25 of its 35 references that are in the map. First posted on arXiv 19 Jan 2026.

Builds on

25 of 35 references.

References · 25

  1. 2021Training Verifiers to Solve Math Word Problemscited by 9,743
  2. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
  3. 2025Qwen3 Technical Reportcited by 8,195
  4. 2021Evaluating Large Language Models Trained on Codecited by 8,053
  5. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,146
  6. 2023Let's Verify Step by Stepcited by 3,598
  7. 2021Program Synthesis with Large Language Modelscited by 3,509
  8. 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,155
  9. 2024LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Codecited by 1,906
  10. 2025Gemma 3 Technical Reportcited by 1,686
  11. 2023Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generationcited by 1,332
  12. 2024OpenAI o1 System Cardcited by 1,220
13 more
  1. 2025Towards Reasoning Era: A Survey of Long Chain-of-Thought for Reasoning Large Language Modelscited by 381
  2. 2025The Illusion of Thinking: Understanding the Strengths and Limitations of Reasoning Models via the Lens of Problem Complexitycited by 298
  3. 2025Towards Large Reasoning Models: A Survey of Reinforced Reasoning with Large Language Modelscited by 291
  4. 2024Monte Carlo Tree Search Boosts Reasoning via Iterative Preference Learningcited by 238
  5. 2025A Survey of Reinforcement Learning for Large Reasoning Modelscited by 175
  6. 2025AIMO-2 Winning Solution: Building State-of-the-Art Mathematical Reasoning Models with OpenMathReasoning datasetcited by 165
  7. 2024Free Process Rewards without Process Labelscited by 162
  8. 2024Sycophancy to Subterfuge: Investigating Reward-Tampering in Large Language Modelscited by 158
  9. 2025Competitive Programming with Large Reasoning Modelscited by 115
  10. 2024Self-Discover: Large Language Models Self-Compose Reasoning Structurescited by 108
  11. 2025Understanding Aha Moments: from External Observations to Internal Mechanismscited by 48
  12. 2025Z1: Efficient Test-time Scaling with Codecited by 35
  13. 2025Causal Consistency Regularization: Training Verifiably Sensitive Reasoning in Large Language Modelscited by 8

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025G1: Teaching LLMs to Reason on Graphs with Reinforcement Learning
  2. 2025Rewarding Graph Reasoning Process makes LLMs more Generalized Reasoners
  3. 2025Graph-R1: Incentivizing the Zero-Shot Graph Learning Capability in LLMs via Explicit Reasoning
  4. 2026GraphPO: Graph-based Policy Optimization for Reasoning Models
  5. 2025STRuCT-LLM: Unifying Tabular and Graph Reasoning with Reinforcement Learning for Semantic Parsing
  6. 2026SARL: Label-Free Reinforcement Learning by Rewarding Reasoning Topology
  7. 2026RewardFlow: Topology-Aware Reward Propagation on State Graphs for Agentic RL with Large Language Models
  8. 2025NPG-Muse: Scaling Long Chain-of-Thought Reasoning with NP-Hard Graph Problems