mlsanityData to 7 Oct 2026

Grounding Multi-Hop Reasoning in Structural Causal Models via Group Relative Policy Optimization

arXiv 2605.01482 ↗First posted 2 May 2026cs.AIcited by 0

On the map: LLM reasoning → Reasoning benchmarks and evaluation

Abstract (arXiv)

Multi-Hop Fact Verification requires complex reasoning across disparate evidence, posing significant challenges for Large Language Models , which may suffer from hallucinations and fractured logical chains. Existing methods, while improving transparency via Chain-of-Thought , often lack explicit modeling of the structural dependencies between evidence and claims. In this work, we introduce an SCM-inspired framework that grounds reasoning in explicit directed dependency graphs, treating verification as a constructive structural reasoning process rather than full causal inference with interventions or counterfactual semantics. We empirically identify an "inverted U-shaped" correlation between reasoning-chain length and accuracy, revealing that excessive structural complexity can degrade performance. To address this, we propose a rule-based reinforcement learning strategy using Group Relative Policy Optimization. This approach dynamically optimizes the trade-off between structural depth and conciseness. Extensive experiments on HoVer and EX-FEVER demonstrate that our SCM-GRPO framework outperforms strong baselines while producing more traceable reasoning structures for complex fact verification.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Reasoning benchmarks and evaluation, one of 17 directions in LLM reasoning. Builds on 54 of its 74 references that are in the map. First posted on arXiv 2 May 2026.

Builds on

54 of 74 references.

Closest ancestors · 3

Same direction, newest first

  1. 2025Qwen3 Technical Report14 May
  2. 2024The Role of Deductive and Inductive Reasoning in Large Language Models3 Oct
  3. 2023Fact-Checking Complex Claims with Program-Guided Reasoning22 May

Other references · 51

  1. 2023GPT-4 Technical Reportcited by 18,132
  2. 2022Training language models to follow instructions with human feedbackcited by 15,712
  3. 2024The Llama 3 Herd of Modelscited by 14,192
  4. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
  5. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
  6. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
  7. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,916
  8. 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,601
  9. 2022Large Language Models are Zero-Shot Reasonerscited by 4,323
  10. 2023Let's Verify Step by Stepcited by 3,598
  11. 2023Qwen Technical Reportcited by 3,273
  12. 2023Retrieval-Augmented Generation for Large Language Models: A Surveycited by 2,185
38 more
  1. 2023Self-RAG: Learning to Retrieve, Generate, and Critique through Self-Reflectioncited by 1,800
  2. 2022Least-to-Most Prompting Enables Complex Reasoning in Large Language Modelscited by 1,397
  3. 2023FActScore: Fine-grained Atomic Evaluation of Factual Precision in Long Form Text Generationcited by 1,259
  4. 2022Program of Thoughts Prompting: Disentangling Computation from Reasoning for Numerical Reasoning Taskscited by 1,057
  5. 2023Graph of Thoughts: Solving Elaborate Problems with Large Language Modelscited by 873
  6. 2023SelfCheckGPT: Zero-Resource Black-Box Hallucination Detection for Generative Large Language Modelscited by 787
  7. 2023Siren's Song in the AI Ocean: A Survey on Hallucination in Large Language Modelscited by 695
  8. 2023Active Retrieval Augmented Generationcited by 506
  9. 2025Search-o1: Agentic Search-Enhanced Large Reasoning Modelscited by 423
  10. 2021Causal Abstractions of Neural Networkscited by 401
  11. 2021A Survey on Automated Fact-Checkingcited by 376
  12. 2023MQuAKE: Assessing Knowledge Editing in Language Models via Multi-Hop Questionscited by 292
  13. 2023Faithful Chain-of-Thought Reasoningcited by 285
  14. 2020HoVer: A Dataset for Many-Hop Fact Extraction And Claim Verificationcited by 199
  15. 2024Corrective Retrieval Augmented Generationcited by 187
  16. 2021Causal Inference in Natural Language Processing: Estimation, Prediction, Interpretation and Beyondcited by 177
  17. 2023AnnoLLM: Making Large Language Models to Be Better Crowdsourced Annotatorscited by 171
  18. 2021FEVEROUS: Fact Extraction and VERification Over Unstructured and Structured informationcited by 166
  19. 2023Verify-and-Edit: A Knowledge-Enhanced Chain-of-Thought Frameworkcited by 139
  20. 2023OpenICL: An Open-Source Framework for In-context Learningcited by 51
  21. 2025OFFSET: Segmentation-based Focus Shift Revision for Composed Image Retrievalcited by 40
  22. 2026ReTrack: Evidence-Driven Dual-Stream Directional Anchor Calibration Network for Composed Video Retrievalcited by 39
  23. 2023Halo: Estimation and Reduction of Hallucinations in Open-Source Weak Large Language Modelscited by 36
  24. 2023EX-FEVER: A Dataset for Multi-hop Explainable Fact Verificationcited by 36
  25. 2025HUD: Hierarchical Uncertainty-Aware Disambiguation Network for Composed Video Retrievalcited by 32
  26. 2024Scaling Law for Time Series Forecastingcited by 31
  27. 2024Human Motion Instruction Tuningcited by 29
  28. 2023CPSeg: Finer-grained Image Semantic Segmentation via Chain-of-Thought Language Promptingcited by 28
  29. 2026STABLE: Efficient Hybrid Nearest Neighbor Search via Magnitude-Uniformity and Cardinality-Robustnesscited by 26
  30. 2026INTENT: Invariance and Discrimination-aware Noise Mitigation for Robust Composed Image Retrievalcited by 26
  31. 2026HABIT: Chrono-Synergia Robust Progressive Learning Framework for Composed Image Retrievalcited by 24
  32. 2025Intrinsic Entropy of Context Length Scaling in LLMscited by 14
  33. 2025CountLLM: Towards Generalizable Repetitive Action Counting via Large Language Modelcited by 13
  34. 2024Graph Canvas for Controllable 3D Scene Generationcited by 11
  35. 2025Bayesian Optimization for Controlled Image Editing via LLMscited by 11
  36. 2026RAM: Recover Any 3D Human Motion in-the-Wildcited by 11
  37. 2025UniHOI: Unified Human-Object Interaction Understanding via Unified Token Spacecited by 10
  38. 2025Learning an Efficient Optimizer via Hybrid-Policy Sub-Trajectory Balancecited by 5

50 most cited of 51 All 51 (JSON)

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Reasoning Paths as Signals: Augmenting Multi-hop Fact Verification through Structural Reasoning Progression
  2. 2026ReflectFact: Self-Reflective Agents for Improving Comprehension and Reasoning in Multi-Hop Fact Verification
  3. 2024Causal Walk: Debiasing Multi-Hop Fact Verification with Front-Door Adjustment
  4. 2026REALHOP: Rethinking Multi-Hop Reasoning Evaluation via Behavioral Auditing
  5. 2025Trustworthy Reasoning: Evaluating and Enhancing Factual Accuracy in LLM Intermediate Thought Processes
  6. 2025Causal Reasoning in Pieces: Modular In-Context Learning for Causal Discovery
  7. 2026Can David Beat Goliath? On Multi-Hop Reasoning with Resource-Constrained Agents
  8. 2024CHECKWHY: Causal Fact Verification via Argument Structure