mlsanityData to 7 Oct 2026

Knowledge Graph-Driven Expert-Level Reasoning for Neuroscience

arXiv 2605.25183 ↗First posted 24 May 2026cs.CL cs.AIcited by 1

On the map: LLM reasoning → Knowledge- and tool-augmented reasoning

Abstract (arXiv)

Knowledge graph (KG) is an abstraction that can be extracted from text corpora and used for in-depth reasoning. Prior work has leveraged KGs to fine-tune language models (LMs), enabling domain-specific superintelligence. In this work, we explore whether KG-driven in-depth reasoning capabilities can emerge in neuroscience using only information contained within a single authoritative textbook. The central hypothesis is that structured knowledge, when distilled into a high-quality KG and converted into KG-grounded question-answer (QA) supervision, is sufficient to produce expert-level reasoning through a fine-tuned LM that surpasses large language models (LLMs) in accuracy, while employing orders of magnitude fewer parameters. We construct a textbook-derived KG via a dual-LLM validation pipeline, expand it with a masked LM trained on the KG topology, generate multi-hop QA items, which include QA pairs and reasoning traces, to fine-tune an LM exclusively on KG-derived supervision, and apply reinforcement learning using path-derived KG signals as implicit reward models. Our results demonstrate that deep, mechanistic neuroscience understanding can be induced in the model without reliance on large, heterogeneous web-scale corpora. The KG-based synthetic neuroscience curriculum that readers can quiz themselves on, and the fine-tuned LM, are available at the following GitHub location: https://kg-bottom-up-superintelligence.github.io/neuro-bench.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Knowledge- and tool-augmented reasoning, one of 17 directions in LLM reasoning. Builds on 33 of its 43 references that are in the map. First posted on arXiv 24 May 2026.

Builds on

33 of 43 references.

Closest ancestors · 1

Same direction, newest first

  1. 2026Knowledge Graphs are Implicit Reward Models: Path-Derived Signals Enable Compositional Reasoning21 Jan

Other references · 32

  1. 2020Language Models are Few-Shot Learnerscited by 32,199
  2. 2022Training language models to follow instructions with human feedbackcited by 15,712
  3. 2017Proximal Policy Optimization Algorithmscited by 14,441
  4. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  5. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
  6. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
  7. 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
  8. 2021Training Verifiers to Solve Math Word Problemscited by 9,743
  9. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
  10. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,916
  11. 2023Let's Verify Step by Stepcited by 3,598
  12. 2023Qwen Technical Reportcited by 3,273
20 more
  1. 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,155
  2. 2022Survey of Hallucination in Natural Language Generationcited by 2,056
  3. 2024Scaling LLM Test-Time Compute Optimally can be More Effective than Scaling Model Parameterscited by 1,928
  4. 2022Large Language Models Encode Clinical Knowledgecited by 1,807
  5. 2023A Survey on Hallucination in Large Language Models: Principles, Taxonomy, Challenges, and Open Questionscited by 1,582
  6. 2018Continual Lifelong Learning with Neural Networks: A Reviewcited by 1,313
  7. 2025s1: Simple test-time scalingcited by 1,311
  8. 2022Scaling Laws for Reward Model Overoptimizationcited by 1,056
  9. 2022Galactica: A Large Language Model for Sciencecited by 736
  10. 2023Unifying Large Language Models and Knowledge Graphs: A Roadmapcited by 663
  11. 2017Representation Learning on Graphs: Methods and Applicationscited by 456
  12. 2023Weak-to-Strong Generalization: Eliciting Strong Capabilities With Weak Supervisioncited by 445
  13. 2019KEPLER: A Unified Model for Knowledge Embedding and Pre-trained Language Representationcited by 356
  14. 2024Hallucination is Inevitable: An Innate Limitation of Large Language Modelscited by 329
  15. 2020Neurosymbolic AI: The 3rd Wavecited by 253
  16. 2025Sample More to Think Less: Group Filtered Policy Optimization for Concise Reasoningcited by 75
  17. 2023A Comprehensive Survey on Automatic Knowledge Graph Constructioncited by 63
  18. 2024Knowledge Graphs Meet Multi-Modal Learning: A Comprehensive Surveycited by 50
  19. 2025Bottom-up Domain-specific Superintelligence: A Reliable Knowledge Graph is What We Needcited by 12
  20. 2025GraphMERT: Efficient and Scalable Distillation of Reliable Knowledge Graphs from Unstructured Datacited by 3

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026KG-Reasoner: A Reinforced Model for End-to-End Multi-Hop Knowledge Graph Reasoning
  2. 2026Explore-on-Graph: Incentivizing Autonomous Exploration of Large Language Models on Knowledge Graphs with Path-refined Reward Modeling
  3. 2026KG-Hopper: Empowering Compact Open LLMs with Knowledge Graph Reasoning via Reinforcement Learning
  4. 2025From Symbolic to Neural and Back: Exploring Knowledge Graph-Large Language Model Synergies
  5. 2025GraphGhost: Tracing Structures Behind Large Language Models
  6. 2024LLM as Prompter: Low-resource Inductive Reasoning on Arbitrary Knowledge Graphs
  7. 2024Matching domain experts by training from scratch on domain knowledge
  8. 2025Towards Unified Neurosymbolic Reasoning on Knowledge Graphs