Inverse Knowledge Search over Verifiable Reasoning: Synthesizing a Scientific Encyclopedia from a Long Chains-of-Thought Knowledge Base
On the map: LLM reasoning → Knowledge- and tool-augmented reasoning
Abstract (arXiv)
Most scientific materials compress reasoning, presenting conclusions while omitting the derivational chains that justify them. This compression hinders verification by lacking explicit, step-wise justifications and inhibits cross-domain links by collapsing the very pathways that establish the logical and causal connections between concepts. We introduce a scalable framework that decompresses scientific reasoning, constructing a verifiable Long Chain-of-Thought (LCoT) knowledge base and projecting it into an emergent encyclopedia, SciencePedia. Our pipeline operationalizes an endpoint-driven, reductionist strategy: a Socratic agent, guided by a curriculum of around 200 courses, generates approximately 3 million first-principles questions. To ensure high fidelity, multiple independent solver models generate LCoTs, which are then rigorously filtered by prompt sanitization and cross-model answer consensus, retaining only those with verifiable endpoints. This verified corpus powers the Brainstorm Search Engine, which performs inverse knowledge search -- retrieving diverse, first-principles derivations that culminate in a target concept. This engine, in turn, feeds the Plato synthesizer, which narrates these verified chains into coherent articles. The initial SciencePedia comprises approximately 200,000 fine-grained entries spanning mathematics, physics, chemistry, biology, engineering, and computation. In evaluations across six disciplines, Plato-synthesized articles (conditioned on retrieved LCoTs) exhibit substantially higher knowledge-point density and significantly lower factual error rates than an equally-prompted baseline without retrieval (as judged by an external LLM). Built on this verifiable LCoT knowledge base, this reasoning-centric approach enables trustworthy, cross-domain scientific synthesis at scale and establishes the foundation for an ever-expanding encyclopedia.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Placed in Knowledge- and tool-augmented reasoning, one of 17 directions in LLM reasoning. Builds on 26 of its 51 references that are in the map. First posted on arXiv 30 Oct 2025.
Builds on
26 of 51 references.
References · 26
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
- 2015Distilling the Knowledge in a Neural Networkcited by 10,324
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
- 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,442
- 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,211
- 2022Survey of Hallucination in Natural Language Generationcited by 2,075
- 2019Language Models as Knowledge Bases?cited by 1,936
- 2020Knowledge Distillation: A Surveycited by 1,603
- 2025Kimi k1.5: Scaling Reinforcement Learning with LLMscited by 1,210
- 2021Retrieval Augmentation Reduces Hallucination in Conversationcited by 692
14 more
- 2022Towards Reasoning in Large Language Models: A Surveycited by 596
- 2023Logic-LM: Empowering Large Language Models with Symbolic Solvers for Faithful Logical Reasoningcited by 391
- 2022A Survey of Knowledge Graph Reasoning on Graph Types: Static, Dynamic, and Multimodalcited by 106
- 2021Increasing Faithfulness in Knowledge-Grounded Dialogue with Controllable Featurescited by 74
- 2024Dated Data: Tracing Knowledge Cutoffs in Large Language Modelscited by 51
- 2022Automatic Generation of Socratic Subquestions for Teaching Math Word Problemscited by 43
- 2022Large Language Models and the Reverse Turing Testcited by 38
- 2023Logical Reasoning over Natural Language as Knowledge Representation: A Surveycited by 32
- 2014Scalable detection of statistically significant communities and hierarchies, using message-passing for modularitycited by 16
- 2024Improving Socratic Question Generation using Data Augmentation and Preference Optimizationcited by 16
- 2025Emergent Slow Thinking in LLMs as Inverse Tree Freezingcited by 8
- 2024Language-Agnostic Modeling of Wikipedia Articles for Content Quality Assessment across Languagescited by 6
- 2025Learning-at-Criticality in Large Language Models for Quantum Field Theory and Beyondcited by 5
- 2018Weighted Community Detection and Data Clustering Using Message Passingcited by 3
Built on by
Citing papers per year: 2025: 1; 2026: 1.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2026Large Knowledge Model: From Papers to a Scientific Reasoning Landscape
- 2026SPARK: Skeleton-Guided Reasoning Synthesis from Large-Scale Scientific Literature
- 2025Thinking About Thinking: SAGE-nano's Inverse Reasoning for Self-Aware Language Models
- 2026From Papers to Mechanisms: An Evidence-Grounded Knowledge Substrate for Scientific Language Models
- 2026FALSIFYBENCH: Evaluating Inductive Reasoning in LLMs with Rule Discovery Games
- 2025OmniScience: A Domain-Specialized LLM for Scientific Reasoning and Discovery
- 2026IsoSci: A Benchmark of Isomorphic Cross-Domain Science Problems for Evaluating Reasoning versus Knowledge Retrieval in LLMs
- 2025SCI-Verifier: Scientific Verifier with Thinking