# The Discovery Engine: A Framework for AI-Driven Synthesis and Navigation of Scientific Knowledge Landscapes

arXiv: https://arxiv.org/abs/2505.17500 · HTML: https://mlsanity.com/paper/2505.17500/

## Key facts

- Cited by 4 papers in the map (data through 14 Oct 2026).
- Builds on 25 of its 63 references that are in the map.
- First posted on arXiv 23 May 2025.

## Builds on (most cited first, 25 of 25)

- [Geometric Deep Learning: Grids, Groups, Graphs, Geodesics, and Gauges](https://mlsanity.com/paper/2104.13478/) (2021)
- [A Primer in BERTology: What we know about how BERT works](https://mlsanity.com/paper/2002.12327/) (2020)
- [BERTopic: Neural topic modeling with a class-based TF-IDF procedure](https://mlsanity.com/paper/2203.05794/) (2022)
- [Fine-tuning large language models for domain adaptation: Exploration of training strategies, scaling, model merging and synergistic capabilities](https://mlsanity.com/paper/2409.03444/) (2024)
- [Human-Level Reinforcement Learning through Theory-Based Modeling, Exploration, and Planning](https://mlsanity.com/paper/2107.12544/) (2021)
- [Computing on Functions Using Randomized Vector Representations](https://mlsanity.com/paper/2109.03429/) (2021)
- [Vector Symbolic Architectures as a Computing Framework for Emerging Hardware](https://mlsanity.com/paper/2106.05268/) (2021)
- [Neural Graph Reasoning: Complex Logical Query Answering Meets Graph Databases](https://mlsanity.com/paper/2303.14617/) (2023)
- [Agentic Deep Graph Reasoning Yields Self-Organizing Knowledge Networks](https://mlsanity.com/paper/2502.13025/) (2025)
- [An Ecosystem for Personal Knowledge Graphs: A Survey and Research Roadmap](https://mlsanity.com/paper/2304.09572/) (2023)
- [Knowledge Graphs in Practice: Characterizing their Users, Challenges, and Visualization Opportunities](https://mlsanity.com/paper/2304.01311/) (2023)
- [A Preliminary Roadmap for LLMs as Assistants in Exploring, Analyzing, and Visualizing Knowledge Graphs](https://mlsanity.com/paper/2404.01425/) (2024)
- [AGENTiGraph: An Interactive Knowledge Graph Platform for LLM-based Chatbots Utilizing Private Data](https://mlsanity.com/paper/2410.11531/) (2024)
- [Patterns for Representing Knowledge Graphs to Communicate Situational Knowledge of Service Robots](https://mlsanity.com/paper/2101.10602/) (2021)
- [Graph-Aware Isomorphic Attention for Adaptive Dynamics in Transformers](https://mlsanity.com/paper/2501.02393/) (2025)
- [A Computational Theory for Life-Long Learning of Semantics](https://mlsanity.com/paper/1806.10755/) (2018)
- [A Categorical Framework of General Intelligence](https://mlsanity.com/paper/2303.04571/) (2023)
- [Categories of Semantic Concepts](https://mlsanity.com/paper/2004.10741/) (2020)
- [Hierarchical Knowledge Graphs: A Novel Information Representation for Exploratory Search Tasks](https://mlsanity.com/paper/2005.01716/) (2020)
- [Limited Diffusion of Scientific Knowledge Forecasts Collapse](https://mlsanity.com/paper/2304.07468/) (2023)
- [Token Space: A Category Theory Framework for AI Computations](https://mlsanity.com/paper/2404.11624/) (2024)
- [A Theoretical Approach for Structuring and Analysing Knowledge Provenance for Visual Analytics](https://mlsanity.com/paper/2204.00585/) (2022)
- [To Classify is to Interpret: Building Taxonomies from Heterogeneous Data through Human-AI Collaboration](https://mlsanity.com/paper/2307.16481/) (2023)
- [The two-way knowledge interaction interface between humans and neural networks](https://mlsanity.com/paper/2401.05461/) (2024)
- [40 Years of Interdisciplinary Research: Phases, Origins, and Key Turning Points (1981-2020)](https://mlsanity.com/paper/2501.05001/) (2025)

## Built on by (most cited first, 4 of 4)

- [The Last Human-Written Paper: Agent-Native Research Artifacts](https://mlsanity.com/paper/2604.24658/) (2026)
- [SciResearcher: Scaling Deep Research Agents for Frontier Scientific Reasoning](https://mlsanity.com/paper/2605.01489/) (2026)
- [Large Knowledge Model: From Papers to a Scientific Reasoning Landscape](https://mlsanity.com/paper/2609.27297/) (2026)
- [Is the `Agent' Paradigm a Limiting Framework for Next-Generation Intelligent Systems?](https://mlsanity.com/paper/2509.10875/) (2025)

## Abstract (arXiv)

The prevailing model for disseminating scientific knowledge relies on individual publications dispersed across numerous journals and archives. This legacy system is ill suited to the recent exponential proliferation of publications, contributing to insurmountable information overload, issues surrounding reproducibility and retractions. We introduce the Discovery Engine, a framework to address these challenges by transforming an array of disconnected literature into a unified, computationally tractable representation of a scientific domain. Central to our approach is the LLM-driven distillation of publications into structured "knowledge artifacts," instances of a universal conceptual schema, complete with verifiable links to source evidence. These artifacts are then encoded into a high-dimensional Conceptual Tensor. This tensor serves as the primary, compressed representation of the synthesized field, where its labeled modes index scientific components (concepts, methods, parameters, relations) and its entries quantify their interdependencies. The Discovery Engine allows dynamic "unrolling" of this tensor into human-interpretable views, such as explicit knowledge graphs (the CNM graph) or semantic vector spaces, for targeted exploration. Crucially, AI agents operate directly on the graph using abstract mathematical and learned operations to navigate the knowledge landscape, identify non-obvious connections, pinpoint gaps, and assist researchers in generating novel knowledge artifacts (hypotheses, designs). By converting literature into a structured tensor and enabling agent-based interaction with this compact representation, the Discovery Engine offers a new paradigm for AI-augmented scientific inquiry and accelerated discovery.