mlsanityData to 7 Oct 2026

HyGRAIL: Cost-Aware and Evidence-Grounded Scientific Hypothesis Discovery over Knowledge Graphs

arXiv 2609.02056 ↗First posted 2 Sep 2026cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

Scientific knowledge graphs organize entities and relations extracted from scientific literature, but they remain inherently incomplete. Missing typed links in such graphs can therefore represent plausible scientific hypotheses, such as unexplored associations between materials and applications. However, scientific hypothesis discovery is challenging because true discoveries are extremely sparse among typed candidate pairs: graph neural networks (GNNs) are efficient but unreliable for ambiguous cases, while large language models (LLMs) are knowledgeable but too costly to apply exhaustively and are not naturally grounded in graph structures. We propose HyGRAIL, a cost-aware and evidence-grounded framework that combines heterogeneous GNN triage with LLM-based hypothesis review. HyGRAIL first uses a GNN to score candidate hypotheses and identify a validation-calibrated ambiguous region, routing only graph-uncertain cases to LLM review. For each routed hypothesis, HyGRAIL retrieves node-level associations and multi-hop relational paths from the knowledge graph (KG), then converts this structured evidence into natural language through template-based or LLM-based naturalization. An LLM review agent finally judges each hard hypothesis using the naturalized evidence and validation-selected decision criteria. On MatKG, HyGRAIL achieves the best F1 score of 0.429, improving over the strongest prior baseline by 0.242 F1 points and over the GNN-only baseline by 0.322. Meanwhile, GNN triage reduces the LLM call rate by 54.36% on average. Ablation studies further show that retrieved graph evidence is crucial for reliable hypothesis verification and that compact, two-sided evidence is more effective than simply increasing retrieval quantity.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 23 of its 46 references that are in the map. First posted on arXiv 2 Sep 2026.

Builds on

23 of 46 references.

References · 23

  1. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
  2. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,393
  3. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
  4. 2020Dense Passage Retrieval for Open-Domain Question Answeringcited by 3,779
  5. 2020REALM: Retrieval-Augmented Language Model Pre-Trainingcited by 2,126
  6. 2017Modeling Relational Data with Graph Convolutional Networkscited by 1,684
  7. 2014Embedding Entities and Relations for Learning and Inference in Knowledge Basescited by 929
  8. 2023Just Ask for Calibration: Strategies for Eliciting Calibrated Confidence Scores from Language Models Fine-Tuned with Human Feedbackcited by 788
  9. 2019Heterogeneous Graph Attention Networkcited by 732
  10. 2020Heterogeneous Graph Transformercited by 581
  11. 2018SimplE Embedding for Link Prediction in Knowledge Graphscited by 195
  12. 2017Go for a Walk and Arrive at the Answer: Reasoning Over Paths in Knowledge Bases using Reinforcement Learningcited by 161
11 more
  1. 2020Investigating Pretrained Language Models for Graph-to-Text Generationcited by 117
  2. 2021Be Confident! Towards Trustworthy Graph Neural Networks via Confidence Calibrationcited by 91
  3. 2024MOOSE-Chem: Large Language Models for Rediscovering Unseen Chemistry Scientific Hypothesescited by 68
  4. 2023Large Language Models for Scientific Synthesis, Inference and Explanationcited by 38
  5. 2015Compositional Vector Space Models for Knowledge Base Completioncited by 33
  6. 2024Large Language Models as Biomedical Hypothesis Generators: A Comprehensive Evaluationcited by 33
  7. 2017Analysis of the Impact of Negative Sampling on Link Prediction in Knowledge Graphscited by 22
  8. 2020AGATHA: Automatic Graph-mining And Transformer based Hypothesis generation Approachcited by 21
  9. 2023Graph Meets LLMs: Towards Large Graph Modelscited by 19
  10. 2024GraphInsight: Unlocking Insights in Large Language Models for Graph Structure Understandingcited by 18
  11. 2025Predicting New Research Directions in Materials Science using Large Language Models and Concept Graphscited by 9

Built on by

Not cited yet.