mlsanityData to 7 Oct 2026

GRAFT: Graph-Distilled Generative Retrieval for Facet-Aware Scientific Literature Exploration

arXiv 2608.22381 ↗First posted 23 Aug 2026cs.IR cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

Scientific papers may relate by problem, method, result, or contribution, but document-level retrievers collapse these into a single similarity score without saying why they are related. Citation- and similarity-based retrieval alone also confines search to the neighbourhood of what is already known, whereas generative retrieval generates document identifiers directly, enabling the exploratory retrieval that scientific discovery depends on. We connect papers in a graph whose edges are typed by these four facets, derived from facet items and citation signals, and distil it into a generative retriever whose identifiers are the papers' own facet text. Two graph properties do not survive naive distillation. First, because every training pair is an edge, naive enumeration indexes just 84% of the corpus. Coverage-aware distillation makes every paper learnable through a reverse-neighbour fallback, a minimum-coverage threshold, and edge-importance weighting. Second, constrained decoding guarantees that every generated identifier is a valid paper, but not that the graph connects it to the query. Graph-weighted reciprocal rank fusion scales each candidate's rank term by its query-candidate edge weight, dropping unsupported ones. On LitWeave, our constructed corpus of 11,359 NLP papers, Graft recovers 91% of its graph teacher's Recall@20 with no nearest-neighbour index or encoder at inference, and outperforms the graph teacher on query papers outside the corpus. It reproduces the graph's own facet labels at 0.922 precision, so every returned paper arrives labelled with the facet that surfaced it rather than an opaque score.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 36 of its 53 references that are in the map. First posted on arXiv 23 Aug 2026.

Builds on

36 of 53 references.

References · 36

  1. 2024The Llama 3 Herd of Modelscited by 14,192
  2. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
  3. 2020Dense Passage Retrieval for Open-Domain Question Answeringcited by 3,779
  4. 2020ColBERT: Efficient and Effective Passage Search via Contextualized Late Interaction over BERTcited by 1,160
  5. 2024The AI Scientist: Towards Fully Automated Open-Ended Scientific Discoverycited by 1,002
  6. 2020SPECTER: Document-level Representation Learning using Citation-informed Transformerscited by 426
  7. 2024Can LLMs Generate Novel Research Ideas? A Large-Scale Human Study with 100+ NLP Researcherscited by 348
  8. 2022Transformer Memory as a Differentiable Search Indexcited by 242
  9. 2023Recommender Systems with Generative Retrievalcited by 191
  10. 2023SciMON: Scientific Inspiration Machines Optimized for Noveltycited by 174
  11. 2022SciRepEval: A Multi-Format Benchmark for Scientific Document Representationscited by 124
  12. 2024AutoSurvey: Large Language Models Can Automatically Write Surveyscited by 116
24 more
  1. 2022Autoregressive Search Engines: Generating Substrings as Document Identifierscited by 112
  2. 2022A Neural Corpus Indexer for Document Retrievalcited by 107
  3. 2024SciAgents: Automating scientific discovery through multi-agent intelligent graph reasoningcited by 90
  4. 2022Neighborhood Contrastive Learning for Scientific Document Representations with Citation Embeddingscited by 75
  5. 2022Bridging the Gap Between Indexing and Retrieval for Differentiable Search Index with Query Generationcited by 47
  6. 2025SurveyForge: On the Outline Heuristics, Memory-Driven Generation, and Multi-dimensional Evaluation for Automated Survey Writingcited by 47
  7. 2022CorpusBrain: Pre-train a Generative Retrieval Model for Knowledge-Intensive Language Taskscited by 36
  8. 2021Multi-Vector Models with Textual Guidance for Fine-Grained Scientific Document Similaritycited by 35
  9. 2022DSI++: Updating Transformer Memory with New Documentscited by 35
  10. 2022Ultron: An Ultimate Retriever on Corpus with a Model-based Indexercited by 30
  11. 2024Evaluating and Enhancing Large Language Models for Novelty Assessment in Scholarly Publicationscited by 26
  12. 2020Aspect-based Document Similarity for Research Paperscited by 21
  13. 2024Generating Interesting Scientific Ideas using Knowledge Graphs and LLMs: Evaluations with 100 Research Group Leaderscited by 21
  14. 2023GLEN: Generative Retrieval via Lexical Index Learningcited by 17
  15. 2025Literature-Grounded Novelty Assessment of Scientific Ideascited by 17
  16. 2024CEval: A Benchmark for Evaluating Counterfactual Text Generationcited by 15
  17. 2025YESciEval: Robust LLM-as-a-Judge for Scientific Question Answeringcited by 15
  18. 2025Scientific Paper Retrieval with LLM-Guided Semantic-Based Rankingcited by 10
  19. 2025Lightweight and Direct Document Relevance Optimization for Generative Information Retrievalcited by 9
  20. 2026NovBench: Evaluating Large Language Models on Academic Paper Novelty Assessmentcited by 6
  21. 2025Constrained Auto-Regressive Decoding Constrains Generative Retrievalcited by 5
  22. 2025Purely Semantic Indexing for LLM-based Generative Recommendation and Retrievalcited by 2
  23. 2025C2T-ID: Converting Semantic Codebooks to Textual Document Identifiers for Generative Searchcited by 2
  24. 2025CASPER: Concept-integrated Sparse Representation for Scientific Retrievalcited by 1

Built on by

Not cited yet.