mlsanityData to 14 Oct 2026

Graphs of Research: Citation Evolution Graphs as Supervision for Research Idea Generation

arXiv 2605.14790 ↗First posted 14 May 2026cs.CL cs.AIcited by 1

Not on the map. Why?

Abstract (arXiv)

Research idea generation is the innovation-driving step of automated scientific research. Recently, large language models (LLMs) have shown potential for automating idea generation at scale. However, existing methods mainly condition LLMs on eliciting idea generation through static retrieval of relevant literature or complex prompt engineering, without discarding the structural relations among references. We propose Graphs of Research (GoR), a supervised fine-tuning method that extracts a 2-hop reference neighborhood for each seed paper, derives the relations among those references from citation position, frequency, predecessor links, and publication time, and organizes them into a paper-evolution directed acyclic graph (DAG). We construct an automated extraction pipeline that draws data from five major ML/NLP venues, comprising 498/50/50 train/validation/test seed papers and approximately 7,600 cited references. Qwen2.5-7B-Instruct-1M is fine-tuned on a structured-text prompt that includes the citation graph, edge signals, reference information, and task definition to predict the idea for the seed paper. Across head-to-head LLM-judge tournaments against gpt-4o-driven baselines, GoR-SFT achieves SOTA, demonstrating the effectiveness of citation-evolution graphs as supervision signal for LLM-based idea generation. We hope that this reduces the barrier for citation evolution graphs as a supervision, accelerating automated scientific innovation.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 26 of its 38 references that are in the map. First posted on arXiv 14 May 2026.

Builds on

26 of 38 references.

References · 26

  1. 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,944
  2. 2019BERTScore: Evaluating Text Generation with BERTcited by 5,512
  3. 2020DeBERTa: Decoding-enhanced BERT with Disentangled Attentioncited by 2,181
  4. 2024The AI Scientist: Towards Fully Automated Open-Ended Scientific Discoverycited by 1,071
  5. 2025Does Reinforcement Learning Really Incentivize Reasoning Capacity in LLMs Beyond the Base Model?cited by 982
  6. 2024BigCodeBench: Benchmarking Code Generation with Diverse Function Calls and Complex Instructionscited by 546
  7. 2024MLE-bench: Evaluating Machine Learning Agents on Machine Learning Engineeringcited by 469
  8. 2025Agent Laboratory: Using LLM Agents as Research Assistantscited by 425
  9. 2025The AI Scientist-v2: Workshop-Level Automated Scientific Discovery via Agentic Tree Searchcited by 422
  10. 2024Can LLMs Generate Novel Research Ideas? A Large-Scale Human Study with 100+ NLP Researcherscited by 363
  11. 2024LightRAG: Simple and Fast Retrieval-Augmented Generationcited by 315
  12. 2025rStar-Math: Small LLMs Can Master Math Reasoning with Self-Evolved Deep Thinkingcited by 313
14 more
  1. 2024HippoRAG: Neurobiologically Inspired Long-Term Memory for Large Language Modelscited by 281
  2. 2023GraphGPT: Graph Instruction Tuning for Large Language Modelscited by 226
  3. 2024ResearchAgent: Iterative Research Idea Generation over Scientific Literature with Large Language Modelscited by 210
  4. 2024LLaGA: Large Language and Graph Assistantcited by 181
  5. 2023SciMON: Scientific Inspiration Machines Optimized for Noveltycited by 179
  6. 2024CycleResearcher: Improving Automated Research via Automated Reviewcited by 148
  7. 2024Liger Kernel: Efficient Triton Kernels for LLM Trainingcited by 130
  8. 2022SciRepEval: A Multi-Format Benchmark for Scientific Document Representationscited by 129
  9. 2023The Semantic Scholar Open Data Platformcited by 118
  10. 2025SWE-Lancer: Can Frontier LLMs Earn 1 Million from Real-World Freelance Software Engineering?cited by 105
  11. 2024Nova: An Iterative Planning and Search Approach to Enhance Novelty and Diversity of LLM Generated Ideascited by 57
  12. 2020AGATHA: Automatic Graph-mining And Transformer based Hypothesis generation Approachcited by 21
  13. 2025AbGen: Evaluating Large Language Models in Ablation Study Design and Evaluation for Scientific Researchcited by 13
  14. 2026FlowPIE: Test-Time Scientific Idea Evolution with Flow-Guided Literature Explorationcited by 3

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.