Exploring and Verbalizing Academic Ideas by Concept Co-occurrence
Not on the map. Why?
Abstract (arXiv)
Researchers usually come up with new ideas only after thoroughly comprehending vast quantities of literature. The difficulty of this procedure is exacerbated by the fact that the number of academic publications is growing exponentially. In this study, we devise a framework based on concept co-occurrence for academic idea inspiration, which has been integrated into a research assistant system. From our perspective, the fusion of two concepts that co-occur in an academic paper can be regarded as an important way of the emergence of a new idea. We construct evolving concept graphs according to the co-occurrence relationship of concepts from 20 disciplines or topics. Then we design a temporal link prediction method based on masked language model to explore potential connections between different concepts. To verbalize the newly discovered connections, we also utilize the pretrained language model to generate a description of an idea based on a new data structure called co-occurrence citation quintuple. We evaluate our proposed system using both automatic metrics and human assessment. The results demonstrate that our system has broad prospects and can assist researchers in expediting the process of discovering new ideas.
Key facts. Cited by 8 papers in the map (data through 14 Oct 2026). Builds on 22 of its 39 references that are in the map. First posted on arXiv 4 Jun 2023.
Builds on
22 of 39 references.
References · 22
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,361
- 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,893
- 2021Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processingcited by 2,234
- 2019Language Models as Knowledge Bases?cited by 1,936
- 2018Hierarchical Neural Story Generationcited by 1,193
- 2022Galactica: A Large Language Model for Sciencecited by 744
- 2019EvolveGCN: Evolving Graph Convolutional Networks for Dynamic Graphscited by 447
- 2016How NOT To Evaluate Your Dialogue System: An Empirical Study of Unsupervised Evaluation Metrics for Dialogue Response Generationcited by 356
- 2019KG-BERT: BERT for Knowledge Graph Completioncited by 324
- 2016A Persona-Based Neural Conversation Modelcited by 223
10 more
- 2020Foundations and modelling of dynamic networks using Dynamic Graph Neural Networks: A surveycited by 124
- 2020A Survey of Knowledge-Enhanced Text Generationcited by 120
- 2020Language Models are Open Knowledge Graphscited by 95
- 2017Automated Phrase Mining from Massive Text Corporacited by 70
- 2019GCN-GAN: A Non-linear Temporal Link Prediction Model for Weighted Dynamic Networkscited by 40
- 2019PaperRobot: Incremental Draft Generation of Scientific Ideascited by 37
- 2019Predicting Research Trends with Semantic and Neural Networks with an application in Quantum Physicscited by 25
- 2022Multi-task Pre-training Language Model for Semantic Network Completioncited by 15
- 2021A Search Engine for Discovery of Scientific Challenges and Directionscited by 12
- 2021How to Train Your Agent to Read and Writecited by 2
Built on by
Citing papers per year: 2023: 2; 2024: 3; 2025: 2; 2026: 1.
8 papers.
- 2023K2: A Foundation Language Model for Geoscience Knowledge Understanding and Utilizationcited by 69
- 2024Can Large Language Models Unlock Novel Scientific Research Ideas?cited by 24
- 2025HypER: Literature-grounded Hypothesis Generation and Distillation with Provenancecited by 10
- 2025Evolving Roles of LLMs in Scientific Innovation: Assistant, Collaborator, Scientist, and Evaluatorcited by 9
- 2024Good Idea or Not, Representation of LLM Could Tellcited by 6
- 2024AceMap: Knowledge Discovery through Academic Graphcited by 2
- 2026Evolving Idea Graphs with Learnable Edits-and-Commits for Multi-Agent Scientific Ideationcited by 2
- 2023Speculative Exploration on the Concept of Artificial Agents Conducting Autonomous Researchcited by 1
- 2026Evolving Idea Graphs with Learnable Edits-and-Commits for Multi-Agent Scientific Ideation6 May 2026
- 2025Evolving Roles of LLMs in Scientific Innovation: Assistant, Collaborator, Scientist, and Evaluator16 Jul 2025
- 2025HypER: Literature-grounded Hypothesis Generation and Distillation with Provenance15 Jun 2025
- 2024Can Large Language Models Unlock Novel Scientific Research Ideas?10 Sep 2024
- 2024Good Idea or Not, Representation of LLM Could Tell7 Sep 2024
- 2024AceMap: Knowledge Discovery through Academic Graph5 Mar 2024
- 2023Speculative Exploration on the Concept of Artificial Agents Conducting Autonomous Research6 Dec 2023
- 2023K2: A Foundation Language Model for Geoscience Knowledge Understanding and Utilization8 Jun 2023