mlsanityData to 14 Oct 2026

Exploring and Verbalizing Academic Ideas by Concept Co-occurrence

arXiv 2306.02282 ↗First posted 4 Jun 2023cs.CL cs.AIcited by 8

Not on the map. Why?

Abstract (arXiv)

Researchers usually come up with new ideas only after thoroughly comprehending vast quantities of literature. The difficulty of this procedure is exacerbated by the fact that the number of academic publications is growing exponentially. In this study, we devise a framework based on concept co-occurrence for academic idea inspiration, which has been integrated into a research assistant system. From our perspective, the fusion of two concepts that co-occur in an academic paper can be regarded as an important way of the emergence of a new idea. We construct evolving concept graphs according to the co-occurrence relationship of concepts from 20 disciplines or topics. Then we design a temporal link prediction method based on masked language model to explore potential connections between different concepts. To verbalize the newly discovered connections, we also utilize the pretrained language model to generate a description of an idea based on a new data structure called co-occurrence citation quintuple. We evaluate our proposed system using both automatic metrics and human assessment. The results demonstrate that our system has broad prospects and can assist researchers in expediting the process of discovering new ideas.

Key facts. Cited by 8 papers in the map (data through 14 Oct 2026). Builds on 22 of its 39 references that are in the map. First posted on arXiv 4 Jun 2023.

Builds on

22 of 39 references.

References · 22

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  2. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
  3. 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,361
  4. 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,893
  5. 2021Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processingcited by 2,234
  6. 2019Language Models as Knowledge Bases?cited by 1,936
  7. 2018Hierarchical Neural Story Generationcited by 1,193
  8. 2022Galactica: A Large Language Model for Sciencecited by 744
  9. 2019EvolveGCN: Evolving Graph Convolutional Networks for Dynamic Graphscited by 447
  10. 2016How NOT To Evaluate Your Dialogue System: An Empirical Study of Unsupervised Evaluation Metrics for Dialogue Response Generationcited by 356
  11. 2019KG-BERT: BERT for Knowledge Graph Completioncited by 324
  12. 2016A Persona-Based Neural Conversation Modelcited by 223
10 more
  1. 2020Foundations and modelling of dynamic networks using Dynamic Graph Neural Networks: A surveycited by 124
  2. 2020A Survey of Knowledge-Enhanced Text Generationcited by 120
  3. 2020Language Models are Open Knowledge Graphscited by 95
  4. 2017Automated Phrase Mining from Massive Text Corporacited by 70
  5. 2019GCN-GAN: A Non-linear Temporal Link Prediction Model for Weighted Dynamic Networkscited by 40
  6. 2019PaperRobot: Incremental Draft Generation of Scientific Ideascited by 37
  7. 2019Predicting Research Trends with Semantic and Neural Networks with an application in Quantum Physicscited by 25
  8. 2022Multi-task Pre-training Language Model for Semantic Network Completioncited by 15
  9. 2021A Search Engine for Discovery of Scientific Challenges and Directionscited by 12
  10. 2021How to Train Your Agent to Read and Writecited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2023: 2; 2024: 3; 2025: 2; 2026: 1.

8 papers.