mlsanityData to 7 Oct 2026

Event-based Dynamic Graph Representation Learning for Patent Application Trend Prediction

arXiv 2308.09780 ↗First posted 4 Aug 2023cs.AI cs.LGcited by 6

Not on the map. Why?

Abstract (arXiv)

Accurate prediction of what types of patents that companies will apply for in the next period of time can figure out their development strategies and help them discover potential partners or competitors in advance. Although important, this problem has been rarely studied in previous research due to the challenges in modelling companies' continuously evolving preferences and capturing the semantic correlations of classification codes. To fill in this gap, we propose an event-based dynamic graph learning framework for patent application trend prediction. In particular, our method is founded on the memorable representations of both companies and patent classification codes. When a new patent is observed, the representations of the related companies and classification codes are updated according to the historical memories and the currently encoded messages. Moreover, a hierarchical message passing mechanism is provided to capture the semantic proximities of patent classification codes by updating their representations along the hierarchical taxonomy. Finally, the patent application trend is predicted by aggregating the representations of the target company and classification codes from static, dynamic, and hierarchical perspectives. Experiments on real-world data demonstrate the effectiveness of our approach under various experimental conditions, and also reveal the abilities of our method in learning semantics of classification codes and tracking technology developing trajectories of companies.

Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Builds on 22 of its 57 references that are in the map. First posted on arXiv 4 Aug 2023.

Builds on

22 of 57 references.

References · 22

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  3. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
  4. 2014Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translationcited by 4,016
  5. 2020LightGCN: Simplifying and Powering Graph Convolution Network for Recommendationcited by 1,134
  6. 2018Graph Convolutional Neural Networks for Web-Scale Recommender Systemscited by 1,133
  7. 2019Graph Neural Networks for Social Recommendationcited by 711
  8. 2015Session-based Recommendations with Recurrent Neural Networkscited by 685
  9. 2019Neural Graph Collaborative Filteringcited by 660
  10. 2020Temporal Graph Networks for Deep Learning on Dynamic Graphscited by 521
  11. 2020Inductive Representation Learning on Temporal Graphscited by 454
  12. 2019EvolveGCN: Evolving Graph Convolutional Networks for Dynamic Graphscited by 443
10 more
  1. 2019Representation Learning for Dynamic Graphs: A Surveycited by 260
  2. 2023Towards Better Dynamic Graph Learning: New Architecture and Unified Librarycited by 154
  3. 2018DeepInf: Social Influence Prediction with Deep Learningcited by 128
  4. 2018Supervised Reinforcement Learning with Recurrent Neural Network for Dynamic Treatment Recommendationcited by 101
  5. 2021Dynamic Graph Neural Networks for Sequential Recommendationcited by 57
  6. 2022Neighborhood-aware Scalable Temporal Network Representation Learningcited by 54
  7. 2019Patent Claim Generation by Fine-Tuning OpenAI GPT-2cited by 49
  8. 2017Patent Retrieval: A Literature Reviewcited by 17
  9. 2020Predicting Temporal Sets with Deep Neural Networkscited by 16
  10. 2019Patent Citation Dynamics Modeling via Multi-Attention Recurrent Networkscited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 1; 2024: 3; 2025: 1; 2026: 1.

6 papers.