mlsanityData to 14 Oct 2026

Adaptive Taxonomy Learning and Historical Patterns Modelling for Patent Classification

arXiv 2308.05385 ↗First posted 10 Aug 2023cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Patent classification aims to assign multiple International Patent Classification (IPC) codes to a given patent. Recent methods for automatically classifying patents mainly focus on analyzing the text descriptions of patents. However, apart from the texts, each patent is also associated with some assignees, and the knowledge of their applied patents is often valuable for classification. Furthermore, the hierarchical taxonomy formulated by the IPC system provides important contextual information and enables models to leverage the correlations between IPC codes for more accurate classification. However, existing methods fail to incorporate the above aspects. In this paper, we propose an integrated framework that comprehensively considers the information on patents for patent classification. To be specific, we first present an IPC codes correlations learning module to derive their semantic representations via adaptively passing and aggregating messages within the same level and across different levels along the hierarchical taxonomy. Moreover, we design a historical application patterns learning component to incorporate the corresponding assignee's previous patents by a dual channel aggregation mechanism. Finally, we combine the contextual information of patent texts that contains the semantics of IPC codes, and assignees' sequential preferences to make predictions. Experiments on real-world datasets demonstrate the superiority of our approach over the existing methods. Besides, we present the model's ability to capture the temporal patterns of assignees and the semantic dependencies among IPC codes.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 20 of its 53 references that are in the map. First posted on arXiv 10 Aug 2023.

Builds on

20 of 53 references.

References · 20

  1. 2017Attention Is All You Needcited by 60,361
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  3. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  4. 2020Language Models are Few-Shot Learnerscited by 32,419
  5. 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,361
  6. 2013Efficient Estimation of Word Representations in Vector Spacecited by 4,375
  7. 2020LightGCN: Simplifying and Powering Graph Convolution Network for Recommendationcited by 1,139
  8. 2013Generating Sequences With Recurrent Neural Networkscited by 554
  9. 2015An Introduction to Convolutional Neural Networkscited by 514
  10. 2018Graph Convolutional Networks for Text Classificationcited by 345
  11. 2019Pre-training of Graph Augmented Transformers for Medication Recommendationcited by 127
  12. 2018AttentionXML: Label Tree-based Attention-Aware Deep Model for High-Performance Extreme Multi-Label Text Classificationcited by 102
8 more
  1. 2018Supervised Reinforcement Learning with Recurrent Neural Network for Dynamic Treatment Recommendationcited by 101
  2. 2016DiSMEC - Distributed Sparse Machines for Extreme Multi-label Classificationcited by 71
  3. 2019Memory Augmented Graph Neural Networks for Sequential Recommendationcited by 46
  4. 2021Collaborative Graph Learning with Auxiliary Text for Temporal Event Prediction in Healthcarecited by 30
  5. 2022Enhancing Sequential Recommendation with Graph Contrastive Learningcited by 18
  6. 2020Predicting Temporal Sets with Deep Neural Networkscited by 16
  7. 2023Event-based Dynamic Graph Representation Learning for Patent Application Trend Predictioncited by 6
  8. 2022HIEN: Hierarchical Intention Embedding Network for Click-Through Rate Predictioncited by 5

Built on by

Not cited yet.