# Multi label classification of Artificial Intelligence related patents using Modified D2SBERT and Sentence Attention mechanism

arXiv: https://arxiv.org/abs/2303.03165 · HTML: https://mlsanity.com/paper/2303.03165/

## Key facts

- Cited by 2 papers in the map (data through 14 Oct 2026).
- Builds on 7 of its 33 references that are in the map.
- First posted on arXiv 3 Mar 2023.

## Builds on (most cited first, 7 of 7)

- [Explainable Prediction of Medical Codes from Clinical Text](https://mlsanity.com/paper/1802.05695/) (2018)
- [DocBERT: BERT for Document Classification](https://mlsanity.com/paper/1904.08398/) (2019)
- [Multi-Label Classification of Patient Notes a Case Study on ICD Code Assignment](https://mlsanity.com/paper/1709.09587/) (2017)
- [PatentSBERTa: A Deep NLP based Hybrid Model for Patent Distance and Classification using Augmented SBERT](https://mlsanity.com/paper/2103.11933/) (2021)
- [An Explainable CNN Approach for Medical Codes Prediction from Clinical Text](https://mlsanity.com/paper/2101.11430/) (2021)
- [Medical Code Prediction from Discharge Summary: Document to Sequence BERT using Sequence Attention](https://mlsanity.com/paper/2106.07932/) (2021)
- [DAGAM: Data Augmentation with Generation And Modification](https://mlsanity.com/paper/2204.02633/) (2022)

## Built on by (most cited first, 2 of 2)

- [Semantic Similarity Matching for Patent Documents Using Ensemble BERT-related Model and Novel Text Processing Method](https://mlsanity.com/paper/2401.06782/) (2024)
- [A Novel Patent Similarity Measurement Methodology: Semantic Distance and Technological Distance](https://mlsanity.com/paper/2303.16767/) (2023)

## Abstract (arXiv)

Patent classification is an essential task in patent information management and patent knowledge mining. It is very important to classify patents related to artificial intelligence, which is the biggest topic these days. However, artificial intelligence-related patents are very difficult to classify because it is a mixture of complex technologies and legal terms. Moreover, due to the unsatisfactory performance of current algorithms, it is still mostly done manually, wasting a lot of time and money. Therefore, we present a method for classifying artificial intelligence-related patents published by the USPTO using natural language processing technique and deep learning methodology. We use deformed BERT and sentence attention overcome the limitations of BERT. Our experiment result is highest performance compared to other deep learning methods.