BERT based patent novelty search by training claims to their own description
Not on the map. Why?
Abstract (arXiv)
In this paper we present a method to concatenate patent claims to their own description. By applying this method, BERT trains suitable descriptions for claims. Such a trained BERT (claim-to-description- BERT) could be able to identify novelty relevant descriptions for patents. In addition, we introduce a new scoring scheme, relevance scoring or novelty scoring, to process the output of BERT in a meaningful way. We tested the method on patent applications by training BERT on the first claims of patents and corresponding descriptions. BERT's output has been processed according to the relevance score and the results compared with the cited X documents in the search reports. The test showed that BERT has scored some of the cited X documents as highly relevant.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 5 of its 18 references that are in the map. First posted on arXiv 1 Mar 2021.
Builds on
5 of 18 references.
References · 5
- 2017Attention Is All You Needcited by 60,361
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2019How to Fine-Tune BERT for Text Classification?cited by 411
- 2020Prior Art Search and Reranking for Generated Patent Textcited by 8
- 2019Deep Patent Landscaping Model Using Transformer and Graph Embeddingcited by 4
Built on by
Citing papers per year: 2021: 1; 2022: 0; 2023: 0; 2024: 0; 2025: 0; 2026: 1.
2 papers.