mlsanityData to 7 Oct 2026

BERT-based knowledge extraction method of unstructured domain text

arXiv 2103.00728 ↗First posted 1 Mar 2021cs.CL cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

With the development and business adoption of knowledge graph, there is an increasing demand for extracting entities and relations of knowledge graphs from unstructured domain documents. This makes the automatic knowledge extraction for domain text quite meaningful. This paper proposes a knowledge extraction method based on BERT, which is used to extract knowledge points from unstructured specific domain texts (such as insurance clauses in the insurance industry) automatically to save manpower of knowledge graph construction. Different from the commonly used methods which are based on rules, templates or entity extraction models, this paper converts the domain knowledge points into question and answer pairs and uses the text around the answer in documents as the context. The method adopts a BERT-based model similar to BERT's SQuAD reading comprehension task. The model is fine-tuned. And it is used to directly extract knowledge points from more insurance clauses. According to the test results, the model performance is good.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 14 of its 23 references that are in the map. First posted on arXiv 1 Mar 2021.

Builds on

14 of 23 references.

References · 14

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2016SQuAD: 100,000+ Questions for Machine Comprehension of Textcited by 4,115
  3. 2018Know What You Don't Know: Unanswerable Questions for SQuADcited by 1,538
  4. 2016Neural Architectures for Named Entity Recognitioncited by 548
  5. 2015Bidirectional LSTM-CRF Models for Sequence Taggingcited by 544
  6. 2016End-to-end Sequence Labeling via Bi-directional LSTM-CNNs-CRFcited by 341
  7. 2018Multi-Task Identification of Entities, Relations, and Coreference for Scientific Knowledge Graph Constructioncited by 321
  8. 2017Recent Trends in Deep Learning Based Natural Language Processingcited by 262
  9. 2016End-to-End Relation Extraction using LSTMs on Sequences and Tree Structurescited by 161
  10. 2016Language to Logical Form with Neural Attentioncited by 158
  11. 2017Joint Extraction of Entities and Relations Based on a Novel Tagging Schemecited by 102
  12. 2019Multi-passage BERT: A Globally Normalized BERT Model for Open-domain Question Answeringcited by 96
2 more
  1. 2019Small and Practical BERT Models for Sequence Labelingcited by 40
  2. 2019A BERT Baseline for the Natural Questionscited by 33

Built on by

Not cited yet.