mlsanityData to 7 Oct 2026

WCL-BBCD: A Contrastive Learning and Knowledge Graph Approach to Named Entity Recognition

arXiv 2203.06925 ↗First posted 14 Mar 2022cs.CL cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Named Entity Recognition task is one of the core tasks of information extraction. Word ambiguity and word abbreviation are important reasons for the low recognition rate of named entities. In this paper, we propose a novel named entity recognition model WCL-BBCD (Word Contrastive Learning with BERT-BiLSTM-CRF-DBpedia), which incorporates the idea of contrastive learning. The model first trains the sentence pairs in the text, calculate similarity between sentence pairs, and fine-tunes BERT used for the named entity recognition task according to the similarity, so as to alleviate word ambiguity. Then, the fine-tuned BERT is combined with BiLSTM-CRF to perform the named entity recognition task. Finally, the recognition results are corrected in combination with prior knowledge such as knowledge graphs, so as to alleviate the low-recognition-rate problem caused by word abbreviations. The results of experimentals conducted on the CoNLL-2003 English dataset and OntoNotes V5 English dataset show that our model outperforms other similar models on.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 26 of its 46 references that are in the map. First posted on arXiv 14 Mar 2022.

Builds on

26 of 46 references.

References · 26

  1. 2017Attention Is All You Needcited by 59,932
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  3. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  4. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
  5. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
  6. 2018Representation Learning with Contrastive Predictive Codingcited by 7,662
  7. 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,482
  8. 2020Dense Passage Retrieval for Open-Domain Question Answeringcited by 3,779
  9. 2013Distributed Representations of Words and Phrases and their Compositionalitycited by 3,462
  10. 2019XLNet: Generalized Autoregressive Pretraining for Language Understandingcited by 2,801
  11. 2019ALBERT: A Lite BERT for Self-supervised Learning of Language Representationscited by 2,772
  12. 2021SimCSE: Simple Contrastive Learning of Sentence Embeddingscited by 2,168
14 more
  1. 2016Enriching Word Vectors with Subword Informationcited by 1,578
  2. 2019PEGASUS: Pre-training with Extracted Gap-sentences for Abstractive Summarizationcited by 1,100
  3. 2019SpanBERT: Improving Pre-training by Representing and Predicting Spanscited by 832
  4. 2020Contrastive Learning with Hard Negative Samplescited by 619
  5. 2016End-to-end Sequence Labeling via Bi-directional LSTM-CNNs-CRFcited by 341
  6. 2021Whitening Sentence Representations for Better Semantics and Faster Retrievalcited by 198
  7. 2018An efficient framework for learning sentence representationscited by 197
  8. 2020CLEAR: Contrastive Learning for Sentence Representationcited by 186
  9. 2020Support-set bottlenecks for video-text representation learningcited by 170
  10. 2021COCO-LM: Correcting and Contrasting Text Sequences for Language Model Pretrainingcited by 126
  11. 2019Learning Dense Representations for Entity Retrievalcited by 122
  12. 2020An Unsupervised Sentence Embedding Method by Mutual Information Maximizationcited by 91
  13. 2020Pre-training Text-to-Text Transformers for Concept-centric Common Sensecited by 42
  14. 2019End-to-end Named Entity Recognition and Relation Extraction using Pre-trained Language Modelscited by 11

Built on by

Not cited yet.