mlsanityData to 14 Oct 2026

A More Efficient Chinese Named Entity Recognition base on BERT and Syntactic Analysis

arXiv 2101.11423 ↗First posted 11 Jan 2021cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

We propose a new Named entity recognition (NER) method to effectively make use of the results of Part-of-speech (POS) tagging, Chinese word segmentation (CWS) and parsing while avoiding NER error caused by POS tagging error. This paper first uses Stanford natural language process (NLP) tool to annotate large-scale untagged data so as to reduce the dependence on the tagged data; then a new NLP model, g-BERT model, is designed to compress Bidirectional Encoder Representations from Transformers (BERT) model in order to reduce calculation quantity; finally, the model is evaluated based on Chinese NER dataset. The experimental results show that the calculation quantity in g-BERT model is reduced by 60% and performance improves by 2% with Test F1 to 96.5 compared with that in BERT model.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 16 of its 36 references that are in the map. First posted on arXiv 11 Jan 2021.

Builds on

16 of 36 references.

References · 16

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  2. 2015Distilling the Knowledge in a Neural Networkcited by 10,324
  3. 2013Efficient Estimation of Word Representations in Vector Spacecited by 4,375
  4. 2016SQuAD: 100,000+ Questions for Machine Comprehension of Textcited by 4,148
  5. 2014Sequence to Sequence Learning with Neural Networkscited by 2,986
  6. 2017A Broad-Coverage Challenge Corpus for Sentence Understanding through Inferencecited by 2,682
  7. 2018Deep contextualized word representationscited by 2,290
  8. 2015A large annotated corpus for learning natural language inferencecited by 1,847
  9. 2016Conditional Image Generation with PixelCNN Decoderscited by 862
  10. 2014Distributed Representations of Sentences and Documentscited by 678
  11. 2017Convolutional Sequence to Sequence Learningcited by 552
  12. 2015Semi-supervised Sequence Learningcited by 198
4 more
  1. 2017Semi-supervised sequence tagging with bidirectional language modelscited by 86
  2. 2017Simplified Minimal Gated Unit Variations for Recurrent Neural Networkscited by 13
  3. 2015When Are Tree Structures Necessary for Deep Learning of Representations?cited by 6
  4. 2018Neural Chinese Word Segmentation with Dictionary Knowledgecited by 4

Built on by

Not cited yet.