mlsanityData to 14 Oct 2026

Type-supervised sequence labeling based on the heterogeneous star graph for named entity recognition

arXiv 2210.10240 ↗First posted 19 Oct 2022cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

Named entity recognition is a fundamental task in natural language processing, identifying the span and category of entities in unstructured texts. The traditional sequence labeling methodology ignores the nested entities, i.e. entities included in other entity mentions. Many approaches attempt to address this scenario, most of which rely on complex structures or have high computation complexity. The representation learning of the heterogeneous star graph containing text nodes and type nodes is investigated in this paper. In addition, we revise the graph attention mechanism into a hybrid form to address its unreasonableness in specific topologies. The model performs the type-supervised sequence labeling after updating nodes in the graph. The annotation scheme is an extension of the single-layer sequence labeling and is able to cope with the vast majority of nested entities. Extensive experiments on public NER datasets reveal the effectiveness of our model in extracting both flat and nested entities. The method achieved state-of-the-art performance on both flat and nested datasets. The significant improvement in accuracy reflects the superiority of the multi-layer labeling strategy.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 26 of its 43 references that are in the map. First posted on arXiv 19 Oct 2022.

Builds on

26 of 43 references.

References · 26

  1. 2017Attention Is All You Needcited by 60,361
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  3. 2017Graph Attention Networkscited by 8,923
  4. 2014Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translationcited by 4,057
  5. 2019BioBERT: a pre-trained biomedical language representation model for biomedical text miningcited by 1,947
  6. 2018Graph Neural Networks: A Review of Methods and Applicationscited by 1,576
  7. 2016Google's Neural Machine Translation System: Bridging the Gap between Human and Machine Translationcited by 1,475
  8. 2015Bidirectional LSTM-CRF Models for Sequence Taggingcited by 546
  9. 2020LUKE: Deep Contextualized Entity Representations with Entity-aware Self-attentioncited by 326
  10. 2017Few-Shot Learning with Graph Neural Networkscited by 324
  11. 2019A Multiscale Visualization of Attention in the Transformer Modelcited by 292
  12. 2019A Unified MRC Framework for Named Entity Recognitioncited by 199
14 more
  1. 2013Maxout Networkscited by 187
  2. 2020Named Entity Recognition as Dependency Parsingcited by 151
  3. 2021A Unified Generative Framework for Various NER Subtaskscited by 141
  4. 2019Star-Transformercited by 94
  5. 2020Heterogeneous Graph Neural Networks for Extractive Document Summarizationcited by 91
  6. 2018Chinese NER Using Lattice LSTMcited by 81
  7. 2020FLAT: Chinese NER Using Flat-Lattice Transformercited by 67
  8. 2021Locate and Label: A Two-stage Identifier for Nested Named Entity Recognitioncited by 61
  9. 2018Analogical Reasoning on Chinese Morphological and Semantic Relationscited by 50
  10. 2021A Sequence-to-Set Network for Nested Named Entity Recognitioncited by 40
  11. 2019Nested Named Entity Recognition via Second-best Sequence Learning and Decodingcited by 34
  12. 2020Improving Named Entity Recognition with Attentive Ensemble of Syntactic Informationcited by 17
  13. 2020SLK-NER: Exploiting Second-order Lexicon Knowledge for Chinese NERcited by 7
  14. 2019Attending to Entities for Better Text Understandingcited by 6

Built on by

Not cited yet.