Named entity recognition architecture combining contextual and global features
Not on the map. Why?
Abstract (arXiv)
Named entity recognition (NER) is an information extraction technique that aims to locate and classify named entities (e.g., organizations, locations,...) within a document into predefined categories. Correctly identifying these phrases plays a significant role in simplifying information access. However, it remains a difficult task because named entities (NEs) have multiple forms and they are context-dependent. While the context can be represented by contextual features, global relations are often misrepresented by those models. In this paper, we propose the combination of contextual features from XLNet and global features from Graph Convolution Network (GCN) to enhance NER performance. Experiments over a widely-used dataset, CoNLL 2003, show the benefits of our strategy, with results competitive with the state of the art (SOTA).
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 23 of its 42 references that are in the map. First posted on arXiv 15 Dec 2021.
Builds on
23 of 42 references.
References · 23
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2019XLNet: Generalized Autoregressive Pretraining for Language Understandingcited by 2,801
- 2019ALBERT: A Lite BERT for Self-supervised Learning of Language Representationscited by 2,772
- 2018Deep contextualized word representationscited by 2,285
- 2019Cross-lingual Language Model Pretrainingcited by 1,088
- 2015Convolutional Networks on Graphs for Learning Molecular Fingerprintscited by 751
- 2020Stanza: A Python Natural Language Processing Toolkit for Many Human Languagescited by 719
- 2016Neural Architectures for Named Entity Recognitioncited by 548
- 2015Bidirectional LSTM-CRF Models for Sequence Taggingcited by 544
- 2018Graph Convolutional Networks for Text Classificationcited by 345
- 2016End-to-end Sequence Labeling via Bi-directional LSTM-CNNs-CRFcited by 341
- 2016FastText.zip: Compressing text classification modelscited by 331
11 more
- 2018A Survey on Deep Learning for Named Entity Recognitioncited by 281
- 2017Advances in Pre-Training Distributed Word Representationscited by 207
- 2015Named Entity Recognition with Bidirectional LSTM-CNNscited by 201
- 2019A Survey on Recent Advances in Named Entity Recognition from Deep Learning modelscited by 117
- 2018Learning General Purpose Distributed Sentence Representations via Large Scale Multi-task Learningcited by 52
- 2019Hierarchical Contextualized Representation for Named Entity Recognitioncited by 32
- 2017Empower Sequence Labeling with Task-Aware Neural Language Modelcited by 28
- 2018Sentence-State LSTM for Text Representationcited by 22
- 2019GCDT: A Global Context Enhanced Deep Transition Architecture for Sequence Labelingcited by 22
- 2019HAMNER: Headword Amplified Multi-span Distantly Supervised Method for Domain Specific Named Entity Recognitioncited by 7
- 2017Graph Convolutional Networks for Named Entity Recognitioncited by 4
Built on by
Citing papers per year: 2022: 2.
2 papers.