LMN at SemEval-2022 Task 11: A Transformer-based System for English Named Entity Recognition
Not on the map. Why?
Abstract (arXiv)
Processing complex and ambiguous named entities is a challenging research problem, but it has not received sufficient attention from the natural language processing community. In this short paper, we present our participation in the English track of SemEval-2022 Task 11: Multilingual Complex Named Entity Recognition. Inspired by the recent advances in pretrained Transformer language models, we propose a simple yet effective Transformer-based baseline for the task. Despite its simplicity, our proposed approach shows competitive results in the leaderboard as we ranked 12 over 30 teams. Our system achieved a macro F1 score of 72.50% on the held-out test set. We have also explored a data augmentation approach using entity linking. While the approach does not improve the final performance, we also discuss it in this paper.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 24 of its 38 references that are in the map. First posted on arXiv 13 Feb 2022.
Builds on
24 of 38 references.
References · 24
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
- 2019DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lightercited by 4,243
- 2019ALBERT: A Lite BERT for Self-supervised Learning of Language Representationscited by 2,772
- 2018Deep contextualized word representationscited by 2,285
- 2019BioBERT: a pre-trained biomedical language representation model for biomedical text miningcited by 1,935
- 2019SpanBERT: Improving Pre-training by Representing and Predicting Spanscited by 832
- 2016Neural Architectures for Named Entity Recognitioncited by 548
- 2020MobileBERT: a Compact Task-Agnostic BERT for Resource-Limited Devicescited by 476
- 2016End-to-end Sequence Labeling via Bi-directional LSTM-CNNs-CRFcited by 341
- 2015Named Entity Recognition with Bidirectional LSTM-CNNscited by 201
- 2019BERT for Joint Intent Classification and Slot Fillingcited by 195
12 more
- 2020Named Entity Recognition as Dependency Parsingcited by 150
- 2019BERT for Coreference Resolution: Baselines and Analysiscited by 125
- 2018UKP-Athene: Multi-Sentence Textual Entailment for Claim Verificationcited by 60
- 2018NCRF++: An Open-source Neural Sequence Labeling Toolkitcited by 29
- 2018Design Challenges and Misconceptions in Neural Sequence Labelingcited by 28
- 2017Generalisation in Named Entity Recognition: A Quantitative Analysiscited by 25
- 2021Joint Biomedical Entity and Relation Extraction with Knowledge-Enhanced Collective Inferencecited by 19
- 2019A Multi-task Approach for Named Entity Recognition in Social Media Datacited by 18
- 2019A Gated Self-attention Memory Network for Answer Selectioncited by 11
- 2019A Simple but Effective BERT Model for Dialog State Tracking on Resource-Limited Systemscited by 10
- 2020A Joint Learning Approach based on Self-Distillation for Keyphrase Extraction from Scientific Documentscited by 5
- 2020Explain by Evidence: An Explainable Memory-based Neural Network for Question Answeringcited by 3
Built on by
Citing papers per year: 2023: 1.
1 paper.