mlsanityData to 7 Oct 2026

Named Entity Recognition in Twitter: A Dataset and Analysis on Short-Term Temporal Shifts

arXiv 2210.03797 ↗First posted 7 Oct 2022cs.CLcited by 27

Not on the map. Why?

Abstract (arXiv)

Recent progress in language model pre-training has led to important improvements in Named Entity Recognition (NER). Nonetheless, this progress has been mainly tested in well-formatted documents such as news, Wikipedia, or scientific articles. In social media the landscape is different, in which it adds another layer of complexity due to its noisy and dynamic nature. In this paper, we focus on NER in Twitter, one of the largest social media platforms, and construct a new NER dataset, TweetNER7, which contains seven entity types annotated over 11,382 tweets from September 2019 to August 2021. The dataset was constructed by carefully distributing the tweets over time and taking representative trends as a basis. Along with the dataset, we provide a set of language model baselines and perform an analysis on the language model performance on the task, especially analyzing the impact of different time periods. In particular, we focus on three important temporal aspects in our analysis: short-term degradation of NER models over time, strategies to fine-tune a language model over different periods, and self-labeling as an alternative to lack of recently-labeled data. TweetNER7 is released publicly (https://huggingface.co/datasets/tner/tweetner7) along with the models fine-tuned on it.

Key facts. Cited by 27 papers in the map (data through 7 Oct 2026). Builds on 17 of its 35 references that are in the map. First posted on arXiv 7 Oct 2022.

Builds on

17 of 35 references.

References · 17

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
  3. 2018Deep contextualized word representationscited by 2,285
  4. 2019BioBERT: a pre-trained biomedical language representation model for biomedical text miningcited by 1,935
  5. 2020BERTweet: A pre-trained language model for English Tweetscited by 346
  6. 2020LUKE: Deep Contextualized Entity Representations with Entity-aware Self-attentioncited by 326
  7. 2021Mind the Gap: Assessing Temporal Generalization in Neural Language Modelscited by 226
  8. 2021PAQ: 65 Million Probably-Asked Questions and What You Can Do With Themcited by 198
  9. 2019Dice Loss for Data-imbalanced NLP Taskscited by 180
  10. 2022TimeLMs: Diachronic Language Models from Twittercited by 129
  11. 2022TweetNLP: Cutting-Edge Natural Language Processing for Social Mediacited by 71
  12. 2021Temporal Effects on Pre-trained Models for Language Processing Taskscited by 46
5 more
  1. 2022T-NER: An All-Round Python Library for Transformer-based Named Entity Recognitioncited by 37
  2. 2018Short-Term Meaning Shift: A Distributional Explorationcited by 23
  3. 2022Twitter Topic Classificationcited by 22
  4. 2018Parsing Tweets into Universal Dependenciescited by 19
  5. 2022Annotating the Tweebank Corpus on Named Entity Recognition and Building NLP Models for Social Media Analysiscited by 9

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2022: 1; 2023: 8; 2024: 10; 2025: 4; 2026: 4.

27 papers.

Sort:

By area:

  1. 2023Large Language Models for Generative Information Extraction: A Surveycited by 183
  2. 2023InstructUIE: Multi-task Instruction Tuning for Unified Information Extractioncited by 167
  3. 2023GLiNER: Generalist Model for Named Entity Recognition using Bidirectional Transformercited by 84
  4. 2023UniversalNER: Targeted Distillation from Large Language Models for Open Named Entity Recognitioncited by 70
  5. 2024Rethinking Negative Instances for Generative Named Entity Recognitioncited by 13
  6. 2022Do CoNLL-2003 Named Entity Taggers Still Work Well in 2023?cited by 9
  7. 2023SuperTweetEval: A Challenging, Unified and Heterogeneous Benchmark for Social Media NLP Researchcited by 9
  8. 2024Sebastian, Basti, Wastl?! Recognizing Named Entities in Bavarian Dialectal Datacited by 8
  9. 2023JsonTuning: Towards Generalizable, Robust, and Controllable Instruction Tuningcited by 6
  10. 2024Beyond Boundaries: Learning a Universal Entity Taxonomy across Datasets and Languages for Open Named Entity Recognitioncited by 5
  11. 2024MasonPerplexity at ClimateActivism 2024: Integrating Advanced Ensemble Techniques and Data Augmentation for Climate Activism Stance and Hate Event Identificationcited by 3
  12. 2024RUIE: Retrieval-based Unified Information Extraction using Large Language Modelcited by 3
15 more
  1. 2024KnowCoder-X: Boosting Multilingual Information Extraction via Codecited by 3
  2. 2024MasonPerplexity at Multimodal Hate Speech Event Detection 2024: Hate Speech and Target Detection Using Transformer Ensemblescited by 2
  3. 2024PICLe: Pseudo-Annotations for In-Context Learning in Low-Resource Named Entity Detectioncited by 2
  4. 2025Selecting and Merging: Towards Adaptable and Scalable Named Entity Recognition with Large Language Modelscited by 2
  5. 2024Is There a One-Model-Fits-All Approach to Information Extraction? Revisiting Task Definition Biasescited by 1
  6. 2025A Multi-Agent LLM Framework for Multi-Domain Low-Resource In-Context NER via Knowledge Retrieval, Disambiguation and Reflective Analysiscited by 1
  7. 2026Model-Agnostic Meta Learning for Class Imbalance Adaptationcited by 1
  8. 2023Keeping in Time: Adding Temporal Context to Sentiment Analysis Modelscited by 0
  9. 2023On Significance of Subword tokenization for Low Resource and Efficient Named Entity Recognition: A case study in Marathicited by 0
  10. 2024A Systematic Analysis on the Temporal Generalization of Language Models in Social Mediacited by 0
  11. 2025Black-box Model Merging for Language-Model-as-a-Service with Massive Model Repositoriescited by 0
  12. 2025A Reasoning Paradigm for Named Entity Recognitioncited by 0
  13. 2026CobwebTM: Probabilistic Concept Formation for Lifelong and Hierarchical Topic Modelingcited by 0
  14. 2026A Mechanism and Optimization Study on the Impact of Information Density on User-Generated Content Named Entity Recognitioncited by 0
  15. 2026Reliable Financial Named Entity Recognition Under Domain Shift: Confidence Estimation and Selective Predictioncited by 0