Rethinking Negative Instances for Generative Named Entity Recognition
On the map: LLM reasoning → Multimodal reasoning
Abstract (arXiv)
Large Language Models (LLMs) have demonstrated impressive capabilities for generalizing in unseen tasks. In the Named Entity Recognition (NER) task, recent advancements have seen the remarkable improvement of LLMs in a broad range of entity domains via instruction tuning, by adopting entity-centric schema. In this work, we explore the potential enhancement of the existing methods by incorporating negative instances into training. Our experiments reveal that negative instances contribute to remarkable improvements by (1) introducing contextual information, and (2) clearly delineating label boundaries. Furthermore, we introduce an efficient longest common subsequence (LCS) matching algorithm, which is tailored to transform unstructured predictions into structured entities. By integrating these components, we present GNER, a Generative NER system that shows improved zero-shot performance across unseen entity domains. Our comprehensive evaluation illustrates our system's superiority, surpassing state-of-the-art (SoTA) methods by 9 F1 score in zero-shot evaluation.
Key facts. Cited by 13 papers in the map (data through 14 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 28 of its 49 references that are in the map. First posted on arXiv 26 Feb 2024.
Builds on
28 of 49 references.
References · 28
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2023GPT-4 Technical Reportcited by 18,396
- 2022Training language models to follow instructions with human feedbackcited by 15,971
- 2021Finetuned Language Models Are Zero-Shot Learnerscited by 3,780
- 2022Scaling Instruction-Finetuned Language Modelscited by 3,024
- 2020The Pile: An 800GB Dataset of Diverse Text for Language Modelingcited by 2,411
- 2023Code Llama: Open Foundation Models for Codecited by 2,139
- 2023The Flan Collection: Designing Data and Methods for Effective Instruction Tuningcited by 739
- 2015Bidirectional LSTM-CRF Models for Sequence Taggingcited by 546
- 2023ChatIE: Zero-Shot Information Extraction via Chatting with ChatGPTcited by 250
- 2015Named Entity Recognition with Bidirectional LSTM-CNNscited by 201
- 2019A Unified MRC Framework for Named Entity Recognitioncited by 199
16 more
- 2023InstructUIE: Multi-task Instruction Tuning for Unified Information Extractioncited by 170
- 2020Named Entity Recognition as Dependency Parsingcited by 151
- 2021A Unified Generative Framework for Various NER Subtaskscited by 141
- 2023Evaluating ChatGPT's Information Extraction Capabilities: An Assessment of Performance, Explainability, Calibration, and Faithfulnesscited by 130
- 2023GoLLIE: Annotation Guidelines improve Zero-Shot Information-Extractioncited by 119
- 2019A Stack-Propagation Framework with Token-Level Intent Detection for Spoken Language Understandingcited by 107
- 2020CrossNER: Evaluating Cross-Domain Named Entity Recognitioncited by 104
- 2021Unified Named Entity Recognition as Word-Word Relation Classificationcited by 90
- 2019CrossWeigh: Training Named Entity Tagger from Imperfect Annotationscited by 60
- 2021SpanNER: Named Entity Re-/Recognition as Span Predictioncited by 55
- 2020Empirical Analysis of Unlabeled Entity Problem in Named Entity Recognitioncited by 35
- 2014POLYGLOT-NER: Massive Multilingual Named Entity Recognitioncited by 32
- 2020Coarse-to-Fine Pre-training for Named Entity Recognitioncited by 28
- 2022Named Entity Recognition in Twitter: A Dataset and Analysis on Short-Term Temporal Shiftscited by 28
- 2023FindVehicle and VehicleFinder: A NER dataset for natural language-based vehicle retrieval and a keyword-based cross-modal vehicle retrieval systemcited by 15
- 2021Rethinking Negative Sampling for Handling Missing Entity Annotationscited by 12
Built on by
Citing papers per year: 2024: 7; 2025: 2; 2026: 4.
13 papers.
Sort:
By area:
- 2024LTNER: Large Language Model Tagging for Named Entity Recognition with Contextualized Entity Markingcited by 7
- 2024Beyond Boundaries: Learning a Universal Entity Taxonomy across Datasets and Languages for Open Named Entity Recognitioncited by 5
- 2024Show Less, Instruct More: Enriching Prompts with Definitions and Guidelines for Zero-Shot NERcited by 5
- 2024Entity Decomposition with Filtering: A Zero-Shot Clinical Named Entity Recognition Frameworkcited by 4
- 2024WhisperNER: Unified Open Named Entity and Speech Recognitioncited by 3
- 2024KnowCoder-X: Boosting Multilingual Information Extraction via Codecited by 3
- 2026Can LLM Agents Sustain Long-Horizon Organizational Dynamics?cited by 1
- 2026Reliable Financial Named Entity Recognition Under Domain Shift: Confidence Estimation and Selective Predictioncited by 1
- 2024OpenBA-V2: Reaching 77.3% High Compression Ratio with Fast Multi-Stage Pruningcited by 0
- 2025Towards DS-NER: Unveiling and Addressing Latent Noise in Distant Annotationscited by 0
- 2025PANER: A Paraphrase-Augmented Framework for Low-Resource Named Entity Recognitioncited by 0
- 2026DiZiNER: Disagreement-guided Instruction Refinement via Pilot Annotation Simulation for Zero-shot Named Entity Recognitioncited by 0
- 2026Reliable Financial Named Entity Recognition Under Domain Shift: Confidence Estimation and Selective Prediction20 Aug 2026
- 2026DIRECT: Direct Decoding for Efficient and Aligned Sequence Labeling with Large Language Models29 Jul 2026
- 2026Can LLM Agents Sustain Long-Horizon Organizational Dynamics?31 May 2026
- 2026DiZiNER: Disagreement-guided Instruction Refinement via Pilot Annotation Simulation for Zero-shot Named Entity Recognition17 Apr 2026
- 2025PANER: A Paraphrase-Augmented Framework for Low-Resource Named Entity Recognition20 Oct 2025
- 2025Towards DS-NER: Unveiling and Addressing Latent Noise in Distant Annotations18 May 2025
- 2024KnowCoder-X: Boosting Multilingual Information Extraction via Code7 Nov 2024
- 2024WhisperNER: Unified Open Named Entity and Speech Recognition12 Sep 2024
- 2024Entity Decomposition with Filtering: A Zero-Shot Clinical Named Entity Recognition Framework5 Jul 2024
- 2024Show Less, Instruct More: Enriching Prompts with Definitions and Guidelines for Zero-Shot NER1 Jul 2024
- 2024Beyond Boundaries: Learning a Universal Entity Taxonomy across Datasets and Languages for Open Named Entity Recognition17 Jun 2024
- 2024OpenBA-V2: Reaching 77.3% High Compression Ratio with Fast Multi-Stage Pruning9 May 2024
- 2026Can LLM Agents Sustain Long-Horizon Organizational Dynamics?31 May 2026
- 2024LTNER: Large Language Model Tagging for Named Entity Recognition with Contextualized Entity Markingcited by 7
- 2024Beyond Boundaries: Learning a Universal Entity Taxonomy across Datasets and Languages for Open Named Entity Recognitioncited by 5
- 2024Show Less, Instruct More: Enriching Prompts with Definitions and Guidelines for Zero-Shot NERcited by 5
- 2024Entity Decomposition with Filtering: A Zero-Shot Clinical Named Entity Recognition Frameworkcited by 4
- 2024WhisperNER: Unified Open Named Entity and Speech Recognitioncited by 3
- 2024KnowCoder-X: Boosting Multilingual Information Extraction via Codecited by 3
- 2026Reliable Financial Named Entity Recognition Under Domain Shift: Confidence Estimation and Selective Predictioncited by 1
- 2024OpenBA-V2: Reaching 77.3% High Compression Ratio with Fast Multi-Stage Pruningcited by 0
- 2025Towards DS-NER: Unveiling and Addressing Latent Noise in Distant Annotationscited by 0
- 2025PANER: A Paraphrase-Augmented Framework for Low-Resource Named Entity Recognitioncited by 0
- 2026DiZiNER: Disagreement-guided Instruction Refinement via Pilot Annotation Simulation for Zero-shot Named Entity Recognitioncited by 0
- 2026Reliable Financial Named Entity Recognition Under Domain Shift: Confidence Estimation and Selective Prediction20 Aug 2026
- 2026DiZiNER: Disagreement-guided Instruction Refinement via Pilot Annotation Simulation for Zero-shot Named Entity Recognition17 Apr 2026
- 2025PANER: A Paraphrase-Augmented Framework for Low-Resource Named Entity Recognition20 Oct 2025
- 2025Towards DS-NER: Unveiling and Addressing Latent Noise in Distant Annotations18 May 2025
- 2024KnowCoder-X: Boosting Multilingual Information Extraction via Code7 Nov 2024
- 2024WhisperNER: Unified Open Named Entity and Speech Recognition12 Sep 2024
- 2024Entity Decomposition with Filtering: A Zero-Shot Clinical Named Entity Recognition Framework5 Jul 2024
- 2024Show Less, Instruct More: Enriching Prompts with Definitions and Guidelines for Zero-Shot NER1 Jul 2024
- 2024Beyond Boundaries: Learning a Universal Entity Taxonomy across Datasets and Languages for Open Named Entity Recognition17 Jun 2024
- 2024OpenBA-V2: Reaching 77.3% High Compression Ratio with Fast Multi-Stage Pruning9 May 2024
- 2024LTNER: Large Language Model Tagging for Named Entity Recognition with Contextualized Entity Marking8 Apr 2024
Similar, not cited
Close in wording, no citation either way
- 2023Self-Improving for Zero-Shot Named Entity Recognition with Large Language Models
- 2024ReverseNER: A Self-Generated Example-Driven Framework for Zero-Shot Named Entity Recognition with Large Language Models
- 2024Recent Advances in Named Entity Recognition: A Comprehensive Survey and Comparative Study
- 2026NE-R1: Enhancing Named Entity Recognition Model via Reinforcement Learning
- 2023UniversalNER: Targeted Distillation from Large Language Models for Open Named Entity Recognition
- 2021Distantly-Supervised Named Entity Recognition with Noise-Robust Learning and Language Model Augmented Self-Training
- 2022kNN-NER: Named Entity Recognition with Nearest Neighbor Search
- 2024PaDeLLM-NER: Parallel Decoding in Large Language Models for Named Entity Recognition