TriggerNER: Learning with Entity Triggers as Explanations for Named Entity Recognition
Not on the map. Why?
Abstract (arXiv)
Training neural models for named entity recognition (NER) in a new domain often requires additional human annotations (e.g., tens of thousands of labeled instances) that are usually expensive and time-consuming to collect. Thus, a crucial research question is how to obtain supervision in a cost-effective way. In this paper, we introduce "entity triggers," an effective proxy of human explanations for facilitating label-efficient learning of NER models. An entity trigger is defined as a group of words in a sentence that helps to explain why humans would recognize an entity in the sentence. We crowd-sourced 14k entity triggers for two well-studied NER datasets. Our proposed model, Trigger Matching Network, jointly learns trigger representations and soft matching module with self-attention such that can generalize to unseen sentences easily for tagging. Our framework is significantly more cost-effective than the traditional neural NER frameworks. Experiments show that using only 20% of the trigger-annotated sentences results in a comparable performance as using 70% of conventional annotated sentences.
Key facts. Cited by 30 papers in the map (data through 7 Oct 2026). First posted on arXiv 16 Apr 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 12; 2022: 7; 2023: 7; 2024: 4.
30 papers.
Sort:
- 2021An Empirical Survey of Data Augmentation for Limited Data Learning in NLPcited by 101
- 2022State-of-the-art generalisation research in NLP: A taxonomy and reviewcited by 97
- 2021SpanNER: Named Entity Re-/Recognition as Span Predictioncited by 55
- 2021Good Examples Make A Faster Learner: Simple Demonstration-based Learning for Low-resource NERcited by 38
- 2021RockNER: A Simple Method to Create Adversarial Examples for Evaluating the Robustness of Named Entity Recognition Modelscited by 28
- 2021A Trigger-Sense Memory Flow Framework for Joint Entity and Relation Extractioncited by 26
- 2021A Survey on Deep Learning Event Extraction: Approaches and Applicationscited by 12
- 2021Probing Pre-trained Auto-regressive Language Models for Named Entity Typing and Recognitioncited by 10
- 2024On Evaluating Explanation Utility for Human-AI Decision Making in NLPcited by 9
- 2022XMD: An End-to-End Framework for Interactive Explanation-Based Debugging of NLP Modelscited by 8
- 2022ER-Test: Evaluating Explanation Regularization Methods for Language Modelscited by 6
- 2023A Human Subject Study of Named Entity Recognition (NER) in Conversational Music Recommendation Queriescited by 6
18 more
- 2021Larger-Context Tagging: When and Why Does It Work?cited by 4
- 2023REFER: An End-to-end Rationale Extraction Framework for Explanation Regularizationcited by 4
- 2024A Benchmark and Robustness Study of In-Context-Learning with Large Language Models in Music Entity Detectioncited by 4
- 2022Trigger-GNN: A Trigger-Based Graph Neural Network for Nested Named Entity Recognitioncited by 3
- 2022DualNER: A Dual-Teaching framework for Zero-shot Cross-lingual Named Entity Recognitioncited by 3
- 2024EROS: Entity-Driven Controlled Policy Document Summarizationcited by 2
- 2021AutoTriggER: Label-Efficient and Robust Named Entity Recognition with Auxiliary Trigger Extractioncited by 1
- 2021Few-shot Named Entity Recognition with Cloze Questionscited by 1
- 2022Distilling Task-specific Logical Rules from Large Pre-trained Modelscited by 1
- 2023Demonstration-based learning for few-shot biomedical named entity recognition under machine reading comprehensioncited by 1
- 2023Do Language Models Learn about Legal Entity Types during Pretraining?cited by 1
- 2021Teach me how to Label: Labeling Functions from Natural Language with Text-to-text Transformerscited by 0
- 2021Low-Resource Named Entity Recognition Based on Multi-hop Dependency Triggercited by 0
- 2022BTPK-based interpretable method for NER tasks based on Talmudic Public Announcement Logiccited by 0
- 2023Cross-lingual German Biomedical Information Extraction: from Zero-shot to Human-in-the-Loopcited by 0
- 2023A Few-Shot Learning Focused Survey on Recent Named Entity Recognition and Relation Classification Methodscited by 0
- 2023Enhancing AI Research Paper Analysis: Methodology Component Extraction using Factored Transformer-based Sequence Modeling Approachcited by 0
- 2024How much reliable is ChatGPT's prediction on Information Extraction under Input Perturbations?cited by 0
- 2024A Benchmark and Robustness Study of In-Context-Learning with Large Language Models in Music Entity Detection16 Dec 2024
- 2024On Evaluating Explanation Utility for Human-AI Decision Making in NLP3 Jul 2024
- 2024How much reliable is ChatGPT's prediction on Information Extraction under Input Perturbations?7 Apr 2024
- 2024EROS: Entity-Driven Controlled Policy Document Summarization29 Feb 2024
- 2023Enhancing AI Research Paper Analysis: Methodology Component Extraction using Factored Transformer-based Sequence Modeling Approach5 Nov 2023
- 2023A Few-Shot Learning Focused Survey on Recent Named Entity Recognition and Relation Classification Methods29 Oct 2023
- 2023REFER: An End-to-end Rationale Extraction Framework for Explanation Regularization22 Oct 2023
- 2023Do Language Models Learn about Legal Entity Types during Pretraining?19 Oct 2023
- 2023Demonstration-based learning for few-shot biomedical named entity recognition under machine reading comprehension12 Aug 2023
- 2023A Human Subject Study of Named Entity Recognition (NER) in Conversational Music Recommendation Queries13 Mar 2023
- 2023Cross-lingual German Biomedical Information Extraction: from Zero-shot to Human-in-the-Loop24 Jan 2023
- 2022DualNER: A Dual-Teaching framework for Zero-shot Cross-lingual Named Entity Recognition15 Nov 2022
18 more
- 2022XMD: An End-to-End Framework for Interactive Explanation-Based Debugging of NLP Models30 Oct 2022
- 2022State-of-the-art generalisation research in NLP: A taxonomy and review6 Oct 2022
- 2022Distilling Task-specific Logical Rules from Large Pre-trained Models6 Oct 2022
- 2022ER-Test: Evaluating Explanation Regularization Methods for Language Models25 May 2022
- 2022Trigger-GNN: A Trigger-Based Graph Neural Network for Nested Named Entity Recognition12 Apr 2022
- 2022BTPK-based interpretable method for NER tasks based on Talmudic Public Announcement Logic24 Jan 2022
- 2021Few-shot Named Entity Recognition with Cloze Questions24 Nov 2021
- 2021Good Examples Make A Faster Learner: Simple Demonstration-based Learning for Low-resource NER16 Oct 2021
- 2021Low-Resource Named Entity Recognition Based on Multi-hop Dependency Trigger15 Sep 2021
- 2021RockNER: A Simple Method to Create Adversarial Examples for Evaluating the Robustness of Named Entity Recognition Models12 Sep 2021
- 2021AutoTriggER: Label-Efficient and Robust Named Entity Recognition with Auxiliary Trigger Extraction10 Sep 2021
- 2021Probing Pre-trained Auto-regressive Language Models for Named Entity Typing and Recognition26 Aug 2021
- 2021A Survey on Deep Learning Event Extraction: Approaches and Applications5 Jul 2021
- 2021An Empirical Survey of Data Augmentation for Limited Data Learning in NLP14 Jun 2021
- 2021SpanNER: Named Entity Re-/Recognition as Span Prediction1 Jun 2021
- 2021Larger-Context Tagging: When and Why Does It Work?9 Apr 2021
- 2021A Trigger-Sense Memory Flow Framework for Joint Entity and Relation Extraction25 Jan 2021
- 2021Teach me how to Label: Labeling Functions from Natural Language with Text-to-text Transformers18 Jan 2021
- 2021An Empirical Survey of Data Augmentation for Limited Data Learning in NLPcited by 101
- 2022State-of-the-art generalisation research in NLP: A taxonomy and reviewcited by 97
- 2021SpanNER: Named Entity Re-/Recognition as Span Predictioncited by 55
- 2021Good Examples Make A Faster Learner: Simple Demonstration-based Learning for Low-resource NERcited by 38
- 2021RockNER: A Simple Method to Create Adversarial Examples for Evaluating the Robustness of Named Entity Recognition Modelscited by 28
- 2021A Trigger-Sense Memory Flow Framework for Joint Entity and Relation Extractioncited by 26
- 2021A Survey on Deep Learning Event Extraction: Approaches and Applicationscited by 12
- 2021Probing Pre-trained Auto-regressive Language Models for Named Entity Typing and Recognitioncited by 10
- 2024On Evaluating Explanation Utility for Human-AI Decision Making in NLPcited by 9
- 2022XMD: An End-to-End Framework for Interactive Explanation-Based Debugging of NLP Modelscited by 8
- 2022ER-Test: Evaluating Explanation Regularization Methods for Language Modelscited by 6
- 2023A Human Subject Study of Named Entity Recognition (NER) in Conversational Music Recommendation Queriescited by 6
12 most cited of 30 All 30 (JSON)
- 2024A Benchmark and Robustness Study of In-Context-Learning with Large Language Models in Music Entity Detection16 Dec 2024
- 2024On Evaluating Explanation Utility for Human-AI Decision Making in NLP3 Jul 2024
- 2024How much reliable is ChatGPT's prediction on Information Extraction under Input Perturbations?7 Apr 2024
- 2024EROS: Entity-Driven Controlled Policy Document Summarization29 Feb 2024
- 2023Enhancing AI Research Paper Analysis: Methodology Component Extraction using Factored Transformer-based Sequence Modeling Approach5 Nov 2023
- 2023A Few-Shot Learning Focused Survey on Recent Named Entity Recognition and Relation Classification Methods29 Oct 2023
- 2023REFER: An End-to-end Rationale Extraction Framework for Explanation Regularization22 Oct 2023
- 2023Do Language Models Learn about Legal Entity Types during Pretraining?19 Oct 2023
- 2023Demonstration-based learning for few-shot biomedical named entity recognition under machine reading comprehension12 Aug 2023
- 2023A Human Subject Study of Named Entity Recognition (NER) in Conversational Music Recommendation Queries13 Mar 2023
- 2023Cross-lingual German Biomedical Information Extraction: from Zero-shot to Human-in-the-Loop24 Jan 2023
- 2022DualNER: A Dual-Teaching framework for Zero-shot Cross-lingual Named Entity Recognition15 Nov 2022
12 newest of 30 All 30 (JSON)