# Joint entity recognition and relation extraction as a multi-head selection problem

arXiv: https://arxiv.org/abs/1804.07847 · HTML: https://mlsanity.com/paper/1804.07847/

## Key facts

- Cited by 59 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 20 Apr 2018.

## Built on by (most cited first, 30 of 59)

- [LayoutXLM: Multimodal Pre-training for Multilingual Visually-rich Document Understanding](https://mlsanity.com/paper/2104.08836/) (2021)
- [Knowledge Graphs: Opportunities and Challenges](https://mlsanity.com/paper/2303.13948/) (2023)
- [Structured information extraction from complex scientific text with fine-tuned large language models](https://mlsanity.com/paper/2212.05238/) (2022)
- [A Partition Filter Network for Joint Entity and Relation Extraction](https://mlsanity.com/paper/2108.12202/) (2021)
- [PRGC: Potential Relation and Global Correspondence Based Joint Relational Triple Extraction](https://mlsanity.com/paper/2106.09895/) (2021)
- [An End-to-end Model for Entity-level Relation Extraction using Multi-instance Learning](https://mlsanity.com/paper/2102.05980/) (2021)
- [A Trigger-Sense Memory Flow Framework for Joint Entity and Relation Extraction](https://mlsanity.com/paper/2101.10213/) (2021)
- [A Survey on Extraction of Causal Relations from Natural Language Text](https://mlsanity.com/paper/2101.06426/) (2021)
- [A sequence-to-sequence approach for document-level relation extraction](https://mlsanity.com/paper/2204.01098/) (2022)
- [Joint Biomedical Entity and Relation Extraction with Knowledge-Enhanced Collective Inference](https://mlsanity.com/paper/2105.13456/) (2021)
- [What do You Mean by Relation Extraction? A Survey on Datasets and Study on Scientific Relation Classification](https://mlsanity.com/paper/2204.13516/) (2022)
- [A Novel Global Feature-Oriented Relational Triple Extraction Model based on Table Filling](https://mlsanity.com/paper/2109.06705/) (2021)
- [Global Pointer: Novel Efficient Span-based Approach for Named Entity Recognition](https://mlsanity.com/paper/2208.03054/) (2022)
- [A Simple but Effective Bidirectional Framework for Relational Triple Extraction](https://mlsanity.com/paper/2112.04940/) (2021)
- [Deep Neural Approaches to Relation Triplets Extraction: A Comprehensive Survey](https://mlsanity.com/paper/2103.16929/) (2021)
- [MatSciRE: Leveraging Pointer Networks to Automate Entity and Relation Extraction for Material Science Knowledge-base Construction](https://mlsanity.com/paper/2401.09839/) (2024)
- [Jointly Extracting Interventions, Outcomes, and Findings from RCT Reports with LLMs](https://mlsanity.com/paper/2305.03642/) (2023)
- [Imposing Relation Structure in Language-Model Embeddings Using Contrastive Learning](https://mlsanity.com/paper/2109.00840/) (2021)
- [An Information Extraction Study: Take In Mind the Tokenization!](https://mlsanity.com/paper/2303.15100/) (2023)
- [AgentRE: An Agent-Based Framework for Navigating Complex Information Landscapes in Relation Extraction](https://mlsanity.com/paper/2409.01854/) (2024)
- [RTE: A Tool for Annotating Relation Triplets from Text](https://mlsanity.com/paper/2108.08184/) (2021)
- [Building Chinese Biomedical Language Models via Multi-Level Text Discrimination](https://mlsanity.com/paper/2110.07244/) (2021)
- [AIFB-WebScience at SemEval-2022 Task 12: Relation Extraction First -- Using Relation Extraction to Identify Entities](https://mlsanity.com/paper/2203.05325/) (2022)
- [Who Blames or Endorses Whom? Entity-to-Entity Directed Sentiment Extraction in News Text](https://mlsanity.com/paper/2106.01033/) (2021)
- [JaMIE: A Pipeline Japanese Medical Information Extraction System](https://mlsanity.com/paper/2111.04261/) (2021)
- [A Survey on Semantic Processing Techniques](https://mlsanity.com/paper/2310.18345/) (2023)
- [REKnow: Enhanced Knowledge for Joint Entity and Relation Extraction](https://mlsanity.com/paper/2206.05123/) (2022)
- [End-to-End n-ary Relation Extraction for Combination Drug Therapies](https://mlsanity.com/paper/2303.16886/) (2023)
- [Leveraging Unlabeled Data for Entity-Relation Extraction through Probabilistic Constraint Satisfaction](https://mlsanity.com/paper/2103.11062/) (2021)
- [Adjacency List Oriented Relational Fact Extraction via Adaptive Multi-task Learning](https://mlsanity.com/paper/2106.01559/) (2021)

## Abstract (arXiv)

State-of-the-art models for joint entity recognition and relation extraction strongly rely on external natural language processing (NLP) tools such as POS (part-of-speech) taggers and dependency parsers. Thus, the performance of such joint models depends on the quality of the features obtained from these NLP tools. However, these features are not always accurate for various languages and contexts. In this paper, we propose a joint neural model which performs entity recognition and relation extraction simultaneously, without the need of any manually extracted features or the use of any external tool. Specifically, we model the entity recognition task using a CRF (Conditional Random Fields) layer and the relation extraction task as a multi-head selection problem (i.e., potentially identify multiple relations for each entity). We present an extensive experimental setup, to demonstrate the effectiveness of our method using datasets from various contexts (i.e., news, biomedical, real estate) and languages (i.e., English, Dutch). Our model outperforms the previous neural models that use automatically extracted features, while it performs within a reasonable margin of feature-based neural models, or even beats them.