mlsanityData to 7 Oct 2026

Maximizing Relation Extraction Potential: A Data-Centric Study to Unveil Challenges and Opportunities

arXiv 2409.04934 ↗First posted 7 Sep 2024cs.CL cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Relation extraction is a Natural Language Processing task that aims to extract relationships from textual data. It is a critical step for information extraction. Due to its wide-scale applicability, research in relation extraction has rapidly scaled to using highly advanced neural networks. Despite their computational superiority, modern relation extractors fail to handle complicated extraction scenarios. However, a comprehensive performance analysis of the state-of-the-art extractors that compile these challenges has been missing from the literature, and this paper aims to bridge this gap. The goal has been to investigate the possible data-centric characteristics that impede neural relation extraction. Based on extensive experiments conducted using 15 state-of-the-art relation extraction algorithms ranging from recurrent architectures to large language models and seven large-scale datasets, this research suggests that modern relation extractors are not robust to complex data and relation characteristics. It emphasizes pivotal issues, such as contextual ambiguity, correlating relations, long-tail data, and fine-grained relation distributions. In addition, it sets a marker for future directions to alleviate these issues, thereby proving to be a critical resource for novice and advanced researchers. Efficient handling of the challenges described can have significant implications for the field of information extraction, which is a critical part of popular systems such as search engines and chatbots. Data and relevant code can be found at urlhttps://aaig.ece.ufl.edu/projects/relation-extraction.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 53 of its 90 references that are in the map. First posted on arXiv 7 Sep 2024.

Builds on

53 of 90 references.

References · 53

  1. 2017Attention Is All You Needcited by 59,932
  2. 2020Language Models are Few-Shot Learnerscited by 32,199
  3. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  4. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
  5. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
  6. 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,874
  7. 2017Billion-scale similarity search with GPUscited by 2,477
  8. 2021SimCSE: Simple Contrastive Learning of Sentence Embeddingscited by 2,168
  9. 2019ERNIE: Enhanced Language Representation with Informative Entitiescited by 525
  10. 2019KEPLER: A Unified Model for Knowledge Embedding and Pre-trained Language Representationcited by 356
  11. 2020LUKE: Deep Contextualized Entity Representations with Entity-aware Self-attentioncited by 326
  12. 2020K-Adapter: Infusing Knowledge into Pre-Trained Models with Adapterscited by 318
38 more
  1. 2019Knowledge Enhanced Contextual Word Representationscited by 294
  2. 2018FewRel: A Large-Scale Supervised Few-Shot Relation Classification Dataset with State-of-the-Art Evaluationcited by 254
  3. 2021How Many Data Points is a Prompt Worth?cited by 197
  4. 2021KnowPrompt: Knowledge-aware Prompt-tuning with Synergistic Optimization for Relation Extractioncited by 180
  5. 2016End-to-End Relation Extraction using LSTMs on Sequences and Tree Structurescited by 161
  6. 2023Large Language Model Is Not a Good Few-shot Information Extractor, but a Good Reranker for Hard Samples!cited by 119
  7. 2019A Survey on Recent Advances in Named Entity Recognition from Deep Learning modelscited by 117
  8. 2017Joint Extraction of Entities and Relations Based on a Novel Tagging Schemecited by 102
  9. 2023Revisiting Relation Extraction in the era of Large Language Modelscited by 100
  10. 2020TACRED Revisited: A Thorough Evaluation of the TACRED Relation Extraction Taskcited by 96
  11. 2019Enriching Pre-trained Language Model with Entity Information for Relation Classificationcited by 82
  12. 2021An Improved Baseline for Sentence-level Relation Extractioncited by 80
  13. 2023LLMs Accelerate Annotation for Medical Information Extractioncited by 77
  14. 2020Learning from Context or Names? An Empirical Study on Neural Relation Extractioncited by 75
  15. 2019Effective Modeling of Encoder-Decoder Architecture for Joint Entity and Relation Extractioncited by 73
  16. 2021Re-TACRED: Addressing Shortcomings of the TACRED Datasetcited by 73
  17. 2020TPLinker: Single-stage Joint Extraction of Entities and Relations Through Token Pair Linkingcited by 72
  18. 2023GPT-RE: In-context Learning for Relation Extraction using Large Language Modelscited by 62
  19. 2022Revisiting DocRED -- Addressing the False Negative Problem in Relation Extractioncited by 57
  20. 2020Joint Entity and Relation Extraction with Set Prediction Networkscited by 54
  21. 2020More Data, More Relations, More Context and More Openness: A Review and Outlook for Relation Extractioncited by 52
  22. 2018RESIDE: Improving Distantly-Supervised Neural Relation Extraction using Side Informationcited by 47
  23. 2018Reinforcement Learning for Relation Classification from Noisy Datacited by 46
  24. 2017Relation Extraction : A Surveycited by 44
  25. 2019UHop: An Unrestricted-Hop Relation Extraction Framework for Knowledge-Based Question Answeringcited by 37
  26. 2023How to Unleash the Power of Large Language Models for Few-shot Relation Extraction?cited by 30
  27. 2023A Comprehensive Survey on Relation Extraction: Recent Advances and New Frontierscited by 21
  28. 2022CrossRE: A Cross-Domain Dataset for Relation Extractioncited by 20
  29. 2020Probing Linguistic Features of Sentence-Level Representations in Neural Relation Extractioncited by 18
  30. 2022What do You Mean by Relation Extraction? A Survey on Datasets and Study on Scientific Relation Classificationcited by 17
  31. 2023REFinD: Relation Extraction Financial Datasetcited by 17
  32. 2016Automatic Extraction of Causal Relations from Natural Language Texts: A Comprehensive Surveycited by 16
  33. 2017A Survey of Deep Learning Methods for Relation Extractioncited by 16
  34. 2022UniRel: Unified Representation and Interaction for Joint Relational Triple Extractioncited by 14
  35. 2019Semantic Relation Classification via Bidirectional LSTM Networks with Entity-aware Attention using Latent Entity Typingcited by 13
  36. 2022Generative Prompt Tuning for Relation Classificationcited by 13
  37. 2021Deep Neural Network Based Relation Extraction: An Overviewcited by 11
  38. 2024GenRES: Rethinking Evaluation for Generative Relation Extraction in the Era of Large Language Modelscited by 7

50 most cited of 53 All 53 (JSON)

Built on by

Not cited yet.