SemEval-2010 Task 8: Multi-Way Classification of Semantic Relations Between Pairs of Nominals
Not on the map. Why?
Abstract (arXiv)
In response to the continuing research interest in computational semantic analysis, we have proposed a new task for SemEval-2010: multi-way classification of mutually exclusive semantic relations between pairs of nominals. The task is designed to compare different approaches to the problem and to provide a standard testbed for future research. In this paper, we define the task, describe the creation of the datasets, and discuss the results of the participating 28 systems submitted by 10 teams.
Key facts. Cited by 63 papers in the map (data through 14 Oct 2026). First posted on arXiv 23 Nov 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 18; 2022: 23; 2023: 10; 2024: 7; 2025: 3; 2026: 2.
63 papers.
Sort:
By area:
- 2021KnowPrompt: Knowledge-aware Prompt-tuning with Synergistic Optimization for Relation Extractioncited by 180
- 2021OpenPrompt: An Open-source Framework for Prompt-learningcited by 148
- 2023Evaluating ChatGPT's Information Extraction Capabilities: An Assessment of Performance, Explainability, Calibration, and Faithfulnesscited by 130
- 2021WRENCH: A Comprehensive Benchmark for Weak Supervisioncited by 96
- 2022BioRED: A Rich Biomedical Relation Extraction Datasetcited by 85
- 2021When Can Models Learn From Explanations? A Formal Framework for Understanding the Roles of Explanation Datacited by 75
- 2023GPT-RE: In-context Learning for Relation Extraction using Large Language Modelscited by 62
- 2022Revisiting DocRED -- Addressing the False Negative Problem in Relation Extractioncited by 57
- 2023Aligning Instruction Tasks Unlocks Large Language Models as Zero-Shot Relation Extractorscited by 45
- 2024KnowCoder: Coding Structured Knowledge into LLMs for Universal Information Extractioncited by 34
- 2021Gradient Imitation Reinforcement Learning for Low Resource Relation Extractioncited by 33
- 2022Summarization as Indirect Supervision for Relation Extractioncited by 31
38 more
- 2021Incremental Few-shot Text Classification with Multi-round New Classes: Formulation, Dataset and Systemcited by 30
- 2022Should We Rely on Entity Mentions for Relation Extraction? Debiasing Relation Extraction with Counterfactual Analysiscited by 30
- 2021A Survey on Extraction of Causal Relations from Natural Language Textcited by 25
- 2021SAIS: Supervising and Augmenting Intermediate Steps for Document-Level Relation Extractioncited by 23
- 2022CrossRE: A Cross-Domain Dataset for Relation Extractioncited by 21
- 2022What do You Mean by Relation Extraction? A Survey on Datasets and Study on Scientific Relation Classificationcited by 17
- 2021Not All Models Localize Linguistic Knowledge in the Same Place: A Layer-wise Probing on BERToids' Representationscited by 16
- 2021Deep Neural Approaches to Relation Triplets Extraction: A Comprehensive Surveycited by 12
- 2021CausalBERT: Injecting Causal Knowledge Into Pre-trained Models with Minimal Supervisioncited by 12
- 2021Deep Neural Network Based Relation Extraction: An Overviewcited by 11
- 2023GDA: Generative Data Augmentation Techniques for Relation Extraction Taskscited by 10
- 2021Distantly-Supervised Long-Tailed Relation Extraction Using Constraint Graphscited by 9
- 2022A Distant Supervision Corpus for Extracting Biomedical Relationships Between Chemicals, Diseases and Genescited by 9
- 2024Retrieval-Augmented Generation-based Relation Extractioncited by 9
- 2022Why only Micro-F1? Class Weighting of Measures for Relation Classificationcited by 8
- 2023Weaker Than You Think: A Critical Look at Weakly Supervised Learningcited by 8
- 2022Vector-Quantized Input-Contextualized Soft Prompts for Natural Language Understandingcited by 7
- 2024Recall, Retrieve and Reason: Towards Better In-Context Relation Extractioncited by 6
- 2024Relation Extraction with Fine-Tuned Large Language Models in Retrieval Augmented Generation Frameworkscited by 6
- 2022A Generative Model for Relation Extraction and Classificationcited by 5
- 2024IEPile: Unearthing Large-Scale Schema-Based Information Extraction Corpuscited by 5
- 2024The Odyssey of Commonsense Causality: From Foundational Benchmarks to Cutting-Edge Reasoningcited by 5
- 2022Implicit N-grams Induced by Recurrencecited by 4
- 2022SepLL: Separating Latent Class Labels from Weak Supervision Noisecited by 4
- 2022Event Causality Identification with Causal News Corpus -- Shared Task 3, CASE 2022cited by 4
- 2025Adaptive Rank Allocation for Federated Parameter-Efficient Fine-Tuning of Language Modelscited by 4
- 2021D-REX: Dialogue Relation Extraction with Explanationscited by 3
- 2021Disengagement Cause-and-Effect Relationships Extraction Using an NLP Pipelinecited by 3
- 2022REKnow: Enhanced Knowledge for Joint Entity and Relation Extractioncited by 3
- 2022An Overview of Distant Supervision for Relation Extraction with a Focus on Denoising and Pre-training Methodscited by 3
- 2023Did the Models Understand Documents? Benchmarking Models for Language Understanding in Document-Level Relation Extractioncited by 3
- 2023Enhancing Low-Resource Relation Representations through Multi-View Decouplingcited by 3
- 2024KnowCoder-X: Boosting Multilingual Information Extraction via Codecited by 3
- 2021Do Models Learn the Directionality of Relations? A New Evaluation: Relation Direction Recognitioncited by 2
- 2022GRAPHCACHE: Message Passing as Caching for Sentence-Level Relation Extractioncited by 2
- 2022Span-based joint entity and relation extraction augmented with sequence tagging mechanismcited by 2
- 2022Continual Contrastive Finetuning Improves Low-Resource Relation Extractioncited by 2
- 2023Jointprop: Joint Semi-supervised Learning for Entity and Relation Extraction with Heterogeneous Graph-based Propagationcited by 2
50 most cited of 63 All 63 (JSON)
- 2026Benchmarking LLMs for Pairwise Causal Discovery in Biomedical and Multi-Domain Contexts21 Jan 2026
- 2026Relation Extraction Capabilities of LLMs on Clinical Text: A Bilingual Evaluation for English and Turkish14 Jan 2026
- 2025Retrieval-augmented Prompt Learning for Pre-trained Foundation Models23 Dec 2025
- 2025Investigating Counterclaims in Causality Extraction from Text9 Oct 2025
- 2025Adaptive Rank Allocation for Federated Parameter-Efficient Fine-Tuning of Language Models24 Jan 2025
- 2024KnowCoder-X: Boosting Multilingual Information Extraction via Code7 Nov 2024
- 2024The Odyssey of Commonsense Causality: From Foundational Benchmarks to Cutting-Edge Reasoning27 Jun 2024
- 2024Relation Extraction with Fine-Tuned Large Language Models in Retrieval Augmented Generation Frameworks20 Jun 2024
- 2024Recall, Retrieve and Reason: Towards Better In-Context Relation Extraction27 Apr 2024
- 2024Retrieval-Augmented Generation-based Relation Extraction20 Apr 2024
- 2024KnowCoder: Coding Structured Knowledge into LLMs for Universal Information Extraction12 Mar 2024
- 2024IEPile: Unearthing Large-Scale Schema-Based Information Extraction Corpus22 Feb 2024
38 more
- 2023Enhancing Low-Resource Relation Representations through Multi-View Decoupling26 Dec 2023
- 2023Did the Models Understand Documents? Benchmarking Models for Language Understanding in Document-Level Relation Extraction20 Jun 2023
- 2023Semi-supervised Relation Extraction via Data Augmentation and Consistency-training16 Jun 2023
- 2023Weaker Than You Think: A Critical Look at Weakly Supervised Learning27 May 2023
- 2023GDA: Generative Data Augmentation Techniques for Relation Extraction Tasks26 May 2023
- 2023Jointprop: Joint Semi-supervised Learning for Entity and Relation Extraction with Heterogeneous Graph-based Propagation25 May 2023
- 2023Aligning Instruction Tasks Unlocks Large Language Models as Zero-Shot Relation Extractors18 May 2023
- 2023GPT-RE: In-context Learning for Relation Extraction using Large Language Models3 May 2023
- 2023Evaluating ChatGPT's Information Extraction Capabilities: An Assessment of Performance, Explainability, Calibration, and Faithfulness23 Apr 2023
- 2023LabelPrompt: Effective Prompt-based Learning for Relation Classification16 Feb 2023
- 2022Continual Contrastive Finetuning Improves Low-Resource Relation Extraction21 Dec 2022
- 2022Event Causality Identification with Causal News Corpus -- Shared Task 3, CASE 202222 Nov 2022
- 2022Gradient Imitation Reinforcement Learning for General Low-Resource Information Extraction11 Nov 2022
- 2022SepLL: Separating Latent Class Labels from Weak Supervision Noise25 Oct 2022
- 2022Augmenting Task-Oriented Dialogue Systems with Relation Extraction24 Oct 2022
- 2022Span-based joint entity and relation extraction augmented with sequence tagging mechanism23 Oct 2022
- 2022CrossRE: A Cross-Domain Dataset for Relation Extraction17 Oct 2022
- 2022An Overview of Distant Supervision for Relation Extraction with a Focus on Denoising and Pre-training Methods17 Jul 2022
- 2022REKnow: Enhanced Knowledge for Joint Entity and Relation Extraction10 Jun 2022
- 2022Revisiting DocRED -- Addressing the False Negative Problem in Relation Extraction25 May 2022
- 2022Vector-Quantized Input-Contextualized Soft Prompts for Natural Language Understanding23 May 2022
- 2022Summarization as Indirect Supervision for Relation Extraction19 May 2022
- 2022Why only Micro-F1? Class Weighting of Measures for Relation Classification19 May 2022
- 2022GRAPHCACHE: Message Passing as Caching for Sentence-Level Relation Extraction8 May 2022
- 2022Should We Rely on Entity Mentions for Relation Extraction? Debiasing Relation Extraction with Counterfactual Analysis8 May 2022
- 2022Implicit N-grams Induced by Recurrence5 May 2022
- 2022What do You Mean by Relation Extraction? A Survey on Datasets and Study on Scientific Relation Classification28 Apr 2022
- 2022CREER: A Large-Scale Corpus for Relation Extraction and Entity Recognition27 Apr 2022
- 2022A Distant Supervision Corpus for Extracting Biomedical Relationships Between Chemicals, Diseases and Genes13 Apr 2022
- 2022BioRED: A Rich Biomedical Relation Extraction Dataset8 Apr 2022
- 2022Evaluating Prompts Across Multiple Choice Tasks In a Zero-Shot Setting29 Mar 2022
- 2022A Generative Model for Relation Extraction and Classification26 Feb 2022
- 2022POTATO: exPlainable infOrmation exTrAcTion framewOrk31 Jan 2022
- 2021Disengagement Cause-and-Effect Relationships Extraction Using an NLP Pipeline5 Nov 2021
- 2021OpenPrompt: An Open-source Framework for Prompt-learning3 Nov 2021
- 2021SAIS: Supervising and Augmenting Intermediate Steps for Document-Level Relation Extraction24 Sep 2021
- 2021WRENCH: A Comprehensive Benchmark for Weak Supervision23 Sep 2021
- 2021Gradient Imitation Reinforcement Learning for Low Resource Relation Extraction14 Sep 2021
50 newest of 63 All 63 (JSON)
- 2021KnowPrompt: Knowledge-aware Prompt-tuning with Synergistic Optimization for Relation Extractioncited by 180
- 2021OpenPrompt: An Open-source Framework for Prompt-learningcited by 148
- 2023Evaluating ChatGPT's Information Extraction Capabilities: An Assessment of Performance, Explainability, Calibration, and Faithfulnesscited by 130
- 2021WRENCH: A Comprehensive Benchmark for Weak Supervisioncited by 96
- 2022BioRED: A Rich Biomedical Relation Extraction Datasetcited by 85
- 2021When Can Models Learn From Explanations? A Formal Framework for Understanding the Roles of Explanation Datacited by 75
- 2023GPT-RE: In-context Learning for Relation Extraction using Large Language Modelscited by 62
- 2022Revisiting DocRED -- Addressing the False Negative Problem in Relation Extractioncited by 57
- 2023Aligning Instruction Tasks Unlocks Large Language Models as Zero-Shot Relation Extractorscited by 45
- 2024KnowCoder: Coding Structured Knowledge into LLMs for Universal Information Extractioncited by 34
- 2021Gradient Imitation Reinforcement Learning for Low Resource Relation Extractioncited by 33
- 2022Summarization as Indirect Supervision for Relation Extractioncited by 31
12 most cited of 59 All 59 (JSON)
- 2026Benchmarking LLMs for Pairwise Causal Discovery in Biomedical and Multi-Domain Contexts21 Jan 2026
- 2026Relation Extraction Capabilities of LLMs on Clinical Text: A Bilingual Evaluation for English and Turkish14 Jan 2026
- 2025Investigating Counterclaims in Causality Extraction from Text9 Oct 2025
- 2025Adaptive Rank Allocation for Federated Parameter-Efficient Fine-Tuning of Language Models24 Jan 2025
- 2024KnowCoder-X: Boosting Multilingual Information Extraction via Code7 Nov 2024
- 2024The Odyssey of Commonsense Causality: From Foundational Benchmarks to Cutting-Edge Reasoning27 Jun 2024
- 2024KnowCoder: Coding Structured Knowledge into LLMs for Universal Information Extraction12 Mar 2024
- 2024IEPile: Unearthing Large-Scale Schema-Based Information Extraction Corpus22 Feb 2024
- 2023Enhancing Low-Resource Relation Representations through Multi-View Decoupling26 Dec 2023
- 2023Did the Models Understand Documents? Benchmarking Models for Language Understanding in Document-Level Relation Extraction20 Jun 2023
- 2023Semi-supervised Relation Extraction via Data Augmentation and Consistency-training16 Jun 2023
- 2023Weaker Than You Think: A Critical Look at Weakly Supervised Learning27 May 2023
12 newest of 59 All 59 (JSON)