mlsanityData to 7 Oct 2026

SemEval-2022 Task 7: Identifying Plausible Clarifications of Implicit and Underspecified Phrases in Instructional Texts

arXiv 2309.12102 ↗First posted 21 Sep 2023cs.CLcited by 3

Not on the map. Why?

Abstract (arXiv)

We describe SemEval-2022 Task 7, a shared task on rating the plausibility of clarifications in instructional texts. The dataset for this task consists of manually clarified how-to guides for which we generated alternative clarifications and collected human plausibility judgements. The task of participating systems was to automatically determine the plausibility of a clarification in the respective context. In total, 21 participants took part in this task, with the best system achieving an accuracy of 68.9%. This report summarizes the results and findings from 8 teams and their system descriptions. Finally, we show in an additional evaluation that predictions by the top participating team make it possible to identify contexts with multiple plausible clarifications with an accuracy of 75.2%.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 14 of its 35 references that are in the map. First posted on arXiv 21 Sep 2023.

Builds on

14 of 35 references.

References · 14

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  3. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
  4. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
  5. 2019Unsupervised Cross-lingual Representation Learning at Scalecited by 3,907
  6. 2020DeBERTa: Decoding-enhanced BERT with Disentangled Attentioncited by 2,157
  7. 2016The LAMBADA dataset: Word prediction requiring a broad discourse contextcited by 960
  8. 2020Stanza: A Python Natural Language Processing Toolkit for Many Human Languagescited by 719
  9. 2016A Corpus and Evaluation Framework for Deeper Understanding of Commonsense Storiescited by 413
  10. 2019ERNIE: Enhanced Representation through Knowledge Integrationcited by 301
  11. 2018Constituency Parsing with a Self-Attentive Encodercited by 196
  12. 2018WikiAtomicEdits: A Multilingual Corpus of Wikipedia Edits for Modeling Language and Discoursecited by 26
2 more
  1. 2022ArgRewrite V.2: an Annotated Argumentative Revisions Corpuscited by 9
  2. 2019Identifying Editor Roles in Argumentative Writing from Student Revision Historiescited by 2

Built on by

Cited by year

Citing papers per year: 2023: 1; 2024: 2.

3 papers.

  1. 2023Structured Probabilistic Codingcited by 3
  2. 2024Representation Learning with Conditional Information Flow Maximizationcited by 2
  3. 2024Structural Entropy Guided Probabilistic Codingcited by 1