mlsanityData to 7 Oct 2026

SemEval-2022 Task 2: Multilingual Idiomaticity Detection and Sentence Embedding

arXiv 2204.10050 ↗First posted 21 Apr 2022cs.CLcited by 36

Not on the map. Why?

Abstract (arXiv)

This paper presents the shared task on Multilingual Idiomaticity Detection and Sentence Embedding, which consists of two subtasks: (a) a binary classification task aimed at identifying whether a sentence contains an idiomatic expression, and (b) a task based on semantic text similarity which requires the model to adequately represent potentially idiomatic expressions in context. Each subtask includes different settings regarding the amount of training data. Besides the task description, this paper introduces the datasets in English, Portuguese, and Galician and their annotation procedure, the evaluation metrics, and a summary of the participant systems and their results. The task had close to 100 registered participants organised into twenty five teams making over 650 and 150 submissions in the practice and evaluation phases respectively.

Key facts. Cited by 36 papers in the map (data through 7 Oct 2026). Builds on 19 of its 65 references that are in the map. First posted on arXiv 21 Apr 2022.

Builds on

19 of 65 references.

References · 19

  1. 2017Attention Is All You Needcited by 59,932
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  3. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
  4. 2019Unsupervised Cross-lingual Representation Learning at Scalecited by 3,907
  5. 2020mT5: A massively multilingual pre-trained text-to-text transformercited by 1,813
  6. 2017SemEval-2017 Task 1: Semantic Textual Similarity - Multilingual and Cross-lingual Focused Evaluationcited by 998
  7. 2019CCNet: Extracting High Quality Monolingual Datasets from Web Crawl Datacited by 544
  8. 2017Efficient Natural Language Response Suggestion for Smart Replycited by 228
  9. 2021R-Drop: Regularized Dropout for Neural Networkscited by 202
  10. 2020Rethinking embedding coupling in pre-trained language modelscited by 103
  11. 2019Still a Pain in the Neck: Evaluating Text Representations on Lexical Compositioncited by 27
  12. 2021AStitchInLanguageModels: Dataset and Methods for the Exploration of Idiomaticity in Pre-Trained Language Modelscited by 27
7 more
  1. 2021Idiomatic Expression Identification using Semantic Compatibilitycited by 19
  2. 2019BERTRAM: Improved Word Embeddings Have Big Impact on Contextualized Model Performancecited by 18
  3. 2019SemEval-2013 Task 4: Free Paraphrases of Noun Compoundscited by 11
  4. 2022drsphelps at SemEval-2022 Task 2: Learning idiom representations using BERTRAMcited by 5
  5. 2022HIT at SemEval-2022 Task 2: Pre-trained Language Model for Idioms Detectioncited by 3
  6. 2022JARVix at SemEval-2022 Task 2: It Takes One to Know One? Idiomaticity Detection using Zero and One-Shot Learningcited by 1
  7. 2022kpfriends at SemEval-2022 Task 2: NEAMER -- Named Entity Augmented Multi-word Expression Recognizercited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2022: 8; 2023: 6; 2024: 8; 2025: 6; 2026: 8.

36 papers.

Sort:

By area:

  1. 2022BLOOM: A 176B-Parameter Open-Access Multilingual Language Modelcited by 1,968
  2. 2025LLMs as a synthesis between symbolic and distributed approaches to languagecited by 13
  3. 2024Sign of the Times: Evaluating the use of Large Language Models for Idiomaticity Detectioncited by 11
  4. 2022A Report on the Euphemisms Detection Shared Taskcited by 7
  5. 2024Code-Mixed Probes Show How Pre-Trained Models Generalise On Code-Switched Textcited by 7
  6. 2024Enhancing Idiomatic Representation in Multiple Languages via an Adaptive Contrastive Triplet Losscited by 7
  7. 2023Construction Artifacts in Metaphor Identification Datasetscited by 5
  8. 2024PharmaGPT: Domain-Specific Large Language Models for Bio-Pharmaceutical and Chemistrycited by 4
  9. 2024CoAM: Corpus of All-Type Multiword Expressionscited by 4
  10. 2022Sample Efficient Approaches for Idiomaticity Detectioncited by 3
  11. 2023Idioms, Probing and Dangerous Things: Towards Structural Probing for Idiomaticity in Vector Spacecited by 3
  12. 2023Multilingual Multi-Figurative Language Detectioncited by 3
24 more
  1. 2025SemEval-2025 Task 1: AdMIRe -- Advancing Multimodal Idiomaticity Representationcited by 3
  2. 2026Preferences for Idiomatic Language are Acquired Slowly -- and Forgotten Quickly: A Case Study on Swedishcited by 3
  3. 2022Effective Cross-Task Transfer Learning for Explainable Natural Language Inference with T5cited by 2
  4. 2024Topic Aware Probing: From Sentence Length Prediction to Idiom Identification how reliant are Neural Language Models on Topic?cited by 2
  5. 2025A Survey of Idiom Datasets for Psycholinguistic and Computational Researchcited by 2
  6. 2025NLP Datasets for Idiom and Figurative Language Taskscited by 2
  7. 2022UAlberta at SemEval 2022 Task 2: Leveraging Glosses and Translations for Multilingual Idiomaticity Detectioncited by 1
  8. 2024Is Less More? Quality, Quantity and Context in Idiom Processing with Natural Language Modelscited by 1
  9. 2024Investigating Idiomaticity in Word Representationscited by 1
  10. 2026A Parallel Cross-Lingual Benchmark for Multimodal Idiomaticity Understandingcited by 1
  11. 2026SinFoS: A Parallel Dataset for Translating Sinhala Figures of Speechcited by 1
  12. 2022HiJoNLP at SemEval-2022 Task 2: Detecting Idiomaticity of Multiword Expressions using Multilingual Pretrained Language Modelscited by 0
  13. 2022OCHADAI at SemEval-2022 Task 2: Adversarial Training for Multilingual Idiomaticity Detectioncited by 0
  14. 2022HYU at SemEval-2022 Task 2: Effective Idiomaticity Detection with Consideration at Different Levels of Contextualizationcited by 0
  15. 2023tmn at SemEval-2023 Task 9: Multilingual Tweet Intimacy Detection using XLM-T, Google Translate, and Ensemble Learningcited by 0
  16. 2023Assessing Linguistic Generalisation in Language Models: A Dataset for Brazilian Portuguesecited by 0
  17. 2023Unsupervised Paraphrasing of Multiword Expressionscited by 0
  18. 2025Evaluating Large Language Models on Multiword Expressions in Multilingual and Code-Switched Contextscited by 0
  19. 2025Stands to Reason: Investigating the Effect of Reasoning on Idiomaticity Detectioncited by 0
  20. 2026Span Modeling for Idiomaticity and Figurative Language Detection with Span Contrastive Losscited by 0
  21. 2026IdioLink: Retrieving Meaning Beyond Words Across Idiomatic and Literal Expressionscited by 0
  22. 2026Behavioral and Representational Evidence of Binomial Ordering Preferences in Large Language Modelscited by 0
  23. 2026VIVID: A Culturally Grounded Benchmark Exposing the Figurative Language Gap in Vietnamese NLPcited by 0
  24. 2026Wisdom in Unity: The Role of Multilingual Training in Figurative Language Identification in Proverbscited by 0