mlsanityData to 7 Oct 2026

drsphelps at SemEval-2022 Task 2: Learning idiom representations using BERTRAM

arXiv 2204.02821 ↗First posted 6 Apr 2022cs.CLcited by 5

Not on the map. Why?

Abstract (arXiv)

This paper describes our system for SemEval-2022 Task 2 Multilingual Idiomaticity Detection and Sentence Embedding sub-task B. We modify a standard BERT sentence transformer by adding embeddings for each idioms, which are created using BERTRAM and a small number of contexts. We show that this technique increases the quality of idiom representations and leads to better performance on the task. We also perform analysis on our final results and show that the quality of the produced idiom embeddings is highly sensitive to the quality of the input contexts.

Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 11 of its 20 references that are in the map. First posted on arXiv 6 Apr 2022.

Builds on

11 of 20 references.

References · 11

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2019Unsupervised Cross-lingual Representation Learning at Scalecited by 3,907
  3. 2013Distributed Representations of Words and Phrases and their Compositionalitycited by 3,462
  4. 2017SemEval-2017 Task 1: Semantic Textual Similarity - Multilingual and Cross-lingual Focused Evaluationcited by 998
  5. 2019CCNet: Extracting High Quality Monolingual Datasets from Web Crawl Datacited by 544
  6. 2017Mimicking Word Embeddings using Subword RNNscited by 30
  7. 2021AStitchInLanguageModels: Dataset and Methods for the Exploration of Idiomaticity in Pre-Trained Language Modelscited by 27
  8. 2019BERTRAM: Improved Word Embeddings Have Big Impact on Contextualized Model Performancecited by 18
  9. 2019Attentive Mimicking: Better Word Embeddings by Attending to Informative Contextscited by 17
  10. 2018Generalizing Word Embeddings using Bag of Subwordscited by 9
  11. 2021Bertinho: Galician BERT Representationscited by 7

Built on by

Cited by year

Citing papers per year: 2022: 2; 2023: 1; 2024: 2.

5 papers.

  1. 2022SemEval-2022 Task 2: Multilingual Idiomaticity Detection and Sentence Embeddingcited by 36
  2. 2024Enhancing Idiomatic Representation in Multiple Languages via an Adaptive Contrastive Triplet Losscited by 7
  3. 2022Sample Efficient Approaches for Idiomaticity Detectioncited by 3
  4. 2024Is Less More? Quality, Quantity and Context in Idiom Processing with Natural Language Modelscited by 1
  5. 2023Unsupervised Paraphrasing of Multiword Expressionscited by 0