mlsanityData to 7 Oct 2026

BLCU-ICALL at SemEval-2022 Task 1: Cross-Attention Multitasking Framework for Definition Modeling

arXiv 2204.07701 ↗First posted 16 Apr 2022cs.CLcited by 3

Not on the map. Why?

Abstract (arXiv)

This paper describes the BLCU-ICALL system used in the SemEval-2022 Task 1 Comparing Dictionaries and Word Embeddings, the Definition Modeling subtrack, achieving 1st on Italian, 2nd on Spanish and Russian, and 3rd on English and French. We propose a transformer-based multitasking framework to explore the task. The framework integrates multiple embedding architectures through the cross-attention mechanism, and captures the structure of glosses through a masking language model objective. Additionally, we also investigate a simple but effective model ensembling strategy to further improve the robustness. The evaluation results show the effectiveness of our solution. We release our code at: https://github.com/blcuicall/SemEval2022-Task1-DM.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 22 of its 34 references that are in the map. First posted on arXiv 16 Apr 2022.

Builds on

22 of 34 references.

References · 22

  1. 2017Attention Is All You Needcited by 59,932
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  3. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  4. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
  5. 2013Efficient Estimation of Word Representations in Vector Spacecited by 4,346
  6. 2013Distributed Representations of Words and Phrases and their Compositionalitycited by 3,462
  7. 2018SentencePiece: A simple and language independent subword tokenizer and detokenizer for Neural Text Processingcited by 1,973
  8. 2019Language Models as Knowledge Bases?cited by 1,922
  9. 2017Regularizing Neural Networks by Penalizing Confident Output Distributionscited by 461
  10. 2021Recent Advances in Natural Language Processing via Large Pre-Trained Language Models: A Surveycited by 457
  11. 2019MoverScore: Text Generation Evaluating with Contextualized Embeddings and Earth Mover Distancecited by 415
  12. 2020Towards Understanding Ensemble, Knowledge Distillation and Self-Distillation in Deep Learningcited by 292
10 more
  1. 2015Character-Aware Neural Language Modelscited by 129
  2. 2016Definition Modeling: Learning to define word embeddings in natural languagecited by 46
  3. 2018Conditional Generators of Words Definitionscited by 35
  4. 2022Multitasking Framework for Unsupervised Simple Definition Generationcited by 18
  5. 2019Incorporating Sememes into Chinese Definition Modelingcited by 13
  6. 2020VCDM: Leveraging Variational Bi-encoding and Deep Contextualized Word Representations for Improved Definition Modelingcited by 13
  7. 2020Deriving Contextualised Semantic Features from BERT (and Other Transformer Model) Embeddingscited by 12
  8. 2018xSense: Learning Sense-Separated Sparse Representations and Textual Definitions for Explainable Word Sense Networkscited by 8
  9. 2020Toward Cross-Lingual Definition Generation for Language Learnerscited by 5
  10. 2014Learning Word Representations with Hierarchical Sparse Codingcited by 4

Built on by

Cited by year

Citing papers per year: 2022: 1; 2023: 0; 2024: 2.

3 papers.

  1. 2022Semeval-2022 Task 1: CODWOE -- Comparing Dictionaries and Word Embeddingscited by 18
  2. 2024Improving Low-Resource Knowledge Tracing Tasks by Supervised Pre-training and Importance Mechanism Fine-tuningcited by 3
  3. 2024Balancing Speciality and Versatility: A Coarse to Fine Framework for Mitigating Catastrophic Forgetting in Large Language Modelscited by 3