mlsanityData to 14 Oct 2026

A survey of neural-network-based methods utilising comparable data for finding translation equivalents

arXiv 2410.15144 ↗First posted 19 Oct 2024cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

The importance of inducing bilingual dictionary components in many natural language processing (NLP) applications is indisputable. However, the dictionary compilation process requires extensive work and combines two disciplines, NLP and lexicography, while the former often omits the latter. In this paper, we present the most common approaches from NLP that endeavour to automatically induce one of the essential dictionary components, translation equivalents and focus on the neural-network-based methods using comparable data. We analyse them from a lexicographic perspective since their viewpoints are crucial for improving the described methods. Moreover, we identify the methods that integrate these viewpoints and can be further exploited in various applications that require them. This survey encourages a connection between the NLP and lexicography fields as the NLP field can benefit from lexicographic insights, and it serves as a helping and inspiring material for further research in the context of neural-network-based methods utilising comparable data.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 68 of its 146 references that are in the map. First posted on arXiv 19 Oct 2024.

Builds on

68 of 146 references.

References · 68

  1. 2017Attention Is All You Needcited by 60,361
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  3. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
  4. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
  5. 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,893
  6. 2013Efficient Estimation of Word Representations in Vector Spacecited by 4,375
  7. 2019Unsupervised Cross-lingual Representation Learning at Scalecited by 3,935
  8. 2020mT5: A massively multilingual pre-trained text-to-text transformercited by 1,818
  9. 2016Enriching Word Vectors with Subword Informationcited by 1,583
  10. 2019fairseq: A Fast, Extensible Toolkit for Sequence Modelingcited by 1,488
  11. 2019Cross-lingual Language Model Pretrainingcited by 1,090
  12. 2020Multilingual Denoising Pre-training for Neural Machine Translationcited by 1,035
38 more
  1. 2017Word Translation Without Parallel Datacited by 487
  2. 2017Unsupervised Machine Translation Using Monolingual Corpora Onlycited by 273
  3. 2017OpenNMT: Open-source Toolkit for Neural Machine Translationcited by 251
  4. 2013Exploiting Similarities among Languages for Machine Translationcited by 191
  5. 2017Unsupervised Neural Machine Translationcited by 149
  6. 2018A robust self-learning method for fully unsupervised cross-lingual mappings of word embeddingscited by 146
  7. 2017A Survey Of Cross-lingual Word Embedding Modelscited by 143
  8. 2019Neural Machine Translation: A Review and Surveycited by 100
  9. 2018Unsupervised Alignment of Embeddings with Wasserstein Procrustescited by 97
  10. 2018Tensor2Tensor for Neural Machine Translationcited by 85
  11. 2018Loss in Translation: Learning Bilingual Word Mapping with a Retrieval Criterioncited by 70
  12. 2019Cross-Lingual Alignment of Contextual Word Embeddings, with Applications to Zero-shot Dependency Parsingcited by 70
  13. 2018On the Limitations of Unsupervised Bilingual Dictionary Inductioncited by 61
  14. 2014Improving zero-shot learning by mitigating the hubness problemcited by 54
  15. 2020Cross-lingual Retrieval for Iterative Self-Supervised Trainingcited by 54
  16. 2019How to (Properly) Evaluate Cross-Lingual Word Embeddings: On Strong Baselines, Comparative Analyses, and Some Misconceptionscited by 48
  17. 2019Cross-Lingual BERT Transformation for Zero-Shot Dependency Parsingcited by 46
  18. 2019An Effective Approach to Unsupervised Machine Translationcited by 37
  19. 2019Do We Really Need Fully Unsupervised Cross-Lingual Embeddings?cited by 31
  20. 2019Cross-lingual Alignment vs Joint Training: A Comparative Study and A Simple Unified Frameworkcited by 26
  21. 2020LNMap: Departures from Isomorphic Assumption in Bilingual Lexicon Induction Through Non-Linear Mapping in Latent Spacecited by 23
  22. 2020Bilingual Dictionary Based Neural Machine Translation without Using Parallel Sentencescited by 19
  23. 2021Bilingual Lexicon Induction via Unsupervised Bitext Construction and Word Alignmentcited by 19
  24. 2022Improving Word Translation via Two-Stage Contrastive Learningcited by 18
  25. 2019Polyglot Contextual Representations Improve Crosslingual Transfercited by 16
  26. 2019Bilingual Lexicon Induction through Unsupervised Machine Translationcited by 16
  27. 2019Should All Cross-Lingual Embeddings Speak English?cited by 14
  28. 2020Geometry-aware Domain Adaptation for Unsupervised Alignment of Word Embeddingscited by 14
  29. 2019Interactive Refinement of Cross-Lingual Word Embeddingscited by 13
  30. 2016Learning Crosslingual Word Embeddings without Bilingual Corporacited by 12
  31. 2021Combining Static Word Embeddings and Contextual Representations for Bilingual Lexicon Inductioncited by 12
  32. 2021Prix-LM: Pretraining for Multilingual Knowledge Base Constructioncited by 12
  33. 2019Lost in Evaluation: Misleading Benchmarks for Bilingual Dictionary Inductioncited by 10
  34. 2018Uncovering divergent linguistic information in word embeddings with lessons for intrinsic and extrinsic evaluationcited by 8
  35. 2020A Relaxed Matching Procedure for Unsupervised BLIcited by 8
  36. 2020Beyond Offline Mapping: Learning Cross Lingual Word Embeddings through Context Anchoringcited by 8
  37. 2020Multi-Adversarial Learning for Cross-Lingual Word Embeddingscited by 7
  38. 2022Probing Cross-Lingual Lexical Knowledge from Multilingual Sentence Encoderscited by 7

50 most cited of 68 All 68 (JSON)

Built on by

Not cited yet.