A survey of neural-network-based methods utilising comparable data for finding translation equivalents
Not on the map. Why?
Abstract (arXiv)
The importance of inducing bilingual dictionary components in many natural language processing (NLP) applications is indisputable. However, the dictionary compilation process requires extensive work and combines two disciplines, NLP and lexicography, while the former often omits the latter. In this paper, we present the most common approaches from NLP that endeavour to automatically induce one of the essential dictionary components, translation equivalents and focus on the neural-network-based methods using comparable data. We analyse them from a lexicographic perspective since their viewpoints are crucial for improving the described methods. Moreover, we identify the methods that integrate these viewpoints and can be further exploited in various applications that require them. This survey encourages a connection between the NLP and lexicography fields as the NLP field can benefit from lexicographic insights, and it serves as a helping and inspiring material for further research in the context of neural-network-based methods utilising comparable data.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 68 of its 146 references that are in the map. First posted on arXiv 19 Oct 2024.
Builds on
68 of 146 references.
References · 68
- 2017Attention Is All You Needcited by 60,361
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
- 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,893
- 2013Efficient Estimation of Word Representations in Vector Spacecited by 4,375
- 2019Unsupervised Cross-lingual Representation Learning at Scalecited by 3,935
- 2020mT5: A massively multilingual pre-trained text-to-text transformercited by 1,818
- 2016Enriching Word Vectors with Subword Informationcited by 1,583
- 2019fairseq: A Fast, Extensible Toolkit for Sequence Modelingcited by 1,488
- 2019Cross-lingual Language Model Pretrainingcited by 1,090
- 2020Multilingual Denoising Pre-training for Neural Machine Translationcited by 1,035
38 more
- 2017Word Translation Without Parallel Datacited by 487
- 2017Unsupervised Machine Translation Using Monolingual Corpora Onlycited by 273
- 2017OpenNMT: Open-source Toolkit for Neural Machine Translationcited by 251
- 2013Exploiting Similarities among Languages for Machine Translationcited by 191
- 2017Unsupervised Neural Machine Translationcited by 149
- 2018A robust self-learning method for fully unsupervised cross-lingual mappings of word embeddingscited by 146
- 2017A Survey Of Cross-lingual Word Embedding Modelscited by 143
- 2019Neural Machine Translation: A Review and Surveycited by 100
- 2018Unsupervised Alignment of Embeddings with Wasserstein Procrustescited by 97
- 2018Tensor2Tensor for Neural Machine Translationcited by 85
- 2018Loss in Translation: Learning Bilingual Word Mapping with a Retrieval Criterioncited by 70
- 2019Cross-Lingual Alignment of Contextual Word Embeddings, with Applications to Zero-shot Dependency Parsingcited by 70
- 2018On the Limitations of Unsupervised Bilingual Dictionary Inductioncited by 61
- 2014Improving zero-shot learning by mitigating the hubness problemcited by 54
- 2020Cross-lingual Retrieval for Iterative Self-Supervised Trainingcited by 54
- 2019How to (Properly) Evaluate Cross-Lingual Word Embeddings: On Strong Baselines, Comparative Analyses, and Some Misconceptionscited by 48
- 2019Cross-Lingual BERT Transformation for Zero-Shot Dependency Parsingcited by 46
- 2019An Effective Approach to Unsupervised Machine Translationcited by 37
- 2019Do We Really Need Fully Unsupervised Cross-Lingual Embeddings?cited by 31
- 2019Cross-lingual Alignment vs Joint Training: A Comparative Study and A Simple Unified Frameworkcited by 26
- 2020LNMap: Departures from Isomorphic Assumption in Bilingual Lexicon Induction Through Non-Linear Mapping in Latent Spacecited by 23
- 2020Bilingual Dictionary Based Neural Machine Translation without Using Parallel Sentencescited by 19
- 2021Bilingual Lexicon Induction via Unsupervised Bitext Construction and Word Alignmentcited by 19
- 2022Improving Word Translation via Two-Stage Contrastive Learningcited by 18
- 2019Polyglot Contextual Representations Improve Crosslingual Transfercited by 16
- 2019Bilingual Lexicon Induction through Unsupervised Machine Translationcited by 16
- 2019Should All Cross-Lingual Embeddings Speak English?cited by 14
- 2020Geometry-aware Domain Adaptation for Unsupervised Alignment of Word Embeddingscited by 14
- 2019Interactive Refinement of Cross-Lingual Word Embeddingscited by 13
- 2016Learning Crosslingual Word Embeddings without Bilingual Corporacited by 12
- 2021Combining Static Word Embeddings and Contextual Representations for Bilingual Lexicon Inductioncited by 12
- 2021Prix-LM: Pretraining for Multilingual Knowledge Base Constructioncited by 12
- 2019Lost in Evaluation: Misleading Benchmarks for Bilingual Dictionary Inductioncited by 10
- 2018Uncovering divergent linguistic information in word embeddings with lessons for intrinsic and extrinsic evaluationcited by 8
- 2020A Relaxed Matching Procedure for Unsupervised BLIcited by 8
- 2020Beyond Offline Mapping: Learning Cross Lingual Word Embeddings through Context Anchoringcited by 8
- 2020Multi-Adversarial Learning for Cross-Lingual Word Embeddingscited by 7
- 2022Probing Cross-Lingual Lexical Knowledge from Multilingual Sentence Encoderscited by 7
50 most cited of 68 All 68 (JSON)
Built on by
Not cited yet.