Exploiting Similarities among Languages for Machine Translation
Not on the map. Why?
Abstract (arXiv)
Dictionaries and phrase tables are the basis of modern statistical machine translation systems. This paper develops a method that can automate the process of generating and extending dictionaries and phrase tables. Our method can translate missing word and phrase entries by learning language structures based on large monolingual data and mapping between languages from small bilingual data. It uses distributed representation of words and learns a linear mapping between vector spaces of languages. Despite its simplicity, our method is surprisingly effective: we can achieve almost 90% precision@5 for translation of words between English and Spanish. This method makes little assumption about the languages, so it can be used to extend and refine dictionaries and translation tables for any language pairs.
Key facts. Cited by 187 papers in the map (data through 7 Oct 2026). First posted on arXiv 17 Sep 2013.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 46; 2022: 43; 2023: 29; 2024: 28; 2025: 21; 2026: 20.
187 papers.
Sort:
By area:
- 2023The Linear Representation Hypothesis and the Geometry of Large Language Modelscited by 679
- 2021Few-shot Learning with Multilingual Language Modelscited by 278
- 2023ChatGPT Beyond English: Towards a Comprehensive Evaluation of Large Language Models in Multilingual Learningcited by 203
- 2022Relative representations enable zero-shot latent space communicationcited by 175
- 2021Unsupervised Speech Recognitioncited by 147
- 2021mMARCO: A Multilingual Version of the MS MARCO Passage Ranking Datasetcited by 116
- 2021Cross-Attention is All You Need: Adapting Pretrained Transformers for Machine Translationcited by 74
- 2024The Semantic Hub Hypothesis: Language Models Share Semantic Representations Across Languages and Modalitiescited by 69
- 2021First Align, then Predict: Understanding the Cross-Lingual Ability of Multilingual BERTcited by 64
- 2021A Primer on Pretrained Multilingual Language Modelscited by 49
- 2023Latent Space Translation via Semantic Alignmentcited by 46
- 2022Expanding Pretrained Models to Thousands More Languages via Lexicon-based Adaptationcited by 44
38 more
- 2024Do Vision and Language Encoders Represent the World Similarly?cited by 44
- 2021Consistency Regularization for Cross-Lingual Fine-Tuningcited by 41
- 2023Black Box Few-Shot Adaptation for Vision-Language modelscited by 39
- 2025Shared Global and Local Geometry of Language Model Embeddingscited by 34
- 2023CiCo: Domain-Aware Sign Language Retrieval via Cross-Lingual Contrastive Learningcited by 32
- 2022Match the Script, Adapt if Multilingual: Analyzing the Effect of Multilingual Pretraining on Cross-lingual Transferabilitycited by 26
- 2025Middle-Layer Representation Alignment for Cross-Lingual Transfer in Fine-Tuned LLMscited by 26
- 2024Bridging the Language Gaps in Large Language Models with Inference-Time Cross-Lingual Interventioncited by 24
- 2025Mechanistic Interpretability of Emotion Inference in Large Language Modelscited by 24
- 2021On Cross-Lingual Retrieval with Multilingual Text Encoderscited by 22
- 2021Improving Zero-Shot Cross-Lingual Transfer Learning via Robust Trainingcited by 21
- 2021Bilingual Lexicon Induction via Unsupervised Bitext Construction and Word Alignmentcited by 19
- 2021Using Optimal Transport as Alignment Objective for fine-tuning Multilingual Contextualized Embeddingscited by 19
- 2023Discovering Universal Geometry in Embeddings with ICAcited by 19
- 2023Hyperpolyglot LLMs: Cross-Lingual Interpretability in Token Embeddingscited by 19
- 2022Improving Word Translation via Two-Stage Contrastive Learningcited by 18
- 2021Crossing the Conversational Chasm: A Primer on Natural Language Processing for Multilingual Task-Oriented Dialogue Systemscited by 16
- 2022Learning Backward Compatible Embeddingscited by 16
- 2022USCORE: An Effective Approach to Fully Unsupervised Evaluation Metrics for Machine Translationcited by 15
- 2024Attention layers provably solve single-location regressioncited by 15
- 2021Multilingual and cross-lingual document classification: A meta-learning approachcited by 14
- 2021AM2iCo: Evaluating Word Meaning in Context across Low-Resource Languages with Adversarial Examplescited by 14
- 2025Language Model Behavioral Phases are Consistent Across Architecture, Training Data, and Scalecited by 13
- 2021Combining Static Word Embeddings and Contextual Representations for Bilingual Lexicon Inductioncited by 12
- 2021Subword Mapping and Anchoring across Languagescited by 12
- 2022Reducing Retraining by Recycling Parameter-Efficient Promptscited by 11
- 2021Multi-source Learning via Completion of Block-wise Overlapping Noisy Matricescited by 10
- 2021Code-switched inspired losses for generic spoken dialog representationscited by 10
- 2022Cross-Linguistic Syntactic Difference in Multilingual BERT: How Good is It and How Does It Affect Transfer?cited by 10
- 2023Massively Multilingual Corpus of Sentiment Datasets and Multi-faceted Sentiment Classification Benchmarkcited by 10
- 2024Latent Space Translation via Inverse Relative Projectioncited by 10
- 2024T-FREE: Subword Tokenizer-Free Generative LLMs via Sparse Representations for Memory-Efficient Embeddingscited by 10
- 2021Unsupervised Multilingual Sentence Embeddings for Parallel Corpus Miningcited by 9
- 2021Identification of Biased Terms in News Articles by Comparison of Outlet-specific Word Embeddingscited by 9
- 2025GenRecal: Generation after Recalibration from Large to Small Vision-Language Modelscited by 9
- 2021Analyzing Zero-shot Cross-lingual Transfer in Supervised NLP Taskscited by 8
- 2021Bootstrapping Multilingual AMR with Contextual Word Alignmentscited by 8
- 2022Towards a Broad Coverage Named Entity Resource: A Data-Efficient Approach for Many Diverse Languagescited by 8
50 most cited of 187 All 187 (JSON)
- 2026Word Similarity Datasets for Indian Languages: Annotation and Baseline Systems28 Sep 2026
- 2026Right Tool, Right Job: Native-Language Evaluation, Tokenizer Sensitivity, and Methodological Findings from a French-Only BabyLM15 Sep 2026
- 2026Cross-Lingual Alignment Without Joint Training: Do Monolingual Language Models Converge on Universal Representations?27 Aug 2026
- 2026Cross-lingual Representation Learning via Centroid Intervention Fusion26 Aug 2026
- 2026Aligning Biomedical Texts and Knowledge Graphs: A Systematic Comparison of Lightweight Alignment Strategies24 Aug 2026
- 2026Frozen Memory Is Not Enough: Rethinking External Memory as Extraction17 Aug 2026
- 2026Token-to-Token Alignment of Text Embeddings for Semantic Blending22 Jun 2026
- 2026Geometry-Preserving Unsupervised Alignment for Heterogeneous Foundation Models3 Jun 2026
- 2026Vector Linking via Cross-Model Local Isometric Consistency29 May 2026
- 2026Supervised Semantic Differential for Cross-Cultural Concept Analysis: A Case Study of Human Affect27 May 2026
- 2026Emergent Symbolic Structure in Health Foundation Models: Extraction, Alignment, and Cross-Modal Transfer8 May 2026
- 2026Parallel-SFT: Improving Zero-Shot Cross-Programming-Language Transfer for Code RL22 Apr 2026
38 more
- 2026On the Spectral Geometry of Cross-Modal Representations: A Functional Map Diagnostic for Multimodal Alignment28 Mar 2026
- 2026Weight Tying Biases Token Embeddings Towards the Output Space27 Mar 2026
- 2026Is continuous CoT better suited for multi-lingual reasoning?9 Mar 2026
- 2026Knowledge-Embedded Latent Projection for Robust Representation Learning18 Feb 2026
- 2026Evaluating the impact of word embeddings on similarity scoring in practical information retrieval5 Feb 2026
- 2026LEC-KG: An LLM-Embedding Collaborative Framework for Domain-Specific Knowledge Graph Construction -- A Case Study on SDGs2 Feb 2026
- 2026Corpus-Based Approaches to Igbo Diacritic Restoration26 Jan 2026
- 2026Time Travel Engine: A Shared Latent Chronological Manifold Enables Historical Navigation in Large Language Models10 Jan 2026
- 2025Online Dynamic Pricing of Complementary Products27 Nov 2025
- 2025Detecting and Steering LLMs' Empathy in Action17 Nov 2025
- 2025How Good is BLI as an Alignment Measure: A Study in Word Embedding Paradigm17 Nov 2025
- 2025Language Model Behavioral Phases are Consistent Across Architecture, Training Data, and Scale28 Oct 2025
- 2025When Embedding Models Meet: Procrustes Bounds and Applications15 Oct 2025
- 2025mini-vec2vec: Scaling Universal Geometry Alignment with Linear Transformations27 Sep 2025
- 2025Extracting Conceptual Spaces from LLMs Using Prototype Embeddings23 Sep 2025
- 2025Translate, then Detect: Leveraging Machine Translation for Cross-Lingual Toxicity Classification17 Sep 2025
- 2025Event2Vec: A Geometric Approach to Learning Composable Representations of Event Sequences15 Sep 2025
- 2025On The Role of Pretrained Language Models in General-Purpose Text Embeddings: A Survey28 Jul 2025
- 2025GenRecal: Generation after Recalibration from Large to Small Vision-Language Models18 Jun 2025
- 2025Targeted Lexical Injection: Unlocking Latent Cross-Lingual Alignment in Lugha-Llama via Early-Layer LoRA Fine-Tuning18 Jun 2025
- 2025Static Word Embeddings for Sentence Semantic Representation5 Jun 2025
- 2025The Unreasonable Effectiveness of Model Merging for Cross-Lingual Transfer in LLMs23 May 2025
- 2025Shared Global and Local Geometry of Language Model Embeddings27 Mar 2025
- 2025High-Dimensional Interlingual Representations of Large Language Models14 Mar 2025
- 2025Escaping Plato's Cave: Towards the Alignment of 3D and Text Latent Spaces7 Mar 2025
- 2025Comparative Study of Zero-Shot Cross-Lingual Transfer for Bodo POS and NER Tagging Using Gemini 2.0 Flash Thinking Experimental Model6 Mar 2025
- 2025Middle-Layer Representation Alignment for Cross-Lingual Transfer in Fine-Tuned LLMs20 Feb 2025
- 2025ALGEN: Few-shot Inversion Attacks on Textual Embeddings using Alignment and Generation16 Feb 2025
- 2025Mechanistic Interpretability of Emotion Inference in Large Language Models8 Feb 2025
- 2024Unsupervised Bilingual Lexicon Induction for Low Resource Languages22 Dec 2024
- 2024Modeling Multi-modal Cross-interaction for Multi-label Few-shot Image Classification Based on Local Feature Selection18 Dec 2024
- 2024Fine-tuning Large Language Models with Limited Data: A Survey and Practical Guide14 Nov 2024
- 2024The Semantic Hub Hypothesis: Language Models Share Semantic Representations Across Languages and Modalities7 Nov 2024
- 2024A survey of neural-network-based methods utilising comparable data for finding translation equivalents19 Oct 2024
- 2024Bridging the Language Gaps in Large Language Models with Inference-Time Cross-Lingual Intervention16 Oct 2024
- 2024Attention layers provably solve single-location regression2 Oct 2024
- 2024GrEmLIn: A Repository of Green Baseline Embeddings for 87 Low-Resource Languages Injected with Multilingual Graph Knowledge26 Sep 2024
- 2024Shaping the Future of Endangered and Low-Resource Languages -- Our Role in the Age of LLMs: A Keynote at ECIR 20245 Sep 2024
50 newest of 187 All 187 (JSON)
- 2023The Linear Representation Hypothesis and the Geometry of Large Language Modelscited by 679
- 2021Few-shot Learning with Multilingual Language Modelscited by 278
- 2023ChatGPT Beyond English: Towards a Comprehensive Evaluation of Large Language Models in Multilingual Learningcited by 203
- 2022Relative representations enable zero-shot latent space communicationcited by 175
- 2021Unsupervised Speech Recognitioncited by 147
- 2021mMARCO: A Multilingual Version of the MS MARCO Passage Ranking Datasetcited by 116
- 2021Cross-Attention is All You Need: Adapting Pretrained Transformers for Machine Translationcited by 74
- 2024The Semantic Hub Hypothesis: Language Models Share Semantic Representations Across Languages and Modalitiescited by 69
- 2021First Align, then Predict: Understanding the Cross-Lingual Ability of Multilingual BERTcited by 64
- 2021A Primer on Pretrained Multilingual Language Modelscited by 49
- 2023Latent Space Translation via Semantic Alignmentcited by 46
- 2022Expanding Pretrained Models to Thousands More Languages via Lexicon-based Adaptationcited by 44
12 most cited of 181 All 181 (JSON)
- 2026Word Similarity Datasets for Indian Languages: Annotation and Baseline Systems28 Sep 2026
- 2026Right Tool, Right Job: Native-Language Evaluation, Tokenizer Sensitivity, and Methodological Findings from a French-Only BabyLM15 Sep 2026
- 2026Cross-Lingual Alignment Without Joint Training: Do Monolingual Language Models Converge on Universal Representations?27 Aug 2026
- 2026Cross-lingual Representation Learning via Centroid Intervention Fusion26 Aug 2026
- 2026Aligning Biomedical Texts and Knowledge Graphs: A Systematic Comparison of Lightweight Alignment Strategies24 Aug 2026
- 2026Frozen Memory Is Not Enough: Rethinking External Memory as Extraction17 Aug 2026
- 2026Token-to-Token Alignment of Text Embeddings for Semantic Blending22 Jun 2026
- 2026Vector Linking via Cross-Model Local Isometric Consistency29 May 2026
- 2026Supervised Semantic Differential for Cross-Cultural Concept Analysis: A Case Study of Human Affect27 May 2026
- 2026Emergent Symbolic Structure in Health Foundation Models: Extraction, Alignment, and Cross-Modal Transfer8 May 2026
- 2026Parallel-SFT: Improving Zero-Shot Cross-Programming-Language Transfer for Code RL22 Apr 2026
- 2026On the Spectral Geometry of Cross-Modal Representations: A Functional Map Diagnostic for Multimodal Alignment28 Mar 2026
12 newest of 181 All 181 (JSON)