Gromov-Wasserstein Alignment of Word Embedding Spaces
Not on the map. Why?
Abstract (arXiv)
Cross-lingual or cross-domain correspondences play key roles in tasks ranging from machine translation to transfer learning. Recently, purely unsupervised methods operating on monolingual embeddings have become effective alignment tools. Current state-of-the-art methods, however, involve multiple steps, including heuristic post-hoc refinement strategies. In this paper, we cast the correspondence problem directly as an optimal transport (OT) problem, building on the idea that word embeddings arise from metric recovery algorithms. Indeed, we exploit the Gromov-Wasserstein distance that measures how similarities between pairs of words relate across languages. We show that our OT objective can be estimated efficiently, requires little or no tuning, and results in performance comparable with the state-of-the-art in various unsupervised word translation tasks.
Key facts. Cited by 119 papers in the map (data through 7 Oct 2026). First posted on arXiv 31 Aug 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 22; 2022: 21; 2023: 29; 2024: 20; 2025: 12; 2026: 15.
119 papers.
Sort:
By area:
- 2024A Survey on Multilingual Large Language Models: Corpora, Alignment, and Biascited by 82
- 2025Harnessing the Universal Geometry of Embeddingscited by 54
- 2021Cross-Domain Imitation Learning via Optimal Transportcited by 49
- 2022Unbalanced Optimal Transport, from Theory to Numericscited by 45
- 2025Shared Global and Local Geometry of Language Model Embeddingscited by 34
- 2021AlignMixup: Improving Representations By Interpolating Aligned Featurescited by 33
- 2023Scalable Optimal Transport Methods in Machine Learning: A Contemporary Surveycited by 27
- 2023GENOT: Entropic (Gromov) Wasserstein Flow Matching with Applications to Single-Cell Genomicscited by 27
- 2023Pre-training for Speech Translation: CTC Meets Optimal Transportcited by 25
- 2022Wasserstein Task Embedding for Measuring Task Similaritiescited by 24
- 2021Improving Neural Cross-Lingual Summarization via Employing Optimal Transport Distance for Knowledge Distillationcited by 22
- 2021Bilingual Lexicon Induction via Unsupervised Bitext Construction and Word Alignmentcited by 19
38 more
- 2021Using Optimal Transport as Alignment Objective for fine-tuning Multilingual Contextualized Embeddingscited by 19
- 2023Discovering Universal Geometry in Embeddings with ICAcited by 19
- 2021Quantized Gromov-Wassersteincited by 18
- 2021Adaptive Hierarchical Graph Reasoning with Semantic Coherence for Video-and-Language Inferencecited by 18
- 2022An improved central limit theorem and fast convergence rates for entropic transportation costscited by 18
- 2023Wasserstein-Fisher-Rao Embedding: Logical Query Embeddings with Local Comparison and Global Transportcited by 16
- 2024Neural Optimal Transport with Lagrangian Costscited by 16
- 2021On Transportation of Mini-batches: A Hierarchical Approachcited by 15
- 2025It's a (Blind) Match! Towards Vision-Language Correspondence without Parallel Datacited by 13
- 2021Entropic Gromov-Wasserstein between Gaussian Distributionscited by 12
- 2024Distributional Reduction: Unifying Dimensionality Reduction and Clustering with Gromov-Wassersteincited by 12
- 2024The Z-Gromov-Wasserstein Distancecited by 12
- 2021NeuraCrypt: Hiding Private Health Data via Random Neural Networks for Public Trainingcited by 11
- 2022Efficient Approximation of Gromov-Wasserstein Distance Using Importance Sparsificationcited by 11
- 2021Scalable Optimal Transport in High Dimensions for Graph Distances, Embedding Alignment, and Morecited by 10
- 2022InfoOT: Information Maximizing Optimal Transportcited by 9
- 2023Task-Agnostic Low-Rank Adapters for Unseen English Dialectscited by 9
- 2021Manifold optimization for non-linear optimal transport problemscited by 8
- 2022Towards a Broad Coverage Named Entity Resource: A Data-Efficient Approach for Many Diverse Languagescited by 8
- 2024Source-Free Domain Adaptation for YOLO Object Detectioncited by 8
- 2022Riemannian block SPD coupling manifold and its application to optimal transportcited by 7
- 2022IsoVec: Controlling the Relative Isomorphism of Word Embedding Spacescited by 7
- 2023Globally solving the Gromov-Wasserstein problem for point clouds in low dimensional Euclidean spacescited by 7
- 2024A New Robust Partial p-Wasserstein-Based Metric for Comparing Distributionscited by 7
- 2021Cross-Lingual Word Embedding Refinement by ℓ1 Norm Optimisationcited by 6
- 2022Gromov-Wasserstein Discrepancy with Local Differential Privacy for Distributed Structural Graphscited by 6
- 2022Unbalanced CO-Optimal Transportcited by 6
- 2022Bilingual Lexicon Induction for Low-Resource Languages using Graph Matching via Optimal Transportcited by 6
- 2022Quantized Wasserstein Procrustes Alignment of Word Embedding Spacescited by 6
- 2023Outlier-Robust Gromov-Wasserstein for Graph Datacited by 6
- 2023Uncovering Challenges of Solving the Continuous Gromov-Wasserstein Problemcited by 6
- 2023Applications of No-Collision Transportation Maps in Manifold Learningcited by 6
- 2021Cycle Consistent Probability Divergences Across Different Spacescited by 5
- 2022Transferable Reward Learning by Dynamics-Agnostic Discriminator Ensemblecited by 5
- 2023Personalised Federated Learning On Heterogeneous Feature Spacescited by 5
- 2024Revisiting Cosine Similarity via Normalized ICA-transformed Embeddingscited by 5
- 2024Cross-domain Named Entity Recognition via Graph Matchingcited by 5
- 2024Tree-Wasserstein Distance for High Dimensional Data with a Latent Feature Hierarchycited by 5
50 most cited of 119 All 119 (JSON)
- 2026Beyond Linear Concepts: Discovering and Aligning Non-Linear Concept Manifolds in Large Language Models1 Oct 2026
- 2026A Unified Dual Method for Matching Problems30 Sep 2026
- 2026Averaged Mirror Descent and Dual Gradient Methods: Convergent Algorithms for Entropic Gromov-Wasserstein Problems25 Sep 2026
- 2026A Novel Semantic Manifold Alignment Attack against Embedding-to-Embedding Obfuscation in Privacy-Preserving LLMs6 Sep 2026
- 2026Measuring Optimal Transport in Transformer Depth1 Sep 2026
- 2026Unsupervised Latent Space Alignment with Hyperspherical Geodesic Matching28 Aug 2026
- 2026Gromov-Wasserstein Quantization and Clustering: Structure, Rates, and Algorithms11 Aug 2026
- 2026Multimodal Alignment Through Joint Kernel Entropic Gromov--Wasserstein Optimal Transport4 Aug 2026
- 2026Cluster-Aware Matching via Laplacian Optimal Transport17 Jul 2026
- 2026A Riemannian Approach to Low-Rank Optimal Transport10 Jun 2026
- 2026Platonic Representations in the Human Brain: Unsupervised Recovery of Universal Geometry19 May 2026
- 2026SEMASIA: A Large-Scale Dataset of Semantically Structured Latent Representations10 May 2026
38 more
- 2026Concept Heterogeneity-aware Representation Steering13 Feb 2026
- 2026Robust Generalization with Adaptive Optimal Transport Priors for Decision-Focused Learning1 Feb 2026
- 2026Universal Latent Homeomorphic Manifolds: A Framework for Cross-Domain Representation Unification13 Jan 2026
- 2025Forget BIT, It is All about TOKEN: Towards Semantic Information Theory for LLMs3 Nov 2025
- 2025mini-vec2vec: Scaling Universal Geometry Alignment with Linear Transformations27 Sep 2025
- 2025Co-Alignment: Rethinking Alignment as Bidirectional Human-AI Cognitive Adaptation15 Sep 2025
- 2025Agentic Design Review System14 Aug 2025
- 2025Robust Alignment via Partial Gromov-Wasserstein Distances26 Jun 2025
- 2025Neural Estimation for Scaling Entropic Multimarginal Optimal Transport31 May 2025
- 2025Investigating Fine- and Coarse-grained Structural Correspondences Between Deep Neural Networks and Human Object Image Similarity Judgments Using Unsupervised Alignment22 May 2025
- 2025Harnessing the Universal Geometry of Embeddings18 May 2025
- 2025Variational Online Mirror Descent for Robust Learning in Schr"odinger Bridge3 Apr 2025
- 2025It's a (Blind) Match! Towards Vision-Language Correspondence without Parallel Data31 Mar 2025
- 2025Formation Shape Control using the Gromov-Wasserstein Metric27 Mar 2025
- 2025Shared Global and Local Geometry of Language Model Embeddings27 Mar 2025
- 2024Tree-Wasserstein Distance for High Dimensional Data with a Latent Feature Hierarchy28 Oct 2024
- 2024Linear Partial Gromov-Wasserstein Embedding22 Oct 2024
- 2024Source-Free Domain Adaptation for YOLO Object Detection25 Sep 2024
- 2024A Riemannian Approach to Ground Metric Learning for Optimal Transport16 Sep 2024
- 2024The Z-Gromov-Wasserstein Distance15 Aug 2024
- 2024Cross-domain Named Entity Recognition via Graph Matching2 Aug 2024
- 2024Improving Hyperbolic Representations via Gromov-Wasserstein Regularization15 Jul 2024
- 2024Latent Functional Maps: a spectral framework for representation alignment20 Jun 2024
- 2024Scalable unsupervised alignment of general metric and non-metric structures19 Jun 2024
- 2024Revisiting Cosine Similarity via Normalized ICA-transformed Embeddings16 Jun 2024
- 2024Submodular Framework for Structured-Sparse Optimal Transport7 Jun 2024
- 2024Neural Optimal Transport with Lagrangian Costs1 Jun 2024
- 2024Aligning Embeddings and Geometric Random Graphs: Informational Results and Computational Approaches for the Procrustes-Wasserstein Problem23 May 2024
- 2024Max-sliced Wasserstein concentration and uniform ratio bounds of empirical measures on RKHS21 May 2024
- 2024A New Robust Partial p-Wasserstein-Based Metric for Comparing Distributions6 May 2024
- 2024A Universal Metric of Dataset Similarity for Cross-silo Federated Learning29 Apr 2024
- 2024Fast Gradient Computation for Gromov-Wasserstein Distance13 Apr 2024
- 2024How Lexical is Bilingual Lexicon Induction?5 Apr 2024
- 2024A Survey on Multilingual Large Language Models: Corpora, Alignment, and Bias1 Apr 2024
- 2024Distributional Reduction: Unifying Dimensionality Reduction and Clustering with Gromov-Wasserstein3 Feb 2024
- 2023Robust Point Matching with Distance Profiles19 Dec 2023
- 2023Covariance alignment: from maximum likelihood estimation to Gromov-Wasserstein22 Nov 2023
- 2023Monotone Generative Modeling via a Gromov-Monge Embedding2 Nov 2023
50 newest of 119 All 119 (JSON)
- 2025Agentic Design Review Systemcited by 2
- 2025Agentic Design Review System14 Aug 2025
- 2024A Survey on Multilingual Large Language Models: Corpora, Alignment, and Biascited by 82
- 2025Harnessing the Universal Geometry of Embeddingscited by 54
- 2022Unbalanced Optimal Transport, from Theory to Numericscited by 45
- 2025Shared Global and Local Geometry of Language Model Embeddingscited by 34
- 2021AlignMixup: Improving Representations By Interpolating Aligned Featurescited by 33
- 2023Scalable Optimal Transport Methods in Machine Learning: A Contemporary Surveycited by 27
- 2023Pre-training for Speech Translation: CTC Meets Optimal Transportcited by 25
- 2022Wasserstein Task Embedding for Measuring Task Similaritiescited by 24
- 2021Improving Neural Cross-Lingual Summarization via Employing Optimal Transport Distance for Knowledge Distillationcited by 22
- 2021Bilingual Lexicon Induction via Unsupervised Bitext Construction and Word Alignmentcited by 19
- 2021Using Optimal Transport as Alignment Objective for fine-tuning Multilingual Contextualized Embeddingscited by 19
- 2023Discovering Universal Geometry in Embeddings with ICAcited by 19
12 most cited of 112 All 112 (JSON)
- 2026A Unified Dual Method for Matching Problems30 Sep 2026
- 2026Averaged Mirror Descent and Dual Gradient Methods: Convergent Algorithms for Entropic Gromov-Wasserstein Problems25 Sep 2026
- 2026A Novel Semantic Manifold Alignment Attack against Embedding-to-Embedding Obfuscation in Privacy-Preserving LLMs6 Sep 2026
- 2026Measuring Optimal Transport in Transformer Depth1 Sep 2026
- 2026Unsupervised Latent Space Alignment with Hyperspherical Geodesic Matching28 Aug 2026
- 2026Gromov-Wasserstein Quantization and Clustering: Structure, Rates, and Algorithms11 Aug 2026
- 2026Multimodal Alignment Through Joint Kernel Entropic Gromov--Wasserstein Optimal Transport4 Aug 2026
- 2026Cluster-Aware Matching via Laplacian Optimal Transport17 Jul 2026
- 2026A Riemannian Approach to Low-Rank Optimal Transport10 Jun 2026
- 2026Platonic Representations in the Human Brain: Unsupervised Recovery of Universal Geometry19 May 2026
- 2026SEMASIA: A Large-Scale Dataset of Semantically Structured Latent Representations10 May 2026
- 2026Concept Heterogeneity-aware Representation Steering13 Feb 2026
12 newest of 112 All 112 (JSON)