Are Girls Neko or Sh=ojo? Cross-Lingual Alignment of Non-Isomorphic Embeddings with Iterative Normalization
Not on the map. Why?
Abstract (arXiv)
Cross-lingual word embeddings (CLWE) underlie many multilingual natural language processing systems, often through orthogonal transformations of pre-trained monolingual embeddings. However, orthogonal mapping only works on language pairs whose embeddings are naturally isomorphic. For non-isomorphic pairs, our method (Iterative Normalization) transforms monolingual embeddings to make orthogonal alignment easier by simultaneously enforcing that (1) individual word vectors are unit length, and (2) each language's average vector is zero. Iterative Normalization consistently improves word translation accuracy of three CLWE methods, with the largest improvement observed on English-Japanese (from 2% to 44% test accuracy).
Key facts. Cited by 15 papers in the map (data through 7 Oct 2026). First posted on arXiv 4 Jun 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 6; 2022: 4; 2023: 3; 2024: 1; 2025: 1.
15 papers.
Sort:
- 2021Optimization of Graph Neural Networks: Implicit Acceleration by Skip Connections and More Depthcited by 55
- 2023CiCo: Domain-Aware Sign Language Retrieval via Cross-Lingual Contrastive Learningcited by 32
- 2022Learning Backward Compatible Embeddingscited by 16
- 2021A Massively Multilingual Analysis of Cross-linguality in Shared Embedding Spacecited by 8
- 2022IsoVec: Controlling the Relative Isomorphism of Word Embedding Spacescited by 7
- 2021Cross-Lingual BERT Contextual Embedding Space Mapping with Isotropic and Isometric Conditionscited by 6
- 2022Bilingual Lexicon Induction for Low-Resource Languages using Graph Matching via Optimal Transportcited by 6
- 2021Zero-Shot Cross-Lingual Dependency Parsing through Contextual Embedding Transformationcited by 5
- 2021Majority Voting with Bidirectional Pre-translation For Bitext Retrievalcited by 5
- 2022RAPO: An Adaptive Ranking Paradigm for Bilingual Lexicon Inductioncited by 3
- 2023GRI: Graph-based Relative Isomorphism of Word Embedding Spacescited by 3
- 2023GARI: Graph Attention for Relative Isomorphism of Arabic Word Embeddingscited by 3
3 more
- 2021An Analysis of Euclidean vs. Graph-Based Framing for Bilingual Lexicon Induction from Word Embedding Spacescited by 2
- 2025Hierarchical Level-Wise News Article Clustering via Multilingual Matryoshka Embeddingscited by 2
- 2024Towards Efficient Methods in Medical Question Answering using Knowledge Graph Embeddingscited by 1
- 2025Hierarchical Level-Wise News Article Clustering via Multilingual Matryoshka Embeddings30 May 2025
- 2024Towards Efficient Methods in Medical Question Answering using Knowledge Graph Embeddings15 Jan 2024
- 2023GARI: Graph Attention for Relative Isomorphism of Arabic Word Embeddings19 Oct 2023
- 2023GRI: Graph-based Relative Isomorphism of Word Embedding Spaces18 Oct 2023
- 2023CiCo: Domain-Aware Sign Language Retrieval via Cross-Lingual Contrastive Learning22 Mar 2023
- 2022Bilingual Lexicon Induction for Low-Resource Languages using Graph Matching via Optimal Transport25 Oct 2022
- 2022RAPO: An Adaptive Ranking Paradigm for Bilingual Lexicon Induction18 Oct 2022
- 2022IsoVec: Controlling the Relative Isomorphism of Word Embedding Spaces11 Oct 2022
- 2022Learning Backward Compatible Embeddings7 Jun 2022
- 2021An Analysis of Euclidean vs. Graph-Based Framing for Bilingual Lexicon Induction from Word Embedding Spaces26 Sep 2021
- 2021A Massively Multilingual Analysis of Cross-linguality in Shared Embedding Space13 Sep 2021
- 2021Cross-Lingual BERT Contextual Embedding Space Mapping with Isotropic and Isometric Conditions19 Jul 2021
3 more
- 2021Optimization of Graph Neural Networks: Implicit Acceleration by Skip Connections and More Depthcited by 55
- 2023CiCo: Domain-Aware Sign Language Retrieval via Cross-Lingual Contrastive Learningcited by 32
- 2022Learning Backward Compatible Embeddingscited by 16
- 2021A Massively Multilingual Analysis of Cross-linguality in Shared Embedding Spacecited by 8
- 2022IsoVec: Controlling the Relative Isomorphism of Word Embedding Spacescited by 7
- 2021Cross-Lingual BERT Contextual Embedding Space Mapping with Isotropic and Isometric Conditionscited by 6
- 2022Bilingual Lexicon Induction for Low-Resource Languages using Graph Matching via Optimal Transportcited by 6
- 2021Zero-Shot Cross-Lingual Dependency Parsing through Contextual Embedding Transformationcited by 5
- 2021Majority Voting with Bidirectional Pre-translation For Bitext Retrievalcited by 5
- 2022RAPO: An Adaptive Ranking Paradigm for Bilingual Lexicon Inductioncited by 3
- 2023GRI: Graph-based Relative Isomorphism of Word Embedding Spacescited by 3
- 2023GARI: Graph Attention for Relative Isomorphism of Arabic Word Embeddingscited by 3
12 most cited of 15 All 15 (JSON)
- 2025Hierarchical Level-Wise News Article Clustering via Multilingual Matryoshka Embeddings30 May 2025
- 2024Towards Efficient Methods in Medical Question Answering using Knowledge Graph Embeddings15 Jan 2024
- 2023GARI: Graph Attention for Relative Isomorphism of Arabic Word Embeddings19 Oct 2023
- 2023GRI: Graph-based Relative Isomorphism of Word Embedding Spaces18 Oct 2023
- 2023CiCo: Domain-Aware Sign Language Retrieval via Cross-Lingual Contrastive Learning22 Mar 2023
- 2022Bilingual Lexicon Induction for Low-Resource Languages using Graph Matching via Optimal Transport25 Oct 2022
- 2022RAPO: An Adaptive Ranking Paradigm for Bilingual Lexicon Induction18 Oct 2022
- 2022IsoVec: Controlling the Relative Isomorphism of Word Embedding Spaces11 Oct 2022
- 2022Learning Backward Compatible Embeddings7 Jun 2022
- 2021An Analysis of Euclidean vs. Graph-Based Framing for Bilingual Lexicon Induction from Word Embedding Spaces26 Sep 2021
- 2021A Massively Multilingual Analysis of Cross-linguality in Shared Embedding Space13 Sep 2021
- 2021Cross-Lingual BERT Contextual Embedding Space Mapping with Isotropic and Isometric Conditions19 Jul 2021
12 newest of 15 All 15 (JSON)