Learning Joint Multilingual Sentence Representations with Neural Machine Translation
Not on the map. Why?
Abstract (arXiv)
In this paper, we use the framework of neural machine translation to learn joint sentence representations across six very different languages. Our aim is that a representation which is independent of the language, is likely to capture the underlying semantics. We define a new cross-lingual similarity measure, compare up to 1.4M sentence representations and study the characteristics of close sentences. We provide experimental evidence that sentences that are close in embedding space are indeed semantically highly related, but often have quite different structure and syntax. These relations also hold when comparing sentences in different languages.
Key facts. Cited by 52 papers in the map (data through 14 Oct 2026). First posted on arXiv 13 Apr 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 13; 2022: 14; 2023: 10; 2024: 9; 2025: 4; 2026: 2.
52 papers.
Sort:
By area:
- 2024The Faiss librarycited by 376
- 2022Decoding speech perception from non-invasive brain recordingscited by 130
- 2024Generalization v.s. Memorization: Tracing Language Models' Capabilities Back to Pretraining Datacited by 85
- 2022SpeechMatrix: A Large-Scale Mined Corpus of Multilingual Speech-to-Speech Translationscited by 35
- 2022SAMU-XLSR: Semantically-Aligned Multimodal Utterance-level Cross-Lingual Speech Representationcited by 32
- 2025Multilingual Routing in Mixture-of-Expertscited by 29
- 2023Revisiting non-English Text Simplification: A Unified Multilingual Benchmarkcited by 27
- 2024Residual Quantization with Implicit Neural Codebookscited by 25
- 2023Multilingual Holistic Bias: Extending Descriptors and Patterns to Unveil Demographic Biases in Languages at Scalecited by 24
- 2021Paraphrastic Representations at Scalecited by 21
- 2022EASE: Entity-Aware Contrastive Learning of Sentence Embeddingcited by 21
- 2023There's no Data Like Better Data: Using QE Metrics for MT Data Filteringcited by 19
38 more
- 2021Obtaining Better Static Word Embeddings Using Contextual Embedding Modelscited by 18
- 2021Everything Is All It Takes: A Multipronged Strategy for Zero-Shot Cross-Lingual Information Extractioncited by 16
- 2022BLASER: A Text-Free Speech-to-Speech Translation Evaluation Metriccited by 16
- 2023L3Cube-IndicSBERT: A simple approach for learning cross-lingual sentence representations using multilingual BERTcited by 15
- 2021Cross-lingual Transfer of Monolingual Modelscited by 14
- 2022Learning to Generalize to More: Continuous Semantic Augmentation for Neural Machine Translationcited by 13
- 2023Preparing the Vuk'uzenzele and ZA-gov-multilingual South African multilingual corporacited by 12
- 2024Cross-Lingual Transfer Learning for Speech Translationcited by 11
- 2021Graph-based Multilingual Product Retrieval in E-commerce Searchcited by 9
- 2021Unsupervised Multilingual Sentence Embeddings for Parallel Corpus Miningcited by 9
- 2021FST: the FAIR Speech Translation System for the IWSLT21 Multilingual Shared Taskcited by 6
- 2022NMTScore: A Multilingual Analysis of Translation-based Text Similarity Measurescited by 6
- 2022Very Low Resource Sentence Alignment: Luhya and Swahilicited by 6
- 2024Recovering document annotations for sentence-level bitextcited by 6
- 2021Majority Voting with Bidirectional Pre-translation For Bitext Retrievalcited by 5
- 2021Lightweight Cross-Lingual Sentence Representation Learningcited by 5
- 2022Retrofitting Multilingual Sentence Embeddings with Abstract Meaning Representationcited by 5
- 2022Beyond Contrastive Learning: A Variational Generative Model for Multilingual Retrievalcited by 5
- 2021Cross-lingual hate speech detection based on multilingual domain-specific word embeddingscited by 4
- 2023The Interpreter Understands Your Meaning: End-to-end Spoken Language Understanding Aided by Speech Translationcited by 4
- 2024How to Learn in a Noisy World? Self-Correcting the Real-World Data Noise in Machine Translationcited by 4
- 2021Exploiting Parallel Corpora to Improve Multilingual Embedding based Document and Sentence Alignmentcited by 3
- 2023Towards a Deep Understanding of Multilingual End-to-End Speech Translationcited by 3
- 2022Multilingual Coreference Resolution in Multiparty Dialoguecited by 2
- 2025Long-context Non-factoid Question Answering in Indic Languagescited by 2
- 2026Parallel-SFT: Improving Zero-Shot Cross-Programming-Language Transfer for Code RLcited by 2
- 2021Learning Feature Weights using Reward Modeling for Denoising Parallel Corporacited by 1
- 2021Metric Learning in Multilingual Sentence Similarity Measurement for Document Alignmentcited by 1
- 2022EMS: Efficient and Effective Massively Multilingual Sentence Embedding Learningcited by 1
- 2023Are the Best Multilingual Document Embeddings simply Based on Sentence Embeddings?cited by 1
- 2024Mitigating Semantic Leakage in Cross-lingual Embeddings via Orthogonality Constraintcited by 1
- 2024Pralekha: Cross-Lingual Document Alignment for Indic Languagescited by 1
- 2025DOLFIN -- Document-Level Financial test set for Machine Translationcited by 1
- 2022Learning How to Translate North Korean through South Koreancited by 0
- 2022The VolcTrans System for WMT22 Multilingual Machine Translation Taskcited by 0
- 2023tmn at SemEval-2023 Task 9: Multilingual Tweet Intimacy Detection using XLM-T, Google Translate, and Ensemble Learningcited by 0
- 2023Multilingual Neural Machine Translation System for Indic to Indic Languagescited by 0
- 2024Mapping Transformer Leveraged Embeddings for Cross-Lingual Document Representationcited by 0
50 most cited of 52 All 52 (JSON)
- 2026Cross-Lingual Alignment for Decoder-Only Models using MoE Routers1 Oct 2026
- 2026Parallel-SFT: Improving Zero-Shot Cross-Programming-Language Transfer for Code RL22 Apr 2026
- 2025Multilingual Routing in Mixture-of-Experts6 Oct 2025
- 2025Long-context Non-factoid Question Answering in Indic Languages18 Apr 2025
- 2025DOLFIN -- Document-Level Financial test set for Machine Translation5 Feb 2025
- 2025A comparison of data filtering techniques for English-Polish LLM-based machine translation in the biomedical domain27 Jan 2025
- 2024Pralekha: Cross-Lingual Document Alignment for Indic Languages28 Nov 2024
- 2024Mitigating Semantic Leakage in Cross-lingual Embeddings via Orthogonality Constraint24 Sep 2024
- 2024Generalization v.s. Memorization: Tracing Language Models' Capabilities Back to Pretraining Data20 Jul 2024
- 2024How to Learn in a Noisy World? Self-Correcting the Real-World Data Noise in Machine Translation2 Jul 2024
- 2024Cross-Lingual Transfer Learning for Speech Translation1 Jul 2024
- 2024Recovering document annotations for sentence-level bitext6 Jun 2024
38 more
- 2024Residual Quantization with Implicit Neural Codebooks26 Jan 2024
- 2024The Faiss library16 Jan 2024
- 2024Mapping Transformer Leveraged Embeddings for Cross-Lingual Document Representation12 Jan 2024
- 2023There's no Data Like Better Data: Using QE Metrics for MT Data Filtering9 Nov 2023
- 2023Towards a Deep Understanding of Multilingual End-to-End Speech Translation31 Oct 2023
- 2023Multilingual Neural Machine Translation System for Indic to Indic Languages22 Jun 2023
- 2023Revisiting non-English Text Simplification: A Unified Multilingual Benchmark25 May 2023
- 2023Multilingual Holistic Bias: Extending Descriptors and Patterns to Unveil Demographic Biases in Languages at Scale22 May 2023
- 2023The Interpreter Understands Your Meaning: End-to-end Spoken Language Understanding Aided by Speech Translation16 May 2023
- 2023Are the Best Multilingual Document Embeddings simply Based on Sentence Embeddings?28 Apr 2023
- 2023L3Cube-IndicSBERT: A simple approach for learning cross-lingual sentence representations using multilingual BERT22 Apr 2023
- 2023tmn at SemEval-2023 Task 9: Multilingual Tweet Intimacy Detection using XLM-T, Google Translate, and Ensemble Learning8 Apr 2023
- 2023Preparing the Vuk'uzenzele and ZA-gov-multilingual South African multilingual corpora7 Mar 2023
- 2022Beyond Contrastive Learning: A Variational Generative Model for Multilingual Retrieval21 Dec 2022
- 2022BLASER: A Text-Free Speech-to-Speech Translation Evaluation Metric16 Dec 2022
- 2022SpeechMatrix: A Large-Scale Mined Corpus of Multilingual Speech-to-Speech Translations8 Nov 2022
- 2022Very Low Resource Sentence Alignment: Luhya and Swahili31 Oct 2022
- 2022The VolcTrans System for WMT22 Multilingual Machine Translation Task20 Oct 2022
- 2022Retrofitting Multilingual Sentence Embeddings with Abstract Meaning Representation18 Oct 2022
- 2022Decoding speech perception from non-invasive brain recordings25 Aug 2022
- 2022Multilingual Coreference Resolution in Multiparty Dialogue2 Aug 2022
- 2022EMS: Efficient and Effective Massively Multilingual Sentence Embedding Learning31 May 2022
- 2022SAMU-XLSR: Semantically-Aligned Multimodal Utterance-level Cross-Lingual Speech Representation17 May 2022
- 2022EASE: Entity-Aware Contrastive Learning of Sentence Embedding9 May 2022
- 2022NMTScore: A Multilingual Analysis of Translation-based Text Similarity Measures28 Apr 2022
- 2022Learning to Generalize to More: Continuous Semantic Augmentation for Neural Machine Translation14 Apr 2022
- 2022Learning How to Translate North Korean through South Korean27 Jan 2022
- 2021Cross-lingual Transfer of Monolingual Models15 Sep 2021
- 2021Everything Is All It Takes: A Multipronged Strategy for Zero-Shot Cross-Lingual Information Extraction14 Sep 2021
- 2021Metric Learning in Multilingual Sentence Similarity Measurement for Document Alignment21 Aug 2021
- 2021FST: the FAIR Speech Translation System for the IWSLT21 Multilingual Shared Task14 Jul 2021
- 2021Exploiting Parallel Corpora to Improve Multilingual Embedding based Document and Sentence Alignment12 Jun 2021
- 2021Obtaining Better Static Word Embeddings Using Contextual Embedding Models8 Jun 2021
- 2021Lightweight Cross-Lingual Sentence Representation Learning28 May 2021
- 2021Unsupervised Multilingual Sentence Embeddings for Parallel Corpus Mining21 May 2021
- 2021Graph-based Multilingual Product Retrieval in E-commerce Search6 May 2021
- 2021Paraphrastic Representations at Scale30 Apr 2021
- 2021Cross-lingual hate speech detection based on multilingual domain-specific word embeddings30 Apr 2021
50 newest of 52 All 52 (JSON)
- 2025Multilingual Routing in Mixture-of-Expertscited by 29
- 2026Cross-Lingual Alignment for Decoder-Only Models using MoE Routerscited by 0
- 2026Cross-Lingual Alignment for Decoder-Only Models using MoE Routers1 Oct 2026
- 2025Multilingual Routing in Mixture-of-Experts6 Oct 2025
- 2024The Faiss librarycited by 376
- 2022Decoding speech perception from non-invasive brain recordingscited by 130
- 2024Generalization v.s. Memorization: Tracing Language Models' Capabilities Back to Pretraining Datacited by 85
- 2022SpeechMatrix: A Large-Scale Mined Corpus of Multilingual Speech-to-Speech Translationscited by 35
- 2022SAMU-XLSR: Semantically-Aligned Multimodal Utterance-level Cross-Lingual Speech Representationcited by 32
- 2023Revisiting non-English Text Simplification: A Unified Multilingual Benchmarkcited by 27
- 2024Residual Quantization with Implicit Neural Codebookscited by 25
- 2023Multilingual Holistic Bias: Extending Descriptors and Patterns to Unveil Demographic Biases in Languages at Scalecited by 24
- 2021Paraphrastic Representations at Scalecited by 21
- 2022EASE: Entity-Aware Contrastive Learning of Sentence Embeddingcited by 21
- 2023There's no Data Like Better Data: Using QE Metrics for MT Data Filteringcited by 19
- 2021Obtaining Better Static Word Embeddings Using Contextual Embedding Modelscited by 18
12 most cited of 49 All 49 (JSON)
- 2026Parallel-SFT: Improving Zero-Shot Cross-Programming-Language Transfer for Code RL22 Apr 2026
- 2025Long-context Non-factoid Question Answering in Indic Languages18 Apr 2025
- 2025DOLFIN -- Document-Level Financial test set for Machine Translation5 Feb 2025
- 2025A comparison of data filtering techniques for English-Polish LLM-based machine translation in the biomedical domain27 Jan 2025
- 2024Pralekha: Cross-Lingual Document Alignment for Indic Languages28 Nov 2024
- 2024Mitigating Semantic Leakage in Cross-lingual Embeddings via Orthogonality Constraint24 Sep 2024
- 2024Generalization v.s. Memorization: Tracing Language Models' Capabilities Back to Pretraining Data20 Jul 2024
- 2024How to Learn in a Noisy World? Self-Correcting the Real-World Data Noise in Machine Translation2 Jul 2024
- 2024Cross-Lingual Transfer Learning for Speech Translation1 Jul 2024
- 2024Recovering document annotations for sentence-level bitext6 Jun 2024
- 2024Residual Quantization with Implicit Neural Codebooks26 Jan 2024
- 2024The Faiss library16 Jan 2024
12 newest of 49 All 49 (JSON)