ORPHEAS: A Cross-Lingual Greek-English Embedding Model for Retrieval-Augmented Generation
On the map: Retrieval-augmented generation → Generation and context integration
Abstract (arXiv)
Effective retrieval-augmented generation across bilingual Greek--English applications requires embedding models capable of capturing both domain-specific semantic relationships and cross-lingual semantic alignment. Existing multilingual embedding models distribute their representational capacity across numerous languages, limiting their optimization for Greek and failing to encode the morphological complexity and domain-specific terminological structures inherent in Greek text. In this work, we propose ORPHEAS, a specialized Greek--English embedding model for bilingual retrieval-augmented generation. ORPHEAS is trained with a high quality dataset generated by a knowledge graph-based fine-tuning methodology which is applied to a diverse multi-domain corpus, which enables language-agnostic semantic representations. The numerical experiments across monolingual and cross-lingual retrieval benchmarks reveal that ORPHEAS outperforms state-of-the-art multilingual embedding models, demonstrating that domain-specialized fine-tuning on morphologically complex languages does not compromise cross-lingual retrieval capability.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Generation and context integration, one of 15 directions in Retrieval-augmented generation. Builds on 12 of its 22 references that are in the map. First posted on arXiv 22 Apr 2026.
Builds on
12 of 22 references.
Closest ancestors · 1
Same direction, newest first
Other references · 11
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
- 2016MS MARCO: A Human Generated MAchine Reading COmprehension Datasetcited by 1,591
- 2020MiniLM: Deep Self-Attention Distillation for Task-Agnostic Compression of Pre-Trained Transformerscited by 1,414
- 2020MPNet: Masked and Permuted Pre-training for Language Understandingcited by 973
- 2024Multilingual E5 Text Embeddings: A Technical Reportcited by 357
- 2017Efficient Natural Language Response Suggestion for Smart Replycited by 228
- 2019Emerging Cross-lingual Structure in Pretrained Language Modelscited by 180
- 2020GREEK-BERT: The Greeks visiting Sesame Streetcited by 37
- 2024An evaluation framework for synthetic data generation modelscited by 5
- 2025QuOTE: Question-Oriented Text Embeddingscited by 2
- 2025Forging GEMs: Advancing Greek NLP through Quality-Based Corpus Curationcited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Advancing Retrieval-Augmented Generation for Persian: Development of Language Models, Comprehensive Benchmarks, and Best Practices for Optimization
- 2026Teaching Nemotron Greek: Mining a Corpus, Adapting Retrieval, and Grounding Generation for Modern Greek across Specialist Domains
- 2024MINERS: Multilingual Language Models as Semantic Retrievers
- 2024Embedding-Informed Adaptive Retrieval-Augmented Generation of Large Language Models
- 2025The Cross-Lingual Cost: Retrieval Biases in RAG over Arabic-English Corpora
- 2025KinyaColBERT: A Lexically Grounded Retrieval Model for Low-Resource Retrieval-Augmented Generation
- 2025LMAR: Language Model Augmented Retriever for Domain-specific Knowledge Indexing
- 2026LAMAR: An Open Language-Aware Multilingual Alignment Reranker