Teaching Nemotron Greek: Mining a Corpus, Adapting Retrieval, and Grounding Generation for Modern Greek across Specialist Domains
On the map: Retrieval-augmented generation → Generation and context integration
Abstract (arXiv)
Modern Greek is absent from NVIDIA's Nemotron retrieval models and from major multilingual retrieval benchmarks, despite being important for retrieval-augmented generation (RAG) in legal, energy, financial, and medical applications. We present an end-to-end adaptation of the Nemotron retrieval stack for Modern Greek, including corpus mining, synthetic supervision, retrieval model training, reranker adaptation, reader fine-tuning, and a new benchmark called HERA. Our study shows that a parameter-free BM25 baseline outperforms several off-the-shelf multilingual dense retrieval models on specialist Greek corpora. After fine-tuning on 65,773 Greek retrieval pairs, a Nemotron 1B embedder improves nDCG@10 from 0.362 to 0.835 and substantially outperforms its unadapted counterpart. The learned language competence transfers to general-domain Greek, although the advantage over BM25 remains domain-dependent. We further adapt a cross-encoder reranker and demonstrate consistent improvements across specialist domains. Finally, we LoRA-tune a Nemotron 30B-A3B mixture-of-experts reader for grounded generation, increasing judged answer correctness from 29.4% to 66.9% while significantly improving faithfulness and citation quality. We also introduce HERA, the first large-scale Greek benchmark for retrieval-augmented generation, and release our adapted models and benchmark to support future research on Greek-language RAG systems.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Generation and context integration, one of 15 directions in Retrieval-augmented generation. Builds on 6 of its 13 references that are in the map. First posted on arXiv 5 Aug 2026.
Builds on
6 of 13 references.
References · 6
- 2018Representation Learning with Contrastive Predictive Codingcited by 7,777
- 2020Dense Passage Retrieval for Open-Domain Question Answeringcited by 3,824
- 2017Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layercited by 3,509
- 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,455
- 2021Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsitycited by 3,073
- 2023ARES: An Automated Evaluation Framework for Retrieval-Augmented Generation Systemscited by 265
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026ORPHEAS: A Cross-Lingual Greek-English Embedding Model for Retrieval-Augmented Generation
- 2026Parameter-Efficient Retrievers for Polish and European Languages
- 2025Advancing Retrieval-Augmented Generation for Persian: Development of Language Models, Comprehensive Benchmarks, and Best Practices for Optimization
- 2025KinyaColBERT: A Lexically Grounded Retrieval Model for Low-Resource Retrieval-Augmented Generation
- 2025The Cross-Lingual Cost: Retrieval Biases in RAG over Arabic-English Corpora
- 2026RAGTurk: Best Practices for Retrieval Augmented Generation in Turkish
- 2025LMAR: Language Model Augmented Retriever for Domain-specific Knowledge Indexing
- 2025When Retrieval Succeeds and Fails: Rethinking Retrieval-Augmented Generation for LLMs