mlsanityData to 14 Oct 2026

Teaching Nemotron Greek: Mining a Corpus, Adapting Retrieval, and Grounding Generation for Modern Greek across Specialist Domains

arXiv 2608.05138 ↗First posted 5 Aug 2026eess.AS cs.AI cs.CLcited by 1

On the map: Retrieval-augmented generation → Generation and context integration

Abstract (arXiv)

Modern Greek is absent from NVIDIA's Nemotron retrieval models and from major multilingual retrieval benchmarks, despite being important for retrieval-augmented generation (RAG) in legal, energy, financial, and medical applications. We present an end-to-end adaptation of the Nemotron retrieval stack for Modern Greek, including corpus mining, synthetic supervision, retrieval model training, reranker adaptation, reader fine-tuning, and a new benchmark called HERA. Our study shows that a parameter-free BM25 baseline outperforms several off-the-shelf multilingual dense retrieval models on specialist Greek corpora. After fine-tuning on 65,773 Greek retrieval pairs, a Nemotron 1B embedder improves nDCG@10 from 0.362 to 0.835 and substantially outperforms its unadapted counterpart. The learned language competence transfers to general-domain Greek, although the advantage over BM25 remains domain-dependent. We further adapt a cross-encoder reranker and demonstrate consistent improvements across specialist domains. Finally, we LoRA-tune a Nemotron 30B-A3B mixture-of-experts reader for grounded generation, increasing judged answer correctness from 29.4% to 66.9% while significantly improving faithfulness and citation quality. We also introduce HERA, the first large-scale Greek benchmark for retrieval-augmented generation, and release our adapted models and benchmark to support future research on Greek-language RAG systems.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Generation and context integration, one of 15 directions in Retrieval-augmented generation. Builds on 6 of its 13 references that are in the map. First posted on arXiv 5 Aug 2026.

Builds on

6 of 13 references.

References · 6

  1. 2018Representation Learning with Contrastive Predictive Codingcited by 7,777
  2. 2020Dense Passage Retrieval for Open-Domain Question Answeringcited by 3,824
  3. 2017Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layercited by 3,509
  4. 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,455
  5. 2021Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsitycited by 3,073
  6. 2023ARES: An Automated Evaluation Framework for Retrieval-Augmented Generation Systemscited by 265

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026ORPHEAS: A Cross-Lingual Greek-English Embedding Model for Retrieval-Augmented Generation
  2. 2026Parameter-Efficient Retrievers for Polish and European Languages
  3. 2025Advancing Retrieval-Augmented Generation for Persian: Development of Language Models, Comprehensive Benchmarks, and Best Practices for Optimization
  4. 2025KinyaColBERT: A Lexically Grounded Retrieval Model for Low-Resource Retrieval-Augmented Generation
  5. 2025The Cross-Lingual Cost: Retrieval Biases in RAG over Arabic-English Corpora
  6. 2026RAGTurk: Best Practices for Retrieval Augmented Generation in Turkish
  7. 2025LMAR: Language Model Augmented Retriever for Domain-specific Knowledge Indexing
  8. 2025When Retrieval Succeeds and Fails: Rethinking Retrieval-Augmented Generation for LLMs