mlsanityData to 7 Oct 2026

Meltemi: The first open Large Language Model for Greek

arXiv 2407.20743 ↗First posted 30 Jul 2024cs.CLcited by 16

Not on the map. Why?

Abstract (arXiv)

We describe the development and capabilities of Meltemi 7B, the first open Large Language Model for the Greek language. Meltemi 7B has 7 billion parameters and is trained on a 40 billion token Greek corpus. For the development of Meltemi 7B, we adapt Mistral, by continuous pretraining on the Greek Corpus. Meltemi 7B contains up-to-date information up to September 2023. Furthermore, we have translated and curated a Greek instruction corpus, which has been used for the instruction-tuning of a chat model, named Meltemi 7B Instruct. Special care has been given to the alignment and the removal of toxic content for the Meltemi 7B Instruct. The developed models are evaluated on a broad set of collected evaluation corpora, and examples of prompts and responses are presented. Both Meltemi 7B and Meltemi 7B Instruct are available at https://huggingface.co/ilsp under the Apache 2.0 license.

Key facts. Cited by 16 papers in the map (data through 7 Oct 2026). Builds on 15 of its 50 references that are in the map. First posted on arXiv 30 Jul 2024.

Builds on

15 of 50 references.

References · 15

  1. 2020Measuring Massive Multitask Language Understandingcited by 7,768
  2. 2018Think you have Solved Question Answering? Try ARC, the AI2 Reasoning Challengecited by 4,710
  3. 2019HellaSwag: Can a Machine Really Finish Your Sentence?cited by 4,018
  4. 2023Qwen Technical Reportcited by 3,273
  5. 2021TruthfulQA: Measuring How Models Mimic Human Falsehoodscited by 2,919
  6. 2017Decoupled Weight Decay Regularizationcited by 1,722
  7. 2019ZeRO: Memory Optimizations Toward Training Trillion Parameter Modelscited by 1,278
  8. 2023The Falcon Series of Open Language Modelscited by 526
  9. 2018Massively Multilingual Sentence Embeddings for Zero-Shot Cross-Lingual Transfer and Beyondcited by 434
  10. 2023The Belebele Benchmark: a Parallel Reading Comprehension Dataset in 122 Language Variantscited by 300
  11. 2024Tower: An Open Multilingual Large Language Model for Translation-Related Taskscited by 205
  12. 2023CulturaX: A Cleaned, Enormous, and Multilingual Dataset for Large Language Models in 167 Languagescited by 172
3 more
  1. 2021MultiEURLEX -- A multi-lingual and multi-label legal document classification dataset for zero-shot cross-lingual transfercited by 89
  2. 2024A New Massive Multilingual Dataset for High-Performance Language Technologiescited by 56
  3. 2024RakutenAI-7B: Extending Large Language Models for Japanesecited by 13

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 2; 2025: 8; 2026: 6.

16 papers.

Sort:

By area:

  1. 2025Plutus: Benchmarking Large Language Models in Low-Resource Greek Financecited by 16
  2. 2025GreekBarBench: A Challenging Benchmark for Free-Text Legal Reasoning and Citationscited by 15
  3. 2025Krikri: Advancing Open Large Language Models for Greekcited by 13
  4. 2025BabyBabelLM: A Multilingual Benchmark of Developmentally Plausible Training Datacited by 9
  5. 2026GreekMMLU: A Native-Sourced Multitask Benchmark for Evaluating Language Models in Greekcited by 6
  6. 2025Kuwain 1.5B: An Arabic SLM via Language Injectioncited by 3
  7. 2026Evaluating Monolingual and Multilingual Large Language Models for Greek Question Answering: The DemosQA Benchmarkcited by 2
  8. 2025Open or Closed LLM for Lesser-Resourced Languages? Lessons from Greekcited by 1
  9. 2025CultureMERT: Continual Pre-Training for Cross-Cultural Music Representation Learningcited by 1
  10. 2025Forging GEMs: Advancing Greek NLP through Quality-Based Corpus Curationcited by 1
  11. 2026Ancient Greek to Modern Greek Machine Translation: A Novel Benchmark and Fine-Tuning Experiments on LLMs and NMT Modelscited by 1
  12. 2026MORFES: A Benchmark for Productive Inflectional Competence in Modern Greekcited by 1
4 more
  1. 2024GR-NLP-TOOLKIT: An Open-Source NLP Toolkit for Modern Greekcited by 0
  2. 2024SnakModel: Lessons Learned from Training an Open Danish Large Language Modelcited by 0
  3. 2026Maistros: A Greek Large Language Model Adapted Through Knowledge Distillation From Large Reasoning Modelscited by 0
  4. 2026The Masked Advantage: Uncovering Local-Language Access to Cultural Knowledge in LLMscited by 0