mlsanityData to 14 Oct 2026

Krikri: Advancing Open Large Language Models for Greek

arXiv 2505.13772 ↗First posted 19 May 2025cs.CLcited by 14

Not on the map. Why?

Abstract (arXiv)

We introduce Llama-Krikri-8B, a cutting-edge Large Language Model tailored for the Greek language, built on Meta's Llama 3.1-8B. Llama-Krikri-8B has been extensively trained on high-quality Greek data to ensure superior adaptation to linguistic nuances. With 8 billion parameters, it offers advanced capabilities while maintaining efficient computational performance. Llama-Krikri-8B supports both Modern Greek and English, and is also equipped to handle polytonic text and Ancient Greek. The chat version of Llama-Krikri-8B features a multi-stage post-training pipeline, utilizing both human and synthetic instruction and preference data, by applying techniques such as MAGPIE. In addition, for evaluation, we propose three novel public benchmarks for Greek. Our evaluation on existing as well as the proposed benchmarks shows notable improvements over comparable Greek and multilingual LLMs in both natural language understanding and generation as well as code generation.

Key facts. Cited by 14 papers in the map (data through 14 Oct 2026). Builds on 50 of its 85 references that are in the map. First posted on arXiv 19 May 2025.

Builds on

50 of 85 references.

References · 50

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  2. 2020Language Models are Few-Shot Learnerscited by 32,419
  3. 2022Training language models to follow instructions with human feedbackcited by 15,971
  4. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
  5. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 8,065
  6. 2020Measuring Massive Multitask Language Understandingcited by 7,963
  7. 2018Think you have Solved Question Answering? Try ARC, the AI2 Reasoning Challengecited by 4,886
  8. 2019HellaSwag: Can a Machine Really Finish Your Sentence?cited by 4,100
  9. 2023Qwen Technical Reportcited by 3,344
  10. 2022Constitutional AI: Harmlessness from AI Feedbackcited by 3,050
  11. 2021TruthfulQA: Measuring How Models Mimic Human Falsehoodscited by 2,975
  12. 2017Decoupled Weight Decay Regularizationcited by 1,831
38 more
  1. 2020Don't Stop Pretraining: Adapt Language Models to Domains and Taskscited by 1,565
  2. 2024Chatbot Arena: An Open Platform for Evaluating LLMs by Human Preferencecited by 1,184
  3. 2024The FineWeb Datasets: Decanting the Web for the Finest Text Data at Scalecited by 1,160
  4. 2016Bag of Tricks for Efficient Text Classificationcited by 876
  5. 2021Deduplicating Training Data Makes Language Models Bettercited by 714
  6. 2023An Empirical Study of Catastrophic Forgetting in Large Language Models During Continual Fine-tuningcited by 639
  7. 2024StarCoder 2 and The Stack v2: The Next Generationcited by 502
  8. 2024From Crowdsourced Data to High-Quality Benchmarks: Arena-Hard and BenchBuilder Pipelinecited by 500
  9. 2024WildGuard: Open One-Stop Moderation Tools for Safety Risks, Jailbreaks, and Refusals of LLMscited by 496
  10. 2018Massively Multilingual Sentence Embeddings for Zero-Shot Cross-Lingual Transfer and Beyondcited by 434
  11. 2024Magpie: Alignment Data Synthesis from Scratch by Prompting Aligned LLMs with Nothingcited by 346
  12. 2025SmolLM2: When Smol Goes Big -- Data-Centric Training of a Small Language Modelcited by 335
  13. 2024Skywork-Reward: Bag of Tricks for Reward Modeling in LLMscited by 327
  14. 2023The Belebele Benchmark: a Parallel Reading Comprehension Dataset in 122 Language Variantscited by 311
  15. 2024A Survey on Data Selection for Language Modelscited by 236
  16. 2024HelpSteer2: Open-source dataset for training top-performing reward modelscited by 236
  17. 2022CometKiwi: IST-Unbabel 2022 Submission for the Quality Estimation Shared Taskcited by 207
  18. 2024Tower: An Open Multilingual Large Language Model for Translation-Related Taskscited by 206
  19. 2024Advancing LLM Reasoning Generalists with Preference Treescited by 192
  20. 2023CulturaX: A Cleaned, Enormous, and Multilingual Dataset for Large Language Models in 167 Languagescited by 174
  21. 2024How do Large Language Models Handle Multilingualism?cited by 150
  22. 2024HelpSteer2-Preference: Complementing Ratings with Preferencescited by 130
  23. 2024Liger Kernel: Efficient Triton Kernels for LLM Trainingcited by 130
  24. 2024Aya Expanse: Combining Research Breakthroughs for a New Multilingual Frontiercited by 129
  25. 2018When and Why are Pre-trained Word Embeddings Useful for Neural Machine Translation?cited by 126
  26. 2025Preference Leakage: A Contamination Problem in LLM-as-a-judgecited by 125
  27. 2024EuroLLM: Multilingual Language Models for Europecited by 106
  28. 2019Large-Scale Multi-Label Text Classification on EU Legislationcited by 104
  29. 2021MultiEURLEX -- A multi-lingual and multi-label legal document classification dataset for zero-shot cross-lingual transfercited by 90
  30. 2024AgentInstruct: Toward Generative Teaching with Agentic Flowscited by 89
  31. 2018Margin-based Parallel Corpus Mining with Multilingual Sentence Embeddingscited by 83
  32. 2024RLHF Can Speak Many Languages: Unlocking Multilingual Preference Optimization for LLMscited by 43
  33. 2023Efficiently Adapting Pretrained Language Models To New Languagescited by 28
  34. 2024Meltemi: The first open Large Language Model for Greekcited by 17
  35. 2021Multi-granular Legal Topic Classification on Greek Legislationcited by 15
  36. 2024Bielik 7B v0.1: A Polish Language Model -- Development, Insights, and Evaluationcited by 15
  37. 2024Enhancing Function-Calling Capabilities in LLMs: Strategies for Prompt Formats, Data Integration, and Multilingual Translationcited by 14
  38. 2024BgGPT 1.0: Extending English-centric LLMs to other languagescited by 8

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 4; 2026: 10.

14 papers.

Sort:

By area:

  1. 2025GreekBarBench: A Challenging Benchmark for Free-Text Legal Reasoning and Citationscited by 15
  2. 2025BabyBabelLM: A Multilingual Benchmark of Developmentally Plausible Training Datacited by 10
  3. 2026GreekMMLU: A Native-Sourced Multitask Benchmark for Evaluating Language Models in Greekcited by 6
  4. 2025GRDD+: An Extended Greek Dialectal Dataset with Cross-Architecture Fine-tuning Evaluationcited by 3
  5. 2026Evaluating Monolingual and Multilingual Large Language Models for Greek Question Answering: The DemosQA Benchmarkcited by 2
  6. 2026Ancient Greek to Modern Greek Machine Translation: A Novel Benchmark and Fine-Tuning Experiments on LLMs and NMT Modelscited by 1
  7. 2025VOX-KRIKRI: Unifying Speech and Language through Continuous Fusioncited by 0
  8. 2026BYOL: Bring Your Own Language Into LLMscited by 0
  9. 2026The Masked Advantage: Uncovering Local-Language Access to Cultural Knowledge in LLMscited by 0
  10. 2026Thinking in a Low-Resource Language: What SFT Builds, What RL Fixes, What Accuracy Cannot Seecited by 0
  11. 2026More Capable, Less Faithful: A Multilingual Analysis of Mathematical (Un)Solvability Detection in LLMscited by 0
  12. 2026Late Transformer Layers Recode Syntax Canonically: Evidence from Greek Scrambling and Cross-Layer Generalisationcited by 0
2 more
  1. 2026Pass or Fail? Evaluating LLMs on Two Greek Examination Benchmarkscited by 0
  2. 2026Recognition Is Not Grounding: Benchmarking Multilingual Financial Evidence Extractioncited by 0