mlsanityData to 14 Oct 2026

OpenLLM-Ro -- Technical Report on Open-source Romanian LLMs

arXiv 2405.07703 ↗First posted 13 May 2024cs.CLcited by 7

Not on the map. Why?

Abstract (arXiv)

In recent years, Large Language Models (LLMs) have achieved almost human-like performance on various tasks. While some LLMs have been trained on multilingual data, most of the training data is in English. Hence, their performance in English greatly exceeds their performance in other languages. This document presents our approach to training and evaluating the first foundational and chat LLM specialized for Romanian.

Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Builds on 23 of its 31 references that are in the map. First posted on arXiv 13 May 2024.

Builds on

23 of 31 references.

References · 23

  1. 2017Attention Is All You Needcited by 60,361
  2. 2020Language Models are Few-Shot Learnerscited by 32,419
  3. 2023GPT-4 Technical Reportcited by 18,396
  4. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  5. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
  6. 2021Training Verifiers to Solve Math Word Problemscited by 10,109
  7. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
  8. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 8,065
  9. 2020Measuring Massive Multitask Language Understandingcited by 7,963
  10. 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,326
  11. 2018Think you have Solved Question Answering? Try ARC, the AI2 Reasoning Challengecited by 4,886
  12. 2019HellaSwag: Can a Machine Really Finish Your Sentence?cited by 4,100
11 more
  1. 2021TruthfulQA: Measuring How Models Mimic Human Falsehoodscited by 2,975
  2. 2019Fine-Tuning Language Models from Human Preferencescited by 2,150
  3. 2020mT5: A massively multilingual pre-trained text-to-text transformercited by 1,818
  4. 2023OpenAssistant Conversations -- Democratizing Large Language Model Alignmentcited by 721
  5. 2023AGIEval: A Human-Centric Benchmark for Evaluating Foundation Modelscited by 716
  6. 2023Efficient and Effective Text Encoding for Chinese LLaMA and Alpacacited by 305
  7. 2023Okapi: Instruction-tuned Large Language Models in Multiple Languages with Reinforcement Learning from Human Feedbackcited by 190
  8. 2023CulturaX: A Cleaned, Enormous, and Multilingual Dataset for Large Language Models in 167 Languagescited by 174
  9. 2022Towards a Cleaner Document-Oriented Multilingual Crawled Corpuscited by 143
  10. 2023SteerLM: Attribute Conditioned SFT as an (User-Steerable) Alternative to RLHFcited by 111
  11. 2023FinGPT: Large Generative Models for a Small Languagecited by 49

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 2; 2025: 4; 2026: 1.

7 papers.

  1. 2024Open Llama2 Model for the Lithuanian Languagecited by 2
  2. 2025Exploring Large Language Models for Translating Romanian Computational Problems into Englishcited by 2
  3. 2025GRILE: A Benchmark for Grammar Reasoning and Explanation in Romanian LLMscited by 1
  4. 2024Evaluating the Performance of Large Language Models in Competitive Programming: A Multi-Year, Multi-Grade Analysiscited by 0
  5. 2025A Culturally-Rich Romanian NLP Dataset from "Who Wants to Be a Millionaire?" Videoscited by 0
  6. 2025Evaluating Large Language Models for Diacritic Restoration in Romanian Texts: A Comparative Studycited by 0
  7. 2026PolERo: Studying Political Evasion in Romaniancited by 0