mlsanityData to 7 Oct 2026

AMALIA Technical Report: A Fully Open Source Large Language Model for European Portuguese

arXiv 2603.26511 ↗First posted 27 Mar 2026cs.CL cs.AI cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Despite rapid progress in open large language models (LLMs), European Portuguese (pt-PT) remains underrepresented in both training data and native evaluation, with machine-translated benchmarks likely missing the variant's linguistic and cultural nuances. We introduce AMALIA, a fully open LLM that prioritizes pt-PT by using more high-quality pt-PT data during both the mid- and post-training stages. To evaluate pt-PT more faithfully, we release a suite of pt-PT benchmarks that includes translated standard tasks and four new datasets targeting pt-PT generation, linguistic competence, and pt-PT/pt-BR bias. Experiments show that AMALIA matches strong baselines on translated benchmarks while substantially improving performance on pt-PT-specific evaluations, supporting the case for targeted training and native benchmarking for European Portuguese.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 16 of its 32 references that are in the map. First posted on arXiv 27 Mar 2026.

Builds on

16 of 32 references.

References · 16

  1. 2021Training Verifiers to Solve Math Word Problemscited by 9,743
  2. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,916
  3. 2020Measuring Massive Multitask Language Understandingcited by 7,768
  4. 2018Think you have Solved Question Answering? Try ARC, the AI2 Reasoning Challengecited by 4,710
  5. 2021TruthfulQA: Measuring How Models Mimic Human Falsehoodscited by 2,919
  6. 2022Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language modelscited by 1,970
  7. 2023OpenAssistant Conversations -- Democratizing Large Language Model Alignmentcited by 712
  8. 2024Scaling Synthetic Data Creation with 1,000,000,000 Personascited by 397
  9. 2023Effective Long-Context Scaling of Foundation Modelscited by 301
  10. 2023Red-Teaming Large Language Models using Chain of Utterances for Safety-Alignmentcited by 213
  11. 2025Qwen3Guard Technical Reportcited by 125
  12. 2025NVIDIA Nemotron Nano 2: An Accurate and Efficient Hybrid Mamba-Transformer Reasoning Modelcited by 94
4 more
  1. 2025MMLU-ProX: A Multilingual Benchmark for Advanced Large Language Model Evaluationcited by 73
  2. 2025The Bitter Lesson Learned from 2,000+ Multilingual Benchmarkscited by 31
  3. 2024Advancing Generative AI for Portuguese with Open Decoder Gerv'asio PT*cited by 19
  4. 2024Gl'orIA -- A Generative and Open Large Language Model for Portuguesecited by 16

Built on by

Not cited yet.