mlsanityData to 14 Oct 2026

Evaluating Compact LLMs for Zero-Shot Iberian Language Tasks on End-User Devices

arXiv 2504.03312 ↗First posted 4 Apr 2025cs.CL cs.LGcited by 1

Not on the map. Why?

Abstract (arXiv)

Large Language Models have significantly advanced natural language processing, achieving remarkable performance in tasks such as language generation, translation, and reasoning. However, their substantial computational requirements restrict deployment to high-end systems, limiting accessibility on consumer-grade devices. This challenge is especially pronounced for under-resourced languages like those spoken in the Iberian Peninsula, where relatively limited linguistic resources and benchmarks hinder effective evaluation. This work presents a comprehensive evaluation of compact state-of-the-art LLMs across several essential NLP tasks tailored for Iberian languages. The results reveal that while some models consistently excel in certain tasks, significant performance gaps remain, particularly for languages such as Basque. These findings highlight the need for further research on balancing model compactness with robust multilingual performance

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 8 of its 25 references that are in the map. First posted on arXiv 4 Apr 2025.

Builds on

8 of 25 references.

References · 8

  1. 2023GPT-4 Technical Reportcited by 18,396
  2. 2024The Llama 3 Herd of Modelscited by 14,715
  3. 2024Gemma 2: Improving Open Language Models at a Practical Sizecited by 1,998
  4. 2022No Language Left Behind: Scaling Human-Centered Machine Translationcited by 1,312
  5. 2024Fine-Tuned 'Small' LLMs (Still) Significantly Outperform Zero-Shot Generative AI Models in Text Classificationcited by 70
  6. 2024Latxa: An Open Language Model and Evaluation Suite for Basquecited by 42
  7. 2025Inference-Time Computations for LLM Reasoning and Planning: A Benchmark and Insightscited by 30
  8. 2025LLM-Powered Benchmark Factory: Reliable, Generic, and Efficientcited by 7

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.