AMALIA-VL: A Native European Portuguese Open-Source Vision and Language Model
Not on the map. Why?
Abstract (arXiv)
Large Vision and Language Models (LVLMs) have advanced rapidly, yet European Portuguese (pt-PT) remains systematically underserved by existing open-source multimodal models, which either conflate it with Brazilian Portuguese or severely under-represent it in their training data mixes. We introduce AMALIA-VL, the first open-source instruction-tuned LVLM built natively for pt-PT, pairing a high-resolution vision encoder with dynamic image tiling and a fully open pt-PT-optimized language model via a learned connector. We contribute with a purposefully designed three-stage training process - vision-language alignment, general visual instruction tuning, and preference optimization - together with a pt-PT-centric multimodal data mix combining curated and translated public datasets with novel datasets that address the near-total absence of European Portuguese multimodal resources. Our evaluation shows that AMALIA-VL establishes a strong baseline for open-source pt-PT LVLMs. We will release model weights, training data, and construction pipelines along with machine-translated pt-PT evaluation benchmarks to help democratize pt-PT LVLM development.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 48 of its 61 references that are in the map. First posted on arXiv 17 Jun 2026.
Builds on
48 of 61 references.
References · 48
- 2014Microsoft COCO: Common Objects in Contextcited by 17,608
- 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 8,065
- 2025Qwen3-VL Technical Reportcited by 2,793
- 2015VQA: Visual Question Answeringcited by 2,506
- 2023MMMU: A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for Expert AGIcited by 2,080
- 2022Learn to Explain: Multimodal Reasoning via Thought Chains for Science Question Answeringcited by 1,919
- 2025Gemma 3 Technical Reportcited by 1,824
- 2023Evaluating Object Hallucination in Large Vision-Language Modelscited by 1,729
- 2019Towards VQA Models That Can Readcited by 1,718
- 2023MME: A Comprehensive Evaluation Benchmark for Multimodal Large Language Modelscited by 1,652
- 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiencycited by 1,510
- 2022ChartQA: A Benchmark for Question Answering about Charts with Visual and Logical Reasoningcited by 1,479
36 more
- 2020DocVQA: A Dataset for VQA on Document Imagescited by 1,317
- 2025SigLIP 2: Multilingual Vision-Language Encoders with Improved Semantic Understanding, Localization, and Dense Featurescited by 1,188
- 2024Are We on the Right Way for Evaluating Large Vision-Language Models?cited by 914
- 2016A Diagram Is Worth A Dozen Imagescited by 804
- 2019CodeSearchNet Challenge: Evaluating the State of Semantic Code Searchcited by 654
- 2024LLaVA-NeXT-Interleave: Tackling Multi-image, Video, and 3D in Large Multimodal Modelscited by 584
- 2024Measuring Multimodal Mathematical Reasoning with MATH-Vision Datasetcited by 526
- 2024MMMU-Pro: A More Robust Multi-discipline Multimodal Understanding Benchmarkcited by 512
- 2023OCRBench: On the Hidden Mystery of OCR in Large Multimodal Modelscited by 476
- 2025GLM-4.5V and GLM-4.1V-Thinking: Towards Versatile Multimodal Reasoning with Scalable Reinforcement Learningcited by 466
- 2021InfographicVQAcited by 437
- 2016Visual Dialogcited by 377
- 2024LMMs-Eval: Reality Check on the Evaluation of Large Multimodal Modelscited by 353
- 2023Demystifying CLIP Datacited by 270
- 2025LLaVA-OneVision-1.5: Fully Open Framework for Democratized Multimodal Trainingcited by 244
- 2025MiniCPM-V 4.5: Cooking Efficient MLLMs via Architecture, Data, and Training Recipecited by 186
- 2018TallyQA: Answering Complex Counting Questionscited by 153
- 2026Molmo2: Open Weights and Data for Vision-Language Models with Video Understanding and Groundingcited by 139
- 2022CLEVR-Math: A Dataset for Compositional Language, Visual and Mathematical Reasoningcited by 120
- 2026Ministral 3cited by 114
- 2023GeomVerse: A Systematic Evaluation of Large Models for Geometric Reasoningcited by 108
- 2024EmbSpatial-Bench: Benchmarking Spatial Understanding for Embodied Tasks with Large Vision-Language Modelscited by 107
- 2024EuroLLM: Multilingual Language Models for Europecited by 106
- 2025PerceptionLM: Open-Access Data and Models for Detailed Visual Understandingcited by 92
- 2025Eagle 2: Building Post-Training Data Strategies from Scratch for Frontier Vision-Language Modelscited by 70
- 2025Scaling Text-Rich Image Understanding via Code-Guided Synthetic Multimodal Data Generationcited by 58
- 2024MMEvol: Empowering Multimodal Large Language Models with Evol-Instructcited by 42
- 2024Encoder vs Decoder: Comparative Analysis of Encoder and Decoder Language Models on Multilingual NLU Taskscited by 34
- 2025NVIDIA Nemotron Nano V2 VLcited by 17
- 2024Public Domain 12M: A Highly Aesthetic Image-Text Dataset with Novel Governance Mechanismscited by 15
- 2025SeedBench: A Multi-task Benchmark for Evaluating Large Language Models in Seed Sciencecited by 10
- 2026TranslateGemma Technical Reportcited by 7
- 2023FATURA: A Multi-Layout Invoice Image Dataset for Document Analysis and Understandingcited by 4
- 2025Enhancing Portuguese Variety Identification with Cross-Domain Approachescited by 4
- 2026ALBA: A European Portuguese Benchmark for Evaluating Language and Linguistic Dimensions in Generative LLMscited by 3
- 2025TowerVision: Understanding and Improving Multilinguality in Vision-Language Modelscited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Multilingual Training and Evaluation Resources for Vision-Language Models
- 2025Centurio: On Drivers of Multilingual Ability of Large Vision-Language Model
- 2024DeepSeek-VL: Towards Real-World Vision-Language Understanding
- 2026"Inctelegi Romanecste?'' A Recipe for Romanian Vision-Language Models
- 2025Rethinking Multilingual Vision-Language Translation: Dataset, Evaluation, and Adaptation
- 2025Benchmarking and Boosting Multilingual Capabilities of LVLMs via OCR-Centric Reinforcement Learning
- 2024ALLaVA: Harnessing GPT4V-Synthesized Data for Lite Vision-Language Models
- 2025Behind Maya: Building a Multilingual Vision Language Model