Phoenix-VL 1.5 Medium Technical Report
Not on the map. Why?
Abstract (arXiv)
We introduce Phoenix-VL 1.5 Medium, a 123B-parameter natively multimodal and multilingual foundation model, adapted to regional languages and the Singapore context. Developed as a sovereign AI asset, it demonstrates that deep domain adaptation can be achieved with minimal degradation to broad-spectrum intelligence and alignment. Continued pretraining was performed on Mistral Medium 3.1 using a localized 1-trillion tokens multimodal corpus, followed by a 250-billion tokens long-context extension phase. Subsequent post-training incorporated a novel human-annotated Singapore multimodal dataset and curated textual corpus on Singapore culture, knowledge, and legislation, totaling 22-billion tokens. An additional 5 billion tokens of model alignment was performed through Online Direct Preference Optimization. Phoenix-VL 1.5 Medium achieves state-of-the-art performance for its size on Singapore multimodal, legal, and government policy benchmarks while remaining globally competitive on general multimodal intelligence, multilingual, and STEM benchmarks. We also introduce a novel evaluation suite encompassing localized knowledge benchmarks and an institutionally aligned model behavior and safety framework. We report the data curation principles, training methodology, and highlight benchmark and inference performance.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 34 of its 40 references that are in the map. First posted on arXiv 11 May 2026.
Builds on
34 of 40 references.
References · 34
- 2015Distilling the Knowledge in a Neural Networkcited by 10,076
- 2020Measuring Massive Multitask Language Understandingcited by 7,768
- 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,069
- 2022Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedbackcited by 3,634
- 2023Retrieval-Augmented Generation for Large Language Models: A Surveycited by 2,185
- 2023MMMU: A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for Expert AGIcited by 2,044
- 2024LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Codecited by 1,906
- 2020GLU Variants Improve Transformercited by 1,724
- 2023MathVista: Evaluating Mathematical Reasoning of Foundation Models in Visual Contextscited by 1,582
- 2020Don't Stop Pretraining: Adapt Language Models to Domains and Taskscited by 1,548
- 2019Root Mean Square Layer Normalizationcited by 1,425
- 2023GQA: Training Generalized Multi-Query Transformer Models from Multi-Head Checkpointscited by 1,311
22 more
- 2022No Language Left Behind: Scaling Human-Centered Machine Translationcited by 1,290
- 2018Averaging Weights Leads to Wider Optima and Better Generalizationcited by 1,194
- 2021Deduplicating Training Data Makes Language Models Bettercited by 705
- 2023YaRN: Efficient Context Window Extension of Large Language Modelscited by 584
- 2022Using DeepSpeed and Megatron to Train Megatron-Turing NLG 530B, A Large-Scale Generative Language Modelcited by 557
- 2023CMMLU: Measuring massive multitask language understanding in Chinesecited by 436
- 2024Pixtral 12Bcited by 174
- 2024Continual Learning for Large Language Models: A Surveycited by 144
- 2023SeaLLMs -- Large Language Models for Southeast Asiacited by 104
- 2024KMMLU: Measuring Massive Multitask Language Understanding in Koreancited by 91
- 2023Alignment for Honestycited by 72
- 2023COLLIE: Systematic Construction of Constrained Text Generation Taskscited by 69
- 2024Reuse, Don't Retrain: A Recipe for Continued Pretraining of Language Modelscited by 69
- 2022One Country, 700+ Languages: NLP Challenges for Underrepresented Languages and Dialects in Indonesiacited by 65
- 2024Should We Respect LLMs? A Cross-Lingual Study on the Influence of Prompt Politeness on LLM Performancecited by 41
- 2025Scalable-Softmax Is Superior for Attentioncited by 38
- 2024SeaLLMs 3: Open Foundation and Chat Multilingual Large Language Models for Southeast Asian Languagescited by 35
- 2025Sailor2: Sailing in South-East Asia with Inclusive Multilingual LLMscited by 17
- 2025SEA-HELM: Southeast Asian Holistic Evaluation of Language Modelscited by 17
- 2025SEA-LION: Southeast Asian Languages in One Networkcited by 17
- 2025Towards Safer Pretraining: Analyzing and Filtering Harmful Content in Webscale datasets for Responsible LLMscited by 8
- 2025Lost in Localization: Building RabakBench with Human-in-the-Loop Validation to Measure Multilingual Safety Gapscited by 2
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2024NVLM: Open Frontier-Class Multimodal LLMs
- 2024A Survey on Multimodal Benchmarks: In the Era of Large AI Models
- 2024From GPT-4 to Gemini and Beyond: Assessing the Landscape of MLLMs on Generalizability, Trustworthiness and Causality through Four Modalities
- 2026What Transfers from Text to Vision? Capability Scaling Laws and Transfer Dynamics for VLMs
- 2026Innovator-VL: A Multimodal Large Language Model for Scientific Discovery
- 2023Gemini in Reasoning: Unveiling Commonsense in Multimodal Large Language Models
- 2024V-Zen: Efficient GUI Understanding and Precise Grounding With A Novel Multimodal LLM
- 2024SUTRA: Scalable Multilingual Language Model Architecture