mlsanityData to 14 Oct 2026

SEA-LION: Southeast Asian Languages in One Network

arXiv 2504.05747 ↗First posted 8 Apr 2025cs.CLcited by 22

Not on the map. Why?

Abstract (arXiv)

Recently, Large Language Models (LLMs) have dominated much of the artificial intelligence scene with their ability to process and generate natural languages. However, the majority of LLM research and development remains English-centric, leaving low-resource languages such as those in the Southeast Asian (SEA) region under-represented. To address this representation gap, we introduce Llama-SEA-LION-v3-8B-IT and Gemma-SEA-LION-v3-9B-IT, two cutting-edge multilingual LLMs designed for SEA languages. The SEA-LION family of LLMs supports 11 SEA languages, namely English, Chinese, Indonesian, Vietnamese, Malay, Thai, Burmese, Lao, Filipino, Tamil, and Khmer. Our work leverages large-scale multilingual continued pre-training with a comprehensive post-training regime involving multiple stages of instruction fine-tuning, alignment, and model merging. Evaluation results on multilingual benchmarks indicate that our models achieve state-of-the-art performance across LLMs supporting SEA languages. We open-source the models to benefit the wider SEA community.

Key facts. Cited by 22 papers in the map (data through 14 Oct 2026). Builds on 38 of its 56 references that are in the map. First posted on arXiv 8 Apr 2025.

Builds on

38 of 56 references.

References · 38

  1. 2020Language Models are Few-Shot Learnerscited by 32,419
  2. 2024The Llama 3 Herd of Modelscited by 14,715
  3. 2021Measuring Mathematical Problem Solving With the MATH Datasetcited by 5,371
  4. 2023GPQA: A Graduate-Level Google-Proof Q&A Benchmarkcited by 2,879
  5. 2024Gemma 2: Improving Open Language Models at a Practical Sizecited by 1,998
  6. 2022BLOOM: A 176B-Parameter Open-Access Multilingual Language Modelcited by 1,984
  7. 2024MMLU-Pro: A More Robust and Challenging Multi-Task Language Understanding Benchmarkcited by 1,848
  8. 2022Challenging BIG-Bench Tasks and Whether Chain-of-Thought Can Solve Themcited by 1,807
  9. 2024LlamaFactory: Unified Efficient Fine-Tuning of 100+ Language Modelscited by 1,464
  10. 2024The FineWeb Datasets: Decanting the Web for the Finest Text Data at Scalecited by 1,160
  11. 2022Editing Models with Task Arithmeticcited by 1,120
  12. 2024SimPO: Simple Preference Optimization with a Reference-Free Rewardcited by 963
26 more
  1. 2016Bag of Tricks for Efficient Text Classificationcited by 876
  2. 2024MiniCPM: Unveiling the Potential of Small Language Models with Scalable Training Strategiescited by 723
  3. 2023Language Models are Super Mario: Absorbing Abilities from Homologous Models as a Free Lunchcited by 694
  4. 2023PyTorch FSDP: Experiences on Scaling Fully Sharded Data Parallelcited by 660
  5. 2024OLMo: Accelerating the Science of Language Modelscited by 613
  6. 2024StarCoder 2 and The Stack v2: The Next Generationcited by 502
  7. 2024Dolma: an Open Corpus of Three Trillion Tokens for Language Model Pretraining Researchcited by 483
  8. 2023UltraFeedback: Boosting Language Models with Scaled AI Feedbackcited by 406
  9. 2024Magpie: Alignment Data Synthesis from Scratch by Prompting Aligned LLMs with Nothingcited by 346
  10. 2024Aya Model: An Instruction Finetuned Open-Access Multilingual Language Modelcited by 295
  11. 2024Do Llamas Work in English? On the Latent Language of Multilingual Transformerscited by 281
  12. 2023MuSR: Testing the Limits of Chain-of-thought with Multistep Soft Reasoningcited by 201
  13. 2024OpenMathInstruct-2: Accelerating AI for Math with Massive Open-Source Instruction Datacited by 200
  14. 2019BPE-Dropout: Simple and Effective Subword Regularizationcited by 195
  15. 2023Small-scale proxies for large-scale Transformer training instabilitiescited by 183
  16. 2024Localizing Task Information for Improved Model Merging and Compressioncited by 131
  17. 2024Liger Kernel: Efficient Triton Kernels for LLM Trainingcited by 130
  18. 2023SeaLLMs -- Large Language Models for Southeast Asiacited by 104
  19. 2023SeaEval for Multilingual Foundation Models: From Cross-Lingual Alignment to Cultural Reasoningcited by 94
  20. 2024Beyond English-Centric LLMs: What Language Do Multilingual Language Models Think in?cited by 41
  21. 2024Mitigating Catastrophic Forgetting in Language Transfer via Model Mergingcited by 36
  22. 2024SeaLLMs 3: Open Foundation and Chat Multilingual Large Language Models for Southeast Asian Languagescited by 36
  23. 2023BHASA: A Holistic Southeast Asian Linguistic and Cultural Evaluation Suite for Large Language Modelscited by 18
  24. 2024Breaking Language Barriers: Cross-Lingual Continual Pre-Training at Scalecited by 15
  25. 2024Weighted-Reward Preference Optimization for Implicit Model Fusioncited by 15
  26. 2024Self-training Large Language Models through Knowledge Detectioncited by 8

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 4; 2026: 18.

22 papers.

Sort:

By area:

  1. 2026Tiny Aya: Bridging Scale and Multilingual Depthcited by 15
  2. 2026Gained in Translation: Privileged Pairwise Judges Enhance Multilingual Reasoningcited by 6
  3. 2025Fair-PP: A Synthetic Dataset for Aligning LLM with Personalized Preferences of Social Equitycited by 4
  4. 2026Preference Redirection via Attention Concentration: An Attack on Computer Use Agentscited by 3
  5. 2025Compass-V2 Technical Reportcited by 2
  6. 2025MERLIN: Multi-Stage Curriculum Alignment for Multilingual Encoder-LLM Integration in Cross-Lingual Reasoningcited by 2
  7. 2026Visual Memory Injection Attacks for Multi-Turn Conversationscited by 2
  8. 2026Anthropogenic Regional Adaptation in Multimodal Vision-Language Modelcited by 2
  9. 2026Buy versus Build an LLM: A Decision Framework for Governmentscited by 1
  10. 2026Language-Aware Distillation for Multilingual Instruction-Following Speech LLMs with ASR-Only Supervisioncited by 1
  11. 2025Sunflower: A New Approach To Expanding Coverage of African Languages in Large Language Modelscited by 0
  12. 2026HoReN: Normalized Hopfield Retrieval for Large-Scale Sequential Model Editingcited by 0
10 more
  1. 2026Phoenix-VL 1.5 Medium Technical Reportcited by 0
  2. 2026SEA-NLI: Natural Language Inference as a Lens into Southeast Asian Cultural Understandingcited by 0
  3. 2026World Wide Models: Literary Tools for Cultural AIcited by 0
  4. 2026Pancasila-Dilemmas: Evaluating Large Language Models on Indonesian Human Value Dilemmas Grounded in Pancasilacited by 0
  5. 2026TSWAP: A Multilingual Retrieval-Augmented Thai Wellness Advisorcited by 0
  6. 2026Cultural Moment Benchmark: Evaluating Video Cultural Reasoning and Grounding in Southeast Asiacited by 0
  7. 2026CultureConverse: A Multilingual Multi-turn Simulation Harness for Culturally Grounded Assistance in East and Southeast Asiacited by 0
  8. 2026Tanawpamana: Benchmarking Vision-Language Models on Philippine Cultural Heritage Sitescited by 0
  9. 2026TDR: Tagalog Diacritic Restoration Datasetcited by 0
  10. 2026SEA-HELM Audio: Evaluating Multilingual ASR-LLM Pipeline Performance Across SEA-HELM Subsetscited by 0