mlsanityData to 14 Oct 2026

VinaLLaMA: LLaMA-based Vietnamese Foundation Model

arXiv 2312.11011 ↗First posted 18 Dec 2023cs.CLcited by 10

Not on the map. Why?

Abstract (arXiv)

In this technical report, we present VinaLLaMA, an open-weight, state-of-the-art (SOTA) Large Language Model for the Vietnamese language, built upon LLaMA-2 with an additional 800 billion trained tokens. VinaLLaMA not only demonstrates fluency in Vietnamese but also exhibits a profound understanding of Vietnamese culture, making it a truly indigenous model. VinaLLaMA-7B-chat, trained on 1 million high-quality synthetic samples, achieves SOTA results on key benchmarks, including VLSP, VMLU, and Vicuna Benchmark Vietnamese, marking a significant advancement in the Vietnamese AI landscape and offering a versatile resource for various applications.

Key facts. Cited by 10 papers in the map (data through 14 Oct 2026). Builds on 14 of its 23 references that are in the map. First posted on arXiv 18 Dec 2023.

Builds on

14 of 23 references.

References · 14

  1. 2020Language Models are Few-Shot Learnerscited by 32,419
  2. 2022Training language models to follow instructions with human feedbackcited by 15,971
  3. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
  4. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
  5. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
  6. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
  7. 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,893
  8. 2021Finetuned Language Models Are Zero-Shot Learnerscited by 3,780
  9. 2023Qwen Technical Reportcited by 3,344
  10. 2023The Falcon Series of Open Language Modelscited by 535
  11. 2023Sheared LLaMA: Accelerating Language Model Pre-training via Structured Pruningcited by 415
  12. 2023CulturaX: A Cleaned, Enormous, and Multilingual Dataset for Large Language Models in 167 Languagescited by 174
2 more
  1. 2023Platypus: Quick, Cheap, and Powerful Refinement of LLMscited by 150
  2. 2023PhoGPT: Generative Pre-training for Vietnamesecited by 8

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 4; 2025: 2; 2026: 4.

10 papers.

  1. 2024Sailor: Open Language Models for South-East Asiacited by 19
  2. 2025Global PIQA: Evaluating Commonsense Reasoning Across 100+ Languages and Culturescited by 10
  3. 2024BgGPT 1.0: Extending English-centric LLMs to other languagescited by 8
  4. 2024From Bytes to Borsch: Fine-Tuning Gemma and Mistral for the Ukrainian Language Representationcited by 6
  5. 2026Soro: A Lightweight Foundation Model and Chatbot for Tajikcited by 2
  6. 2024ViLLM-Eval: A Comprehensive Evaluation Suite for Vietnamese Large Language Modelscited by 1
  7. 2025A Benchmark Dataset and Evaluation Framework for Vietnamese Large Language Models in Customer Supportcited by 0
  8. 2026ViMultiChoice: Toward a Method That Gives Explanation for Multiple-Choice Reading Comprehension in Vietnamesecited by 0
  9. 2026VIVID: A Culturally Grounded Benchmark Exposing the Figurative Language Gap in Vietnamese NLPcited by 0
  10. 2026CantoneseLLM v2: Reasoning in a Low-Resource Languagecited by 0