mlsanityData to 14 Oct 2026

LaVy: Vietnamese Multimodal Large Language Model

arXiv 2404.07922 ↗First posted 11 Apr 2024cs.CL cs.CV cs.LGcited by 5

On the map: Multimodal LLMs / vision-language models → MLLM training and visual instruction tuning

Abstract (arXiv)

Large Language Models (LLMs) and Multimodal Large language models (MLLMs) have taken the world by storm with impressive abilities in complex reasoning and linguistic comprehension. Meanwhile there are plethora of works related to Vietnamese Large Language Models, the lack of high-quality resources in multimodality limits the progress of Vietnamese MLLMs. In this paper, we pioneer in address this by introducing LaVy, a state-of-the-art Vietnamese MLLM, and we also introduce LaVy-Bench benchmark designated for evaluating MLLMs's understanding on Vietnamese visual language tasks. Our project is public at https://github.com/baochi0212/LaVy

Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Placed in MLLM training and visual instruction tuning, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 8 of its 20 references that are in the map. First posted on arXiv 11 Apr 2024.

Builds on

8 of 20 references.

Closest ancestors · 2

Same direction, newest first

  1. 2024Peacock: A Family of Arabic Multimodal Large Language Models and Benchmarks1 Mar
  2. 2024Efficient Multimodal Learning from Data-centric Perspective18 Feb

Other references · 6

  1. 2017Attention Is All You Needcited by 60,361
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  3. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
  4. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
  5. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
  6. 2023mBLIP: Efficient Bootstrapping of Multilingual Vision-LLMscited by 41

Built on by

Cited by year

Citing papers per year: 2024: 3; 2025: 2.

5 papers.

  1. 2024A Survey on Evaluation of Multimodal Large Language Modelscited by 46
  2. 2024A Survey on Multimodal Benchmarks: In the Era of Large AI Modelscited by 27
  3. 2024Vintern-1B: An Efficient Multimodal Large Language Model for Vietnamesecited by 12
  4. 2025Large Multimodal Models for Low-Resource Languages: A Surveycited by 4
  5. 2025Parameter Efficient Multimodal Instruction Tuning for Romanian Vision Language Modelscited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2025VMMU: A Vietnamese Multitask Multimodal Understanding and Reasoning Benchmark
  2. 2024A Survey of Multimodal Large Language Model from A Data-centric Perspective
  3. 2023SEED-Bench-2: Benchmarking Multimodal Large Language Models
  4. 2024A Survey on Benchmarks of Multimodal Large Language Models
  5. 2024The Revolution of Multimodal Large Language Models: A Survey
  6. 2024Efficient Multimodal Large Language Models: A Survey
  7. 2024A Comprehensive Survey and Guide to Multimodal Large Language Models in Vision-Language Tasks
  8. 2024ViLLM-Eval: A Comprehensive Evaluation Suite for Vietnamese Large Language Models