mlsanityData to 14 Oct 2026

Sabi'a-2: A New Generation of Portuguese Large Language Models

arXiv 2403.09887 ↗First posted 14 Mar 2024cs.CL cs.AIcited by 10

Not on the map. Why?

Abstract (arXiv)

We introduce Sabi'a-2, a family of large language models trained on Portuguese texts. The models are evaluated on a diverse range of exams, including entry-level tests for Brazilian universities, professional certification exams, and graduate-level exams for various disciplines such as accounting, economics, engineering, law and medicine. Our results reveal that our best model so far, Sabi'a-2 Medium, matches or surpasses GPT-4's performance in 23 out of 64 exams and outperforms GPT-3.5 in 58 out of 64 exams. Notably, specialization has a significant impact on a model's performance without the need to increase its size, allowing us to offer Sabi'a-2 Medium at a price per token that is 10 times cheaper than GPT-4. Finally, we identified that math and coding are key abilities that need improvement.

Key facts. Cited by 10 papers in the map (data through 14 Oct 2026). Builds on 11 of its 14 references that are in the map. First posted on arXiv 14 Mar 2024.

Builds on

11 of 14 references.

References · 11

  1. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
  2. 2022Solving Quantitative Reasoning Problems with Language Modelscited by 1,392
  3. 2023Towards Understanding Sycophancy in Language Modelscited by 1,040
  4. 2023Towards Expert-Level Medical Question Answering with Large Language Modelscited by 384
  5. 2023SeaLLMs -- Large Language Models for Southeast Asiacited by 104
  6. 2023Typhoon: Thai Large Language Modelscited by 30
  7. 2023Taiwan LLM: Bridging the Linguistic Divide with a Culturally Aligned Language Modelcited by 29
  8. 2023Evaluating GPT-3.5 and GPT-4 Models on Brazilian University Admission Examscited by 25
  9. 2023BLUEX: A benchmark based on Brazilian Leading Universities Entrance eXamscited by 15
  10. 2023PersianLLaMA: Towards Building First Persian Large Language Modelcited by 14
  11. 2023Evaluating GPT-4's Vision Capabilities on Brazilian University Admission Examscited by 6

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 4; 2025: 3; 2026: 3.

10 papers.

  1. 2024Survey of Cultural Awareness in Language Models: Text and Beyondcited by 103
  2. 2024FuxiTranyu: A Multilingual Large Language Model Trained with Balanced Datacited by 10
  3. 2025Building High-Quality Datasets for Portuguese LLMs: From Common Crawl Snapshots to Industrial-Grade Corporacited by 7
  4. 2024Juru: Legal Brazilian Large Language Model from Reputable Sourcescited by 5
  5. 2025PoETa v2: Toward More Robust Evaluation of Large Language Models in Portuguesecited by 5
  6. 2024Performance in a dialectal profiling task of LLMs for varieties of Brazilian Portuguesecited by 3
  7. 2025BRoverbs -- Measuring how much LLMs understand Portuguese proverbscited by 3
  8. 2026CALM: Culturally Self-Aware Language Modelscited by 2
  9. 2026Prosa: Rubric-Based Evaluation of LLMs on Real User Chats in Brazilian Portuguesecited by 0
  10. 2026Language Models for Portuguese: A Systematic Mapping Studycited by 0