mlsanityData to 7 Oct 2026

Breeze-7B Technical Report

arXiv 2403.02712 ↗First posted 5 Mar 2024cs.CLcited by 4

Not on the map. Why?

Abstract (arXiv)

Breeze-7B is an open-source language model based on Mistral-7B, designed to address the need for improved language comprehension and chatbot-oriented capabilities in Traditional Chinese. This technical report provides an overview of the additional pretraining, finetuning, and evaluation stages for the Breeze-7B model. The Breeze-7B family of base and chat models exhibits good performance on language comprehension and chatbot-oriented tasks, reaching the top in several benchmarks among models comparable in its complexity class.

Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 16 of its 21 references that are in the map. First posted on arXiv 5 Mar 2024.

Builds on

16 of 21 references.

References · 16

  1. 2023GPT-4 Technical Reportcited by 18,132
  2. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,393
  3. 2016SGDR: Stochastic Gradient Descent with Warm Restartscited by 4,993
  4. 2015Neural Machine Translation of Rare Words with Subword Unitscited by 2,898
  5. 2022BLOOM: A 176B-Parameter Open-Access Multilingual Language Modelcited by 1,968
  6. 2023Extending Context Window of Large Language Models via Positional Interpolationcited by 721
  7. 2023YaRN: Efficient Context Window Extension of Large Language Modelscited by 584
  8. 2023Textbooks Are All You Needcited by 561
  9. 2023Textbooks Are All You Need II: phi-1.5 technical reportcited by 559
  10. 2023Effective Long-Context Scaling of Foundation Modelscited by 301
  11. 2023ChipNeMo: Domain-Adapted LLMs for Chip Designcited by 168
  12. 2023Scaling Laws of RoPE-based Extrapolationcited by 124
4 more
  1. 2018DRCD: a Chinese Machine Reading Comprehension Datasetcited by 57
  2. 2023Advancing the Evaluation of Traditional Chinese Language Models: Towards a Comprehensive Benchmark Suitecited by 13
  3. 2023Extending the Pre-Training of BLOOM for Improved Support of Traditional Chinese: Models, Methods and Resultscited by 10
  4. 2024An Improved Traditional Chinese Evaluation Suite for Foundation Modelcited by 10

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 3; 2026: 1.

4 papers.

  1. 2025The Breeze 2 Herd of Models: Traditional Chinese LLMs Based on Llama with Vision-Aware and Function-Calling Capabilitiescited by 4
  2. 2025Knowledge Retrieval Based on Generative AIcited by 2
  3. 2025Low-Resource Fine-Tuning for Multi-Task Structured Information Extraction with a Billion-Parameter Instruction-Tuned Modelcited by 0
  4. 2026Automated IEP Generation from Traditional Chinese Parent-Teacher Interviews via Corpus-Grounded Feature Diffusioncited by 0