Hyacinth6B: A large language model for Traditional Chinese
Not on the map. Why?
Abstract (arXiv)
This research's primary motivation of this study is to address the high hardware and computational demands typically associated with LLMs.Therefore,our goal is to find a balance between model lightness and performance,striving to maximize performance while using a comparatively lightweight model. Hyacinth6B was developed with this objective in mind,aiming to fully leverage the core capabilities of LLMs without incurring substantial resource costs, effectively pushing the boundaries of smaller model's performance. The training approach involves parameter efficient finetuning using the LoRA method.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 17 of its 17 references that are in the map. First posted on arXiv 20 Mar 2024.
Builds on
17 of 17 references.
References · 17
- 2023GPT-4 Technical Reportcited by 18,132
- 2022Training language models to follow instructions with human feedbackcited by 15,712
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
- 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,916
- 2020Measuring Massive Multitask Language Understandingcited by 7,768
- 2016Overcoming catastrophic forgetting in neural networkscited by 4,718
- 2021GLM: General Language Model Pretraining with Autoregressive Blank Infillingcited by 1,026
- 2022GLM-130B: An Open Bilingual Pre-trained Modelcited by 837
- 2021GPT Understands, Toocited by 715
- 2023C-Eval: A Multi-Level Multi-Discipline Chinese Evaluation Suite for Foundation Modelscited by 694
- 2023CMMLU: Measuring massive multitask language understanding in Chinesecited by 436
5 more
- 2023LLM-Eval: Unified Multi-Dimensional Automatic Evaluation for Open-Domain Conversations with Large Language Modelscited by 100
- 2023XuanYuan 2.0: A Large Chinese Financial Chat Model with Hundreds of Billions Parameterscited by 92
- 2023Taiwan LLM: Bridging the Linguistic Divide with a Culturally Aligned Language Modelcited by 29
- 2023Advancing the Evaluation of Traditional Chinese Language Models: Towards a Comprehensive Benchmark Suitecited by 13
- 2023Extending the Pre-Training of BLOOM for Improved Support of Traditional Chinese: Models, Methods and Resultscited by 10
Built on by
Not cited yet.