mlsanityData to 7 Oct 2026

SiamGPT: Quality-First Fine-Tuning for Stable Thai Text Generation

arXiv 2512.19455 ↗First posted 22 Dec 2025cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

Open-weights large language models remain difficult to deploy for Thai due to unstable generation under complex instructions, despite strong English performance. To mitigate these limitations, We present SiamGPT-32B, an open-weights model based on Qwen3-32B, fine-tuned with a Quality-First strategy emphasizing curated supervision over data scale. The fine-tuning pipeline combines high-complexity English instruction data with a Thai-adapted AutoIF framework for instruction and linguistic constraints. Using supervised fine-tuning only, without continual pretraining or corpus expansion, SiamGPT-32B improves instruction adherence, multi-turn robustness, and linguistic stability. Evaluations on the SEA-HELM benchmark show that SiamGPT-32B achieves the strongest overall performance among similar-scale open-weights Thai models, with consistent gains in instruction following, multi-turn dialogue, and natural language understanding.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 19 of its 23 references that are in the map. First posted on arXiv 22 Dec 2025.

Builds on

19 of 23 references.

References · 19

  1. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
  2. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,393
  3. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,916
  4. 2019The Curious Case of Neural Text Degenerationcited by 2,881
  5. 2024HybridFlow: A Flexible and Efficient RLHF Frameworkcited by 1,980
  6. 2024HarmBench: A Standardized Evaluation Framework for Automated Red Teaming and Robust Refusalcited by 1,330
  7. 2023Instruction-Following Evaluation for Large Language Modelscited by 1,143
  8. 2023An Empirical Study of Catastrophic Forgetting in Large Language Models During Continual Fine-tuningcited by 622
  9. 2024A Survey on Hallucination in Large Vision-Language Modelscited by 352
  10. 2025Agentic Context Engineering: Evolving Contexts for Self-Improving Language Modelscited by 349
  11. 2023From Quantity to Quality: Boosting LLM Performance with Self-Guided Data Selection for Instruction Tuningcited by 301
  12. 2025LIMR: Less is More for RL Scalingcited by 136
7 more
  1. 2024Automatic and Universal Prompt Injection Attacks against Large Language Modelscited by 112
  2. 2019Don't Say That! Making Inconsistent Dialogue Unlikely with Unlikelihood Trainingcited by 110
  3. 2024Self-play with Execution Feedback: Improving Instruction-following Capabilities of Large Language Modelscited by 73
  4. 2019The Effect of Translationese in Machine Translation Test Setscited by 49
  5. 2025DeepAnalyze: Agentic Large Language Models for Autonomous Data Sciencecited by 49
  6. 2025SEA-HELM: Southeast Asian Holistic Evaluation of Language Modelscited by 17
  7. 2024Typhoon 2: A Family of Open Text and Multimodal Thai Large Language Modelscited by 12

Built on by

Not cited yet.