B"uy"uk dil modellerinin T"urkcce verisetleri ile eugitilmesi ve ince ayarlanmasi

Large language models have advanced enormously, gained vast attraction and are having a phase of intensed research. Some of the developed models and training datasets have been made open-accessible. Hence these may be further fine-tuned with some techniques to obtain specialized models for specific tasks. When it comes to Turkish language, open-access models do not provide satisfactory coverage. This is also observed over published datasets. In this work, we propose some ideas to mitigate this issue: creating large Turkish datasets, training LLMs with these and fine-tuning pre-trained models with Turkish inputs. We report our findings on Turkish-based trainings with the problems encountered along the way. We conclude with outcomes of these experiments and propose ideas for further works. -- B"uy"uk dil modelleri inanilmaz "olcc"ude gelicsmekte, b"uy"uk ilgi toplayarak ve "uzerlerinde yougun aracstirmalarin yapildiugi bir d"onemdedirler. Gelicstirilen modeller ve eugitimde kullanilan verisetlerinden bazilari accik ericsimli olarak sunulmaktadir. B"oylece ince ayarlama teknikleri uygulayarak "ozellecsmics g"orevler iccin ccalicsabilir modeller elde edilmektedir. T"urkcce s"oz konusu olduugunda bu modellerinin kapsayiciliugi yeterli d"uzeyde deugildir. Bu durum, yayimlanan verisetlerinde de g"ozlemlenebilir. Bunu acsmanin yollari T"urkcce iccerikli b"uy"uk verisetlerinin olucsturulmasi, b"uy"uk dil modellerinin bunlarla eugitilmesi ve "onceden eugitilmics modellerin T"urkcce girdilerle ince ayarlanmalari olabilir. Bu ccalicsmada accik ericsimli dil modelleri ve verisetleri "uzerinde durulmakta ve T"urkcce temelli bazi deneyler, karcsilacsilan sorunlar ve sonucclar irdelenmektedir.