mlsanityData to 14 Oct 2026

Won: Establishing Best Practices for Korean Financial NLP

arXiv 2503.17963 ↗First posted 23 Mar 2025cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

In this work, we present the first open leaderboard for evaluating Korean large language models focused on finance. Operated for about eight weeks, the leaderboard evaluated 1,119 submissions on a closed benchmark covering five MCQA categories: finance and accounting, stock price prediction, domestic company analysis, financial markets, and financial agent tasks and one open-ended qa task. Building on insights from these evaluations, we release an open instruction dataset of 80k instances and summarize widely used training strategies observed among top-performing models. Finally, we introduce Won, a fully open and transparent LLM built using these best practices. We hope our contributions help advance the development of better and safer financial LLMs for Korean and other languages.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 31 of its 51 references that are in the map. First posted on arXiv 23 Mar 2025.

Builds on

31 of 51 references.

References · 31

  1. 2024The Llama 3 Herd of Modelscited by 14,715
  2. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
  3. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 8,065
  4. 2022Self-Instruct: Aligning Language Models with Self-Generated Instructionscited by 2,724
  5. 2024Gemma 2: Improving Open Language Models at a Practical Sizecited by 1,998
  6. 2024Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phonecited by 1,917
  7. 2024MMLU-Pro: A More Robust and Challenging Multi-Task Language Understanding Benchmarkcited by 1,848
  8. 2025s1: Simple test-time scalingcited by 1,341
  9. 2019ZeRO: Memory Optimizations Toward Training Trillion Parameter Modelscited by 1,301
  10. 2023WizardLM: Empowering large pre-trained language models to follow complex instructionscited by 1,125
  11. 2024ChatGLM: A Family of Large Language Models from GLM-130B to GLM-4 All Toolscited by 1,121
  12. 2023BloombergGPT: A Large Language Model for Financecited by 939
19 more
  1. 2023WizardCoder: Empowering Code Large Language Models with Evol-Instructcited by 733
  2. 2023WizardMath: Empowering Mathematical Reasoning for Large Language Models via Reinforced Evol-Instructcited by 625
  3. 2025LIMO: Less is More for Reasoningcited by 498
  4. 2025Light-R1: Curriculum SFT, DPO and RL for Long COT from Scratch and Beyondcited by 175
  5. 2023UniMax: Fairer and more Effective Language Sampling for Large-Scale Multilingual Pretrainingcited by 151
  6. 2024InfiAgent-DABench: Evaluating Agents on Data Analysis Taskscited by 140
  7. 2024Liger Kernel: Efficient Triton Kernels for LLM Trainingcited by 130
  8. 2023LLM360: Towards Fully Transparent Open-Source LLMscited by 104
  9. 2024The BiGGen Bench: A Principled Benchmark for Fine-grained Evaluation of Language Models with Language Modelscited by 93
  10. 2024KMMLU: Measuring Massive Multitask Language Understanding in Koreancited by 91
  11. 2024A Survey on Large Language Models for Critical Societal Domains: Finance, Healthcare, and Lawcited by 74
  12. 2023Identifying and Mitigating Vulnerabilities in LLM-Integrated Applicationscited by 54
  13. 2025Understand, Solve and Translate: Bridging the Multilingual Mathematical Reasoning Gapcited by 43
  14. 2023Deficiency of Large Language Models in Finance: An Empirical Examination of Hallucinationcited by 41
  15. 2024MMLU-CF: A Contamination-free Multi-task Language Understanding Benchmarkcited by 41
  16. 2025Linguistic Generalizability of Test-Time Scaling in Mathematical Reasoningcited by 37
  17. 2025TinyR1-32B-Preview: Boosting Accuracy with Branch-Merge Distillationcited by 12
  18. 2024Are LLMs Rational Investors? A Study on Detecting and Reducing the Financial Bias in LLMscited by 7
  19. 2025Pensez: Less Data, Better Reasoning -- Rethinking French LLMcited by 5

Built on by

Not cited yet.