mlsanityData to 14 Oct 2026

HyperCLOVA X Technical Report

arXiv 2404.01954 ↗First posted 2 Apr 2024cs.CL cs.AIcited by 18

Not on the map. Why?

Abstract (arXiv)

We introduce HyperCLOVA X, a family of large language models (LLMs) tailored to the Korean language and culture, along with competitive capabilities in English, math, and coding. HyperCLOVA X was trained on a balanced mix of Korean, English, and code data, followed by instruction-tuning with high-quality human-annotated datasets while abiding by strict safety guidelines reflecting our commitment to responsible AI. The model is evaluated across various benchmarks, including comprehensive reasoning, knowledge, commonsense, factuality, coding, math, chatting, instruction-following, and harmlessness, in both Korean and English. HyperCLOVA X exhibits strong reasoning capabilities in Korean backed by a deep understanding of the language and cultural nuances. Further analysis of the inherent bilingual nature and its extension to multilingualism highlights the model's cross-lingual proficiency and strong generalization ability to untargeted languages, including machine translation between several language pairs and cross-lingual inference tasks. We believe that HyperCLOVA X can provide helpful guidance for regions or countries in developing their sovereign LLMs.

Key facts. Cited by 18 papers in the map (data through 14 Oct 2026). Builds on 67 of its 77 references that are in the map. First posted on arXiv 2 Apr 2024.

Builds on

67 of 77 references.

References · 67

  1. 2017Attention Is All You Needcited by 60,361
  2. 2020Language Models are Few-Shot Learnerscited by 32,419
  3. 2023GPT-4 Technical Reportcited by 18,396
  4. 2022Training language models to follow instructions with human feedbackcited by 15,971
  5. 2017Proximal Policy Optimization Algorithmscited by 15,215
  6. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
  7. 2021Training Verifiers to Solve Math Word Problemscited by 10,109
  8. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
  9. 2021Evaluating Large Language Models Trained on Codecited by 8,320
  10. 2020Measuring Massive Multitask Language Understandingcited by 7,963
  11. 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,708
  12. 2021Measuring Mathematical Problem Solving With the MATH Datasetcited by 5,371
38 more
  1. 2018Think you have Solved Question Answering? Try ARC, the AI2 Reasoning Challengecited by 4,886
  2. 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,703
  3. 2019HellaSwag: Can a Machine Really Finish Your Sentence?cited by 4,100
  4. 2022Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedbackcited by 3,720
  5. 2022FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awarenesscited by 3,673
  6. 2021Program Synthesis with Large Language Modelscited by 3,637
  7. 2021TruthfulQA: Measuring How Models Mimic Human Falsehoodscited by 2,975
  8. 2017TriviaQA: A Large Scale Distantly Supervised Challenge Dataset for Reading Comprehensioncited by 2,955
  9. 2015Neural Machine Translation of Rare Words with Subword Unitscited by 2,918
  10. 2019The Curious Case of Neural Text Degenerationcited by 2,916
  11. 2019PIQA: Reasoning about Physical Commonsense in Natural Languagecited by 2,883
  12. 2020Learning to summarize from human feedbackcited by 2,588
  13. 2022Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language modelscited by 1,998
  14. 2018CommonsenseQA: A Question Answering Challenge Targeting Commonsense Knowledgecited by 1,822
  15. 2022Challenging BIG-Bench Tasks and Whether Chain-of-Thought Can Solve Themcited by 1,807
  16. 2023GQA: Training Generalized Multi-Query Transformer Models from Multi-Head Checkpointscited by 1,346
  17. 2023FActScore: Fine-grained Atomic Evaluation of Factual Precision in Long Form Text Generationcited by 1,282
  18. 2020RealToxicityPrompts: Evaluating Neural Toxic Degeneration in Language Modelscited by 1,255
  19. 2021Scaling Language Models: Methods, Analysis & Insights from Training Gophercited by 1,202
  20. 2023LIMA: Less Is More for Alignmentcited by 1,100
  21. 2021A General Language Assistant as a Laboratory for Alignmentcited by 1,055
  22. 2018XNLI: Evaluating Cross-lingual Sentence Representationscited by 915
  23. 2022Super-NaturalInstructions: Generalization via Declarative Instructions on 1600+ NLP Taskscited by 868
  24. 2023Quantifying Language Models' Sensitivity to Spurious Features in Prompt Design or: How I learned to start worrying about prompt formattingcited by 817
  25. 2023AlpacaFarm: A Simulation Framework for Methods that Learn from Human Feedbackcited by 748
  26. 2023AGIEval: A Human-Centric Benchmark for Evaluating Foundation Modelscited by 716
  27. 2021BBQ: A Hand-Built Bias Benchmark for Question Answeringcited by 701
  28. 2021The FLORES-101 Evaluation Benchmark for Low-Resource and Multilingual Machine Translationcited by 560
  29. 2023The Falcon Series of Open Language Modelscited by 535
  30. 2019Neural Text Generation with Unlikelihood Trainingcited by 503
  31. 2018Scalable agent alignment via reward modeling: a research directioncited by 447
  32. 2021BOLD: Dataset and Metrics for Measuring Biases in Open-Ended Language Generationcited by 412
  33. 2023Orca: Progressive Learning from Complex Explanation Traces of GPT-4cited by 379
  34. 2022The Stack: 3 TB of permissively licensed source codecited by 359
  35. 2021True Few-Shot Learning with Language Modelscited by 344
  36. 2024Aya Model: An Instruction Finetuned Open-Access Multilingual Language Modelcited by 295
  37. 2023A Long Way to Go: Investigating Length Correlations in RLHFcited by 291
  38. 2019Way Off-Policy Batch Deep Reinforcement Learning of Implicit Human Preferences in Dialogcited by 284

50 most cited of 67 All 67 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 6; 2025: 9; 2026: 3.

18 papers.

Sort:

By area:

  1. 2024A Survey on Mixture of Experts in Large Language Modelscited by 237
  2. 2024Survey of Cultural Awareness in Language Models: Text and Beyondcited by 103
  3. 2024LLM-as-a-Judge & Reward Model: What They Can and Cannot Docited by 32
  4. 2025Cross-lingual Collapse: How Language-Centric Foundation Models Shape Reasoning in Large Language Modelscited by 11
  5. 2025ValuesRAG: Enhancing Cultural Alignment Through Retrieval-Augmented Contextual Learningcited by 10
  6. 2025Global PIQA: Evaluating Commonsense Reasoning Across 100+ Languages and Culturescited by 10
  7. 2025Guardians and Offenders: A Survey on Harmful Content Generation and Safety Mitigation of LLMcited by 9
  8. 2024LlamaDuo: LLMOps Pipeline for Seamless Migration from Service LLMs to Small-Scale Local LLMscited by 8
  9. 2024KaSA: Knowledge-Aware Singular-Value Adaptation of Large Language Modelscited by 8
  10. 2024Guaranteed Generation from Large Language Modelscited by 7
  11. 2025HyperCLOVA X THINK Technical Reportcited by 7
  12. 2025Nunchi-Bench: Benchmarking Language Models on Cultural Reasoning with a Focus on Korean Superstitioncited by 6
6 more
  1. 2026Toward Culturally Aligned LLMs through Ontology-Guided Multi-Agent Reasoningcited by 3
  2. 2025Expanding Foundational Language Capabilities in Open-Source LLMs through a Korean Case Studycited by 2
  3. 2025KoSimpleQA: A Korean Factuality Benchmark with an Analysis of Reasoning LLMscited by 1
  4. 2026KorMedMCQA-V: A Multimodal Benchmark for Evaluating Vision-Language Models on the Korean Medical Licensing Examinationcited by 1
  5. 2025Soft Inductive Bias Approach via Explicit Reasoning Perspectives in Inappropriate Utterance Detection Using Large Language Modelscited by 0
  6. 2026K-MetBench: A Multi-Dimensional Benchmark for Fine-Grained Evaluation of Expert Reasoning, Locality, and Multimodality in Meteorologycited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2025KORMo: Korean Open Reasoning Model for Everyone
  2. 2026HyperCLOVA X 32B Think
  3. 2025Understand, Solve and Translate: Bridging the Multilingual Mathematical Reasoning Gap
  4. 2024Responsible Multilingual Large Language Models: A Survey of Development, Applications, and Societal Impact
  5. 2025Seed-X: Building Strong Multilingual Translation LLM with 7B Parameters
  6. 2024Multilingual Large Language Models: A Systematic Survey
  7. 2025LaoBench: A Large-Scale Multidimensional Lao Benchmark for Large Language Models
  8. 2024Optimizing Language Augmentation for Multilingual Large Language Models: A Case Study on Korean