mlsanityData to 7 Oct 2026

KorNLI and KorSTS: New Benchmark Datasets for Korean Natural Language Understanding

arXiv 2004.03289 ↗First posted 7 Apr 2020cs.CLcited by 37

Not on the map. Why?

Abstract (arXiv)

Natural language inference (NLI) and semantic textual similarity (STS) are key tasks in natural language understanding (NLU). Although several benchmark datasets for those tasks have been released in English and a few other languages, there are no publicly available NLI or STS datasets in the Korean language. Motivated by this, we construct and release new datasets for Korean NLI and STS, dubbed KorNLI and KorSTS, respectively. Following previous approaches, we machine-translate existing English training sets and manually translate development and test sets into Korean. To accelerate research on Korean NLU, we also establish baselines on KorNLI and KorSTS. Our datasets are publicly available at https://github.com/kakaobrain/KorNLUDatasets.

Key facts. Cited by 37 papers in the map (data through 7 Oct 2026). First posted on arXiv 7 Apr 2020.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 10; 2022: 5; 2023: 5; 2024: 8; 2025: 5; 2026: 4.

37 papers.

Sort:

By area:

  1. 2021KLUE: Korean Language Understanding Evaluationcited by 113
  2. 2024KMMLU: Measuring Massive Multitask Language Understanding in Koreancited by 91
  3. 2021Mitigating Language-Dependent Ethnic Bias in BERTcited by 87
  4. 2024CLIcK: A Benchmark Dataset of Cultural and Linguistic Intelligence in Koreancited by 65
  5. 2023HAE-RAE Bench: Evaluation of Korean Knowledge in Language Modelscited by 47
  6. 2022ORCA: A Challenging Benchmark for Arabic Language Understandingcited by 46
  7. 2022KOBEST: Korean Balanced Evaluation of Significant Taskscited by 37
  8. 2023ScandEval: A Benchmark for Scandinavian Natural Language Processingcited by 16
  9. 2022Compositional Evaluation on Japanese Textual Entailment and Similaritycited by 14
  10. 2021Accurate, yet inconsistent? Consistency Analysis on Language Understanding Modelscited by 13
  11. 2021KoreALBERT: Pretraining a Lite BERT Model for Korean Language Understandingcited by 9
  12. 2025Where Are We? Evaluating LLM Performance on African Languagescited by 9
25 more
  1. 2021Analyzing Zero-shot Cross-lingual Transfer in Supervised NLP Taskscited by 8
  2. 2024Multilingual Sentence-T5: Scalable Sentence Encoders for Multilingual Applicationscited by 7
  3. 2024SLM as Guardian: Pioneering AI Safety with Small Language Modelscited by 7
  4. 2023GeoGLUE: A GeoGraphic Language Understanding Evaluation Benchmarkcited by 5
  5. 2021A Survey on Awesome Korean NLP Datasetscited by 3
  6. 2022InferES : A Natural Language Inference Corpus for Spanish Featuring Negation-Based Contrastive and Adversarial Examplescited by 3
  7. 2024XNLIeu: a dataset for cross-lingual NLI in Basquecited by 3
  8. 2021A novel hybrid methodology of measuring sentence similaritycited by 2
  9. 2024Are ELECTRA's Sentence Embeddings Beyond Repair? The Case of Semantic Textual Similaritycited by 2
  10. 2024Modular Sentence Encoders: Separating Language Specialization from Cross-Lingual Alignmentcited by 2
  11. 2021Transformer-based Korean Pretrained Language Models: A Survey on Three Years of Progresscited by 1
  12. 2023JCSE: Contrastive Learning of Japanese Sentence Embeddings and Its Applicationscited by 1
  13. 2024Cross-lingual Transfer or Machine Translation? On Data Augmentation for Monolingual Semantic Textual Similaritycited by 1
  14. 2025Domain Adaptation for Japanese Sentence Embeddings with Contrastive Learning based on Synthetic Sentence Generationcited by 1
  15. 2025Survey of NLU Benchmarks Diagnosing Linguistic Phenomena: Why not Standardize Diagnostics Benchmarks?cited by 1
  16. 2026ViLegalNLI: Natural Language Inference for Vietnamese Legal Textscited by 1
  17. 2021Structured Pattern Pruning Using Regularizationcited by 0
  18. 2021DPRK-BERT: The Supreme Language Modelcited by 0
  19. 2022Marvelous Agglutinative Language Effect on Cross Lingual Transfer Learningcited by 0
  20. 2023DaG LLM ver 1.0: Pioneering Instruction-Tuned Language Modeling for Korean NLPcited by 0
  21. 2025Making Sense of Korean Sentences: A Comprehensive Evaluation of LLMs through KoSEnd Datasetcited by 0
  22. 2025Ko-PIQA: A Korean Physical Commonsense Reasoning Dataset with Cultural Contextcited by 0
  23. 2026SCRIPT: A Subcharacter Compositional Representation Injection Module for Korean Pre-Trained Language Modelscited by 0
  24. 2026KOMBO: Korean Character Representations Based on the Combination Rules of Subcharacterscited by 0
  25. 2026SEA-NLI: Natural Language Inference as a Lens into Southeast Asian Cultural Understandingcited by 0