mlsanityData to 7 Oct 2026

Linguistically Informed Graph Model and Semantic Contrastive Learning for Korean Short Text Classification

arXiv 2603.03652 ↗First posted 4 Mar 2026cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

Short text classification (STC) remains a challenging task due to the scarcity of contextual information and labeled data. However, existing approaches have pre-dominantly focused on English because most benchmark datasets for the STC are primarily available in English. Consequently, existing methods seldom incorporate the linguistic and structural characteristics of Korean, such as its agglutinative morphology and flexible word order. To address these limitations, we propose LIGRAM, a hierarchical heterogeneous graph model for Korean short-text classification. The proposed model constructs sub-graphs at the morpheme, part-of-speech, and named-entity levels and hierarchically integrates them to compensate for the limited contextual information in short texts while precisely capturing the grammatical and semantic dependencies inherent in Korean. In addition, we apply Semantics-aware Contrastive Learning (SemCon) to reflect semantic similarity across documents, enabling the model to establish clearer decision boundaries even in short texts where class distinctions are often ambiguous. We evaluate LIGRAM on four Korean short-text datasets, where it consistently outperforms existing baseline models. These outcomes validate that integrating language-specific graph representations with SemCon provides an effective solution for short text classification in agglutinative languages such as Korean.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 19 of its 33 references that are in the map. First posted on arXiv 4 Mar 2026.

Builds on

19 of 33 references.

References · 19

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2020Unsupervised Learning of Visual Features by Contrasting Cluster Assignmentscited by 2,845
  3. 2020Supervised Contrastive Learningcited by 2,803
  4. 2021SimCSE: Simple Contrastive Learning of Sentence Embeddingscited by 2,168
  5. 2014Convolutional Neural Networks for Sentence Classificationcited by 1,124
  6. 2020Prototypical Contrastive Learning of Unsupervised Representationscited by 636
  7. 2018Graph Convolutional Networks for Text Classificationcited by 345
  8. 2020Supervised Contrastive Learning for Pre-trained Language Model Fine-tuningcited by 275
  9. 2016Recurrent Neural Network for Text Classification with Multi-Task Learningcited by 144
  10. 2021KLUE: Korean Language Understanding Evaluationcited by 113
  11. 2015PTE: Predictive Text Embedding through Large-scale Heterogeneous Text Networkscited by 96
  12. 2020Every Document Owns Its Structure: Inductive Text Classification via Graph Neural Networkscited by 77
7 more
  1. 2020Be More with Less: Hypergraph Attention Networks for Inductive Text Classificationcited by 73
  2. 2019Text Level Graph Neural Network for Text Classificationcited by 60
  3. 2020Tensor Graph Convolutional Networks for Text Classificationcited by 49
  4. 2022Mitigating Data Sparsity for Short Text Topic Modeling by Topic-Semantic Contrastive Learningcited by 38
  5. 2019Deep Short Text Classification with Knowledge Powered Attentioncited by 22
  6. 2021Hierarchical Heterogeneous Graph Representation Learning for Short Text Classificationcited by 13
  7. 2018Rich Character-Level Information for Korean Morphological Analysis and Part-of-Speech Taggingcited by 3

Built on by

Not cited yet.