mlsanityData to 14 Oct 2026

Leveraging Label Semantics and Meta-Label Refinement for Multi-Label Question Classification

arXiv 2411.01841 ↗First posted 4 Nov 2024cs.LG cs.CLcited by 4

Not on the map. Why?

Abstract (arXiv)

Accurate annotation of educational resources is crucial for effective personalized learning and resource recommendation in online education. However, fine-grained knowledge labels often overlap or share similarities, making it difficult for existing multi-label classification methods to differentiate them. The label distribution imbalance due to sparsity of human annotations further intensifies these challenges. To address these issues, this paper introduces RR2QC, a novel Retrieval Reranking method to multi-label Question Classification by leveraging label semantics and meta-label refinement. First, RR2QC improves the pre-training strategy by utilizing semantic relationships within and across label groups. Second, it introduces a class center learning task to align questions with label semantics during downstream training. Finally, this method decomposes labels into meta-labels and uses a meta-label classifier to rerank the retrieved label sequences. In doing so, RR2QC enhances the understanding and prediction capability of long-tail labels by learning from meta-labels that frequently appear in other labels. Additionally, a mathematical LLM is used to generate solutions for questions, extracting latent information to further refine the model's insights. Experimental results show that RR2QC outperforms existing methods in Precision@K and F1 scores across multiple educational datasets, demonstrating its effectiveness for online education applications. The code and datasets are available at https://github.com/78Erii/RR2QC.

Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 28 of its 61 references that are in the map. First posted on arXiv 4 Nov 2024.

Builds on

28 of 61 references.

References · 28

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  2. 2022Training language models to follow instructions with human feedbackcited by 15,971
  3. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
  4. 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,513
  5. 2020Don't Stop Pretraining: Adapt Language Models to Domains and Taskscited by 1,565
  6. 2019Class-Balanced Loss Based on Effective Number of Samplescited by 1,245
  7. 2014Convolutional Neural Networks for Sentence Classificationcited by 1,127
  8. 2024ChatGLM: A Family of Large Language Models from GLM-130B to GLM-4 All Toolscited by 1,121
  9. 2023Llemma: An Open Language Model For Mathematicscited by 388
  10. 2020Asymmetric Loss For Multi-Label Classificationcited by 381
  11. 2017HDLTex: Hierarchical Deep Learning for Text Classificationcited by 106
  12. 2023Text Classification via Large Language Modelscited by 106
16 more
  1. 2018AttentionXML: Label Tree-based Attention-Aware Deep Model for High-Performance Extreme Multi-Label Text Classificationcited by 102
  2. 2016Image-to-Markup Generation with Coarse-to-Fine Attentioncited by 79
  3. 2021MathBERT: A Pre-Trained Model for Mathematical Formula Understandingcited by 58
  4. 2021MathBERT: A Pre-trained Language Model for General NLP Tasks in Mathematics Educationcited by 37
  5. 2022Ranking Info Noise Contrastive Estimation: Boosting Contrastive Learning via Ranked Positivescited by 37
  6. 2021DECAF: Deep Extreme Classification with Label Featurescited by 33
  7. 2022HPT: Hierarchy-aware Prompt Tuning for Hierarchical Text Classificationcited by 31
  8. 2024TELEClass: Taxonomy Enrichment and LLM-Enhanced Hierarchical Text Classification with Minimal Supervisioncited by 25
  9. 2024LLMvsSmall Model? Large Language Model Based Text Augmentation Enhanced Personality Detection Modelcited by 21
  10. 2023Label Supervised LLaMA Finetuningcited by 20
  11. 2020Label Confusion Learning to Enhance Text Classification Modelscited by 16
  12. 2022JiuZhang: A Chinese Pre-trained Language Model for Mathematical Problem Understandingcited by 15
  13. 2022An Effective Deployment of Contrastive Learning in Multi-label Text Classificationcited by 9
  14. 2023Towards a Holistic Understanding of Mathematical Questions with Contrastive Pre-trainingcited by 5
  15. 2023Instances and Labels: Hierarchy-aware Joint Supervised Contrastive Learning for Hierarchical Multi-Label Text Classificationcited by 4
  16. 2022Automatic tagging of knowledge points for K12 math problemscited by 1

Built on by

Cited by year

Citing papers per year: 2025: 4.

4 papers.