Leveraging Label Semantics and Meta-Label Refinement for Multi-Label Question Classification
Not on the map. Why?
Abstract (arXiv)
Accurate annotation of educational resources is crucial for effective personalized learning and resource recommendation in online education. However, fine-grained knowledge labels often overlap or share similarities, making it difficult for existing multi-label classification methods to differentiate them. The label distribution imbalance due to sparsity of human annotations further intensifies these challenges. To address these issues, this paper introduces RR2QC, a novel Retrieval Reranking method to multi-label Question Classification by leveraging label semantics and meta-label refinement. First, RR2QC improves the pre-training strategy by utilizing semantic relationships within and across label groups. Second, it introduces a class center learning task to align questions with label semantics during downstream training. Finally, this method decomposes labels into meta-labels and uses a meta-label classifier to rerank the retrieved label sequences. In doing so, RR2QC enhances the understanding and prediction capability of long-tail labels by learning from meta-labels that frequently appear in other labels. Additionally, a mathematical LLM is used to generate solutions for questions, extracting latent information to further refine the model's insights. Experimental results show that RR2QC outperforms existing methods in Precision@K and F1 scores across multiple educational datasets, demonstrating its effectiveness for online education applications. The code and datasets are available at https://github.com/78Erii/RR2QC.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 28 of its 61 references that are in the map. First posted on arXiv 4 Nov 2024.
Builds on
28 of 61 references.
References · 28
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2022Training language models to follow instructions with human feedbackcited by 15,971
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
- 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,513
- 2020Don't Stop Pretraining: Adapt Language Models to Domains and Taskscited by 1,565
- 2019Class-Balanced Loss Based on Effective Number of Samplescited by 1,245
- 2014Convolutional Neural Networks for Sentence Classificationcited by 1,127
- 2024ChatGLM: A Family of Large Language Models from GLM-130B to GLM-4 All Toolscited by 1,121
- 2023Llemma: An Open Language Model For Mathematicscited by 388
- 2020Asymmetric Loss For Multi-Label Classificationcited by 381
- 2017HDLTex: Hierarchical Deep Learning for Text Classificationcited by 106
- 2023Text Classification via Large Language Modelscited by 106
16 more
- 2018AttentionXML: Label Tree-based Attention-Aware Deep Model for High-Performance Extreme Multi-Label Text Classificationcited by 102
- 2016Image-to-Markup Generation with Coarse-to-Fine Attentioncited by 79
- 2021MathBERT: A Pre-Trained Model for Mathematical Formula Understandingcited by 58
- 2021MathBERT: A Pre-trained Language Model for General NLP Tasks in Mathematics Educationcited by 37
- 2022Ranking Info Noise Contrastive Estimation: Boosting Contrastive Learning via Ranked Positivescited by 37
- 2021DECAF: Deep Extreme Classification with Label Featurescited by 33
- 2022HPT: Hierarchy-aware Prompt Tuning for Hierarchical Text Classificationcited by 31
- 2024TELEClass: Taxonomy Enrichment and LLM-Enhanced Hierarchical Text Classification with Minimal Supervisioncited by 25
- 2024LLMvsSmall Model? Large Language Model Based Text Augmentation Enhanced Personality Detection Modelcited by 21
- 2023Label Supervised LLaMA Finetuningcited by 20
- 2020Label Confusion Learning to Enhance Text Classification Modelscited by 16
- 2022JiuZhang: A Chinese Pre-trained Language Model for Mathematical Problem Understandingcited by 15
- 2022An Effective Deployment of Contrastive Learning in Multi-label Text Classificationcited by 9
- 2023Towards a Holistic Understanding of Mathematical Questions with Contrastive Pre-trainingcited by 5
- 2023Instances and Labels: Hierarchy-aware Joint Supervised Contrastive Learning for Hierarchical Multi-Label Text Classificationcited by 4
- 2022Automatic tagging of knowledge points for K12 math problemscited by 1
Built on by
Citing papers per year: 2025: 4.
4 papers.
- 2025A Closed-Loop Personalized Learning Agent Integrating Neural Cognitive Diagnosis, Bounded-Ability Adaptive Testing, and LLM-Driven Feedbackcited by 0
- 2025TLCD: A Deep Transfer Learning Framework for Cross-Disciplinary Cognitive Diagnosiscited by 0
- 2025Dynamically Weighted Momentum with Adaptive Step Sizes for Efficient Deep Network Trainingcited by 0
- 2025Mask-Robust Face Verification for Online Learning via YOLOv5 and Residual Networkscited by 0
- 2025Mask-Robust Face Verification for Online Learning via YOLOv5 and Residual Networks29 Oct 2025
- 2025Dynamically Weighted Momentum with Adaptive Step Sizes for Efficient Deep Network Training29 Oct 2025
- 2025TLCD: A Deep Transfer Learning Framework for Cross-Disciplinary Cognitive Diagnosis27 Oct 2025
- 2025A Closed-Loop Personalized Learning Agent Integrating Neural Cognitive Diagnosis, Bounded-Ability Adaptive Testing, and LLM-Driven Feedback26 Oct 2025