mlsanityData to 14 Oct 2026

Hierarchy-Consistent Learning and Adaptive Loss Balancing for Hierarchical Multi-Label Classification

arXiv 2508.13452 ↗First posted 19 Aug 2025cs.LG cs.CVcited by 2

Not on the map. Why?

Abstract (arXiv)

Hierarchical Multi-Label Classification (HMC) faces critical challenges in maintaining structural consistency and balancing loss weighting in Multi-Task Learning (MTL). In order to address these issues, we propose a classifier called HCAL based on MTL integrated with prototype contrastive learning and adaptive task-weighting mechanisms. The most significant advantage of our classifier is semantic consistency including both prototype with explicitly modeling label and feature aggregation from child classes to parent classes. The other important advantage is an adaptive loss-weighting mechanism that dynamically allocates optimization resources by monitoring task-specific convergence rates. It effectively resolves the "one-strong-many-weak" optimization bias inherent in traditional MTL approaches. To further enhance robustness, a prototype perturbation mechanism is formulated by injecting controlled noise into prototype to expand decision boundaries. Additionally, we formalize a quantitative metric called Hierarchical Violation Rate (HVR) as to evaluate hierarchical consistency and generalization. Extensive experiments across three datasets demonstrate both the higher classification accuracy and reduced hierarchical violation rate of the proposed classifier over baseline models.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 19 of its 33 references that are in the map. First posted on arXiv 19 Aug 2025.

Builds on

19 of 33 references.

References · 19

  1. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 12,049
  2. 2021SimCSE: Simple Contrastive Learning of Sentence Embeddingscited by 2,173
  3. 2020Gradient Surgery for Multi-Task Learningcited by 1,256
  4. 2017GradNorm: Gradient Normalization for Adaptive Loss Balancing in Deep Multitask Networkscited by 834
  5. 2021FedProto: Federated Prototype Learning across Heterogeneous Clientscited by 352
  6. 2019Multi-Task Deep Neural Networks for Natural Language Understandingcited by 350
  7. 2022Multi-Task Learning as a Bargaining Gamecited by 215
  8. 2024Distribution Matching for Multi-Task Learning of Classification Tasks: a Large-Scale Study on Faces & Beyondcited by 60
  9. 2022Prototypical Verbalizer for Prompt-based Few-shot Tuningcited by 53
  10. 2023Online Prototype Learning for Online Continual Learningcited by 53
  11. 2021Multi-Label Classification Neural Networks with Hard Logical Constraintscited by 36
  12. 2023Prototype-Sample Relation Distillation: Towards Replay-Free Continual Learningcited by 35
7 more
  1. 2019Hyperbolic Interaction Model For Hierarchical Multi-Label Classificationcited by 30
  2. 2022Label Relation Graphs Enhanced Hierarchical Residual Network for Hierarchical Multi-Granularity Classificationcited by 29
  3. 2022Adversarial Contrastive Learning via Asymmetric InfoNCEcited by 13
  4. 2024Error Detection and Constraint Recovery in Hierarchical Multi-Label Classification without Prior Knowledgecited by 7
  5. 2023PrototypeFormer: Learning to Explore Prototype Relationships for Few-shot Image Classificationcited by 3
  6. 2024HSVLT: Hierarchical Scale-Aware Vision-Language Transformer for Multi-Label Image Classificationcited by 3
  7. 2021Jointly Modeling Heterogeneous Student Behaviors and Interactions Among Multiple Prediction Taskscited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 2.

2 papers.