Computationally Efficient Wasserstein Loss for Structured Labels
Not on the map. Why?
Abstract (arXiv)
The problem of estimating the probability distribution of labels has been widely studied as a label distribution learning (LDL) problem, whose applications include age estimation, emotion analysis, and semantic segmentation. We propose a tree-Wasserstein distance regularized LDL algorithm, focusing on hierarchical text classification tasks. We propose predicting the entire label hierarchy using neural networks, where the similarity between predicted and true labels is measured using the tree-Wasserstein distance. Through experiments using synthetic and real-world datasets, we demonstrate that the proposed method successfully considers the structure of labels during training, and it compares favorably with the Sinkhorn algorithm in terms of computation time and memory usage.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 16 of its 31 references that are in the map. First posted on arXiv 1 Mar 2021.
Builds on
16 of 31 references.
References · 16
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
- 2013Sinkhorn Distances: Lightspeed Computation of Optimal Transportation Distancescited by 2,277
- 2016Enriching Word Vectors with Subword Informationcited by 1,578
- 2016Bag of Tricks for Efficient Text Classificationcited by 869
- 2018Computational Optimal Transportcited by 765
- 2015Optimal Transport for Domain Adaptationcited by 457
- 2015Learning with a Wasserstein Losscited by 194
- 2014Label Distribution Learningcited by 122
- 2016Deep Label Distribution Learning with Label Ambiguitycited by 104
- 2019Large-Scale Multi-Label Text Classification on EU Legislationcited by 104
- 2017Comparative Study of CNN and RNN for Natural Language Processingcited by 81
4 more
- 2016Stabilized Sparse Scaling Algorithms for Entropy Regularized Transport Problemscited by 69
- 2019Tree-Sliced Variants of Wasserstein Distancescited by 54
- 2020Fast Unbalanced Optimal Transport on a Treecited by 16
- 2018An Entropic Optimal Transport Loss for Learning Deep Neural Networks under Label Noise in Remote Sensing Imagescited by 11
Built on by
Citing papers per year: 2022: 1; 2023: 1.
2 papers.
- 2022Meta Optimal Transportcited by 28
- 2023An Empirical Study of Self-supervised Learning with Wasserstein Distancecited by 0
- 2023An Empirical Study of Self-supervised Learning with Wasserstein Distance16 Oct 2023
- 2022Meta Optimal Transport10 Jun 2022