Hierarchical MixUp Multi-label Classification with Imbalanced Interdisciplinary Research Proposals
Not on the map. Why?
Abstract (arXiv)
Funding agencies are largely relied on a topic matching between domain experts and research proposals to assign proposal reviewers. As proposals are increasingly interdisciplinary, it is challenging to profile the interdisciplinary nature of a proposal, and, thereafter, find expert reviewers with an appropriate set of expertise. An essential step in solving this challenge is to accurately model and classify the interdisciplinary labels of a proposal. Existing methodological and application-related literature, such as textual classification and proposal classification, are insufficient in jointly addressing the three key unique issues introduced by interdisciplinary proposal data: 1) the hierarchical structure of discipline labels of a proposal from coarse-grain to fine-grain, e.g., from information science to AI to fundamentals of AI. 2) the heterogeneous semantics of various main textual parts that play different roles in a proposal; 3) the number of proposals is imbalanced between non-interdisciplinary and interdisciplinary research. Can we simultaneously address the three issues in understanding the proposal's interdisciplinary nature? In response to this question, we propose a hierarchical mixup multiple-label classification framework, which we called H-MixUp. H-MixUp leverages a transformer-based semantic information extractor and a GCN-based interdisciplinary knowledge extractor for the first and second issues. H-MixUp develops a fused training method of Wold-level MixUp, Word-level CutMix, Manifold MixUp, and Document-level MixUp to address the third issue.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 27 of its 63 references that are in the map. First posted on arXiv 28 Sep 2022.
Builds on
27 of 63 references.
References · 27
- 2017Attention Is All You Needcited by 60,361
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,361
- 2017mixup: Beyond Empirical Risk Minimizationcited by 5,183
- 2013Distributed Representations of Words and Phrases and their Compositionalitycited by 3,474
- 2019CutMix: Regularization Strategy to Train Strong Classifiers with Localizable Featurescited by 2,884
- 2017Improved Regularization of Convolutional Neural Networks with Cutoutcited by 1,628
- 2016Enriching Word Vectors with Subword Informationcited by 1,583
- 2019MixMatch: A Holistic Approach to Semi-Supervised Learningcited by 1,391
15 more
- 2016Bag of Tricks for Efficient Text Classificationcited by 876
- 2021Transformer in Transformercited by 633
- 2019Interpolation Consistency Training for Semi-Supervised Learningcited by 251
- 2020How Does Mixup Help With Robustness and Generalization?cited by 193
- 2016Recurrent Neural Network for Text Classification with Multi-Task Learningcited by 144
- 2021TransMix: Attend to Mix for Vision Transformerscited by 79
- 2019Generative Adversarial Minority Oversamplingcited by 73
- 2021Balanced-MixUp for Highly Imbalanced Medical Image Classificationcited by 46
- 2021SSMix: Saliency-Based Span Mixup for Text Classificationcited by 39
- 2013Tradition and Innovation in Scientists' Research Strategiescited by 26
- 2019MixUp as Directional Adversarial Trainingcited by 14
- 2021Expert Knowledge-Guided Length-Variant Hierarchical Label Generation for Proposal Classificationcited by 9
- 2015Quantifying the Cognitive Extent of Sciencecited by 7
- 2020MixBoost: Synthetic Oversampling with Boosted Mixup for Handling Extreme Imbalancecited by 6
- 2022Who Should Review Your Proposal? Interdisciplinary Topic Path Detection for Research Proposalscited by 4
Built on by
Citing papers per year: 2022: 1.
1 paper.