Multi-Task Learning for Metal Alloy Property Prediction: An Empirical Study of Negative Transfer and Mitigation Strategies
Not on the map. Why?
Abstract (arXiv)
Multi-task learning (MTL) in materials science relies on the assumption that physically related properties share learnable representations. We challenge this assumption using a 54,028-sample metal alloy dataset exhibiting extreme task-level imbalance. Our results reveal a striking dichotomy: MTL significantly degrades regression performance for resistivity and hardness but improves classification recall for amorphous-forming ability. We trace this divergence to mismatched functional forms--such as resistivity's polynomial dependence versus hardness's complex interactions--which cause severe gradient misalignment during optimization. Evaluating Deep Imbalanced Regression techniques, we find that projecting conflicting gradients (PCGrad) recovers single-task performance, while combining label distribution smoothing with gradient normalization achieves the best overall balance. Consequently, we propose a strategic framework: utilize independent models for high-precision characterization, but employ MTL for high-throughput screening where recall is paramount. These findings support a "materials property clustering" hypothesis, suggesting that distinct physical mechanisms require specialized optimization strategies to overcome negative transfer.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 13 of its 33 references that are in the map. First posted on arXiv 28 Dec 2025.
Builds on
13 of 33 references.
References · 13
- 2017Multi-Task Learning Using Uncertainty to Weigh Losses for Scene Geometry and Semanticscited by 1,345
- 2020Gradient Surgery for Multi-Task Learningcited by 1,210
- 2017GradNorm: Gradient Normalization for Adaptive Loss Balancing in Deep Multitask Networkscited by 816
- 2018Taskonomy: Disentangling Task Transfer Learningcited by 631
- 2020Multi-Task Learning with Deep Neural Networks: A Surveycited by 374
- 2019Which Tasks Should Be Learned Together in Multi-task Learning?cited by 367
- 2018Characterizing and Avoiding Negative Transfercited by 226
- 2021Delving into Deep Imbalanced Regressioncited by 157
- 2020A Survey on Negative Transfercited by 120
- 2022Balanced MSE for Imbalanced Visual Regressioncited by 89
- 2022Auto-Lambda: Disentangling Dynamic Task Relationshipscited by 73
- 2015Massively Multitask Networks for Drug Discoverycited by 49
1 more
Built on by
Not cited yet.