mlsanityData to 7 Oct 2026

Multi-Task Learning for Metal Alloy Property Prediction: An Empirical Study of Negative Transfer and Mitigation Strategies

arXiv 2512.22740 ↗First posted 28 Dec 2025cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Multi-task learning (MTL) in materials science relies on the assumption that physically related properties share learnable representations. We challenge this assumption using a 54,028-sample metal alloy dataset exhibiting extreme task-level imbalance. Our results reveal a striking dichotomy: MTL significantly degrades regression performance for resistivity and hardness but improves classification recall for amorphous-forming ability. We trace this divergence to mismatched functional forms--such as resistivity's polynomial dependence versus hardness's complex interactions--which cause severe gradient misalignment during optimization. Evaluating Deep Imbalanced Regression techniques, we find that projecting conflicting gradients (PCGrad) recovers single-task performance, while combining label distribution smoothing with gradient normalization achieves the best overall balance. Consequently, we propose a strategic framework: utilize independent models for high-precision characterization, but employ MTL for high-throughput screening where recall is paramount. These findings support a "materials property clustering" hypothesis, suggesting that distinct physical mechanisms require specialized optimization strategies to overcome negative transfer.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 13 of its 33 references that are in the map. First posted on arXiv 28 Dec 2025.

Builds on

13 of 33 references.

References · 13

  1. 2017Multi-Task Learning Using Uncertainty to Weigh Losses for Scene Geometry and Semanticscited by 1,345
  2. 2020Gradient Surgery for Multi-Task Learningcited by 1,210
  3. 2017GradNorm: Gradient Normalization for Adaptive Loss Balancing in Deep Multitask Networkscited by 816
  4. 2018Taskonomy: Disentangling Task Transfer Learningcited by 631
  5. 2020Multi-Task Learning with Deep Neural Networks: A Surveycited by 374
  6. 2019Which Tasks Should Be Learned Together in Multi-task Learning?cited by 367
  7. 2018Characterizing and Avoiding Negative Transfercited by 226
  8. 2021Delving into Deep Imbalanced Regressioncited by 157
  9. 2020A Survey on Negative Transfercited by 120
  10. 2022Balanced MSE for Imbalanced Visual Regressioncited by 89
  11. 2022Auto-Lambda: Disentangling Dynamic Task Relationshipscited by 73
  12. 2015Massively Multitask Networks for Drug Discoverycited by 49
1 more
  1. 2024High Entropy Alloy property predictions using Transformer-based language modelcited by 2

Built on by

Not cited yet.