Adaptive multi-gradient methods for quasiconvex vector optimization and applications to multi-task learning
Not on the map. Why?
Abstract (arXiv)
We present an adaptive step-size method, which does not include line-search techniques, for solving a wide class of nonconvex multiobjective programming problems on an unbounded constraint set. We also prove convergence of a general approach under modest assumptions. More specifically, the convexity criterion might not be satisfied by the objective function. Unlike descent line-search algorithms, it does not require an initial step-size to be determined by a previously determined Lipschitz constant. The process's primary characteristic is its gradual step-size reduction up until a predetermined condition is met. It can be specifically applied to offer an innovative multi-gradient projection method for unbounded constrained optimization issues. Preliminary findings from a few computational examples confirm the accuracy of the strategy. We apply the proposed technique to some multi-task learning experiments to show its efficacy for large-scale challenges.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 13 of its 41 references that are in the map. First posted on arXiv 9 Feb 2024.
Builds on
13 of 41 references.
References · 13
- 2021Convex optimizationcited by 2,479
- 2014Convolutional Neural Networks for Sentence Classificationcited by 1,124
- 2018Multi-Task Learning as Multi-Objective Optimizationcited by 809
- 2018Taskonomy: Disentangling Task Transfer Learningcited by 631
- 2019Pareto Multi-Task Learningcited by 224
- 2016UberNet: Training a `Universal' Convolutional Neural Network for Low-, Mid-, and High-Level Vision using Diverse Datasets and Limited Memorycited by 200
- 2015Multi-task Sequence to Sequence Learningcited by 94
- 2019Adaptive Gradient Descent without Descentcited by 79
- 2016A Joint Many-Task Model: Growing a Neural Network for Multiple NLP Taskscited by 62
- 2016Integrated perception with recurrent multi-task neural networkscited by 24
- 2019Convergence Rates of Subgradient Methods for Quasi-convex Optimization Problemscited by 6
- 2018Simplified Versions of the Conditional Gradient Methodcited by 2
1 more
Built on by
Not cited yet.