mlsanityData to 7 Oct 2026

Adaptive multi-gradient methods for quasiconvex vector optimization and applications to multi-task learning

arXiv 2402.06224 ↗First posted 9 Feb 2024math.OC cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

We present an adaptive step-size method, which does not include line-search techniques, for solving a wide class of nonconvex multiobjective programming problems on an unbounded constraint set. We also prove convergence of a general approach under modest assumptions. More specifically, the convexity criterion might not be satisfied by the objective function. Unlike descent line-search algorithms, it does not require an initial step-size to be determined by a previously determined Lipschitz constant. The process's primary characteristic is its gradual step-size reduction up until a predetermined condition is met. It can be specifically applied to offer an innovative multi-gradient projection method for unbounded constrained optimization issues. Preliminary findings from a few computational examples confirm the accuracy of the strategy. We apply the proposed technique to some multi-task learning experiments to show its efficacy for large-scale challenges.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 13 of its 41 references that are in the map. First posted on arXiv 9 Feb 2024.

Builds on

13 of 41 references.

References · 13

  1. 2021Convex optimizationcited by 2,479
  2. 2014Convolutional Neural Networks for Sentence Classificationcited by 1,124
  3. 2018Multi-Task Learning as Multi-Objective Optimizationcited by 809
  4. 2018Taskonomy: Disentangling Task Transfer Learningcited by 631
  5. 2019Pareto Multi-Task Learningcited by 224
  6. 2016UberNet: Training a `Universal' Convolutional Neural Network for Low-, Mid-, and High-Level Vision using Diverse Datasets and Limited Memorycited by 200
  7. 2015Multi-task Sequence to Sequence Learningcited by 94
  8. 2019Adaptive Gradient Descent without Descentcited by 79
  9. 2016A Joint Many-Task Model: Growing a Neural Network for Multiple NLP Taskscited by 62
  10. 2016Integrated perception with recurrent multi-task neural networkscited by 24
  11. 2019Convergence Rates of Subgradient Methods for Quasi-convex Optimization Problemscited by 6
  12. 2018Simplified Versions of the Conditional Gradient Methodcited by 2
1 more
  1. 2021On the Frank-Wolfe algorithm for non-compact constrained optimization problemscited by 2

Built on by

Not cited yet.