# Proximal Multitask Learning over Networks with Sparsity-inducing Coregularization

arXiv: https://arxiv.org/abs/1509.01360 · HTML: https://mlsanity.com/paper/1509.01360/

## Key facts

- Cited by 1 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 4 Sep 2015.

## Built on by (most cited first, 1 of 1)

- [A non-smooth regularization framework for learning over multitask graphs](https://mlsanity.com/paper/2509.17728/) (2025)

## Abstract (arXiv)

In this work, we consider multitask learning problems where clusters of nodes are interested in estimating their own parameter vector. Cooperation among clusters is beneficial when the optimal models of adjacent clusters have a good number of similar entries. We propose a fully distributed algorithm for solving this problem. The approach relies on minimizing a global mean-square error criterion regularized by non-differentiable terms to promote cooperation among neighboring clusters. A general diffusion forward-backward splitting strategy is introduced. Then, it is specialized to the case of sparsity promoting regularizers. A closed-form expression for the proximal operator of a weighted sum of ℓ1-norms is derived to achieve higher efficiency. We also provide conditions on the step-sizes that ensure convergence of the algorithm in the mean and mean-square error sense. Simulations are conducted to illustrate the effectiveness of the strategy.
