mlsanityData to 14 Oct 2026

Simultaneous off-the-grid learning of mixtures issued from a continuous dictionary

arXiv 2210.16311 ↗First posted 27 Oct 2022stat.ML cs.LG math.PRcited by 0

Not on the map. Why?

Abstract (arXiv)

In this paper we observe a set, possibly a continuum, of signals corrupted by noise. Each signal is a finite mixture of an unknown number of features belonging to a continuous dictionary. The continuous dictionary is parametrized by a real non-linear parameter. We shall assume that the signals share an underlying structure by assuming that each signal has its active features included in a finite and sparse set. We formulate regularized optimization problem to estimate simultaneously the linear coefficients in the mixtures and the non-linear parameters of the features. The optimization problem is composed of a data fidelity term and a (ℓ1,Lp)-penalty. We call its solution the Group-Nonlinear-Lasso and provide high probability bounds on the prediction error using certificate functions. Following recent works on the geometry of off-the-grid methods, we show that such functions can be constructed provided the parameters of the active features are pairwise separated by a constant with respect to a Riemannian metric.When the number of signals is finite and the noise is assumed Gaussian, we give refinements of our results for p=1 and p=2 using tail bounds on suprema of Gaussian and chi2 random processes. When p=2, our prediction error reaches the rates obtained by the Group-Lasso estimator in the multi-task linear regression model. Furthermore, for p=2 these prediction rates are faster than for p=1 when all signals share most of the non-linear parameters.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 9 of its 45 references that are in the map. First posted on arXiv 27 Oct 2022.

Builds on

9 of 45 references.

References · 9

  1. 2019Sparse Optimization on Measures with Over-parameterized Gradient Descentcited by 50
  2. 2018On Representer Theorems and Convex Regularizationcited by 24
  3. 2013Exact Support Recovery for Sparse Spikes Deconvolutioncited by 22
  4. 2018The Sliding Frank-Wolfe Algorithm and its Application to Super-Resolution Microscopycited by 16
  5. 2015The Alternating Descent Conditional Gradient Method for Sparse Inverse Problemscited by 11
  6. 2016Adapting to unknown noise level in sparse deconvolutioncited by 4
  7. 2020An off-the-grid approach to multi-compartment magnetic resonance fingerprintingcited by 2
  8. 2022Off-the-grid learning of mixtures from a continuous dictionarycited by 2
  9. 2019An Epigraphical Approach to the Representer Theoremcited by 1

Built on by

Not cited yet.