Sparsity of solutions for variational inverse problems with finite-dimensional data
Not on the map. Why?
Abstract (arXiv)
In this paper we characterize sparse solutions for variational problems of the form minu∈ X φ(u) + F(A u), where X is a locally convex space, A is a linear continuous operator that maps into a finite dimensional Hilbert space and φ is a seminorm. More precisely, we prove that there exists a minimizer that is `sparse' in the sense that it is represented as a linear combination of the extremal points of the unit ball associated with the regularizer φ (possibly translated by an element in the null space of φ). We apply this result to relevant regularizers such as the total variation seminorm and the Radon norm of a scalar linear differential operator. In the first example, we provide a theoretical justification of the so-called staircase effect and in the second one, we recover the result in [31] under weaker hypotheses.
Key facts. Cited by 25 papers in the map (data through 7 Oct 2026). First posted on arXiv 13 Sep 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 4; 2022: 4; 2023: 4; 2024: 8; 2025: 2; 2026: 3.
25 papers.
Sort:
By area:
- 2021What Kinds of Functions do Deep Neural Networks Learn? Insights from Variational Spline Theorycited by 60
- 2021Understanding neural networks with reproducing kernel Banach spacescited by 50
- 2021Two-layer neural networks with values in a Banach spacecited by 26
- 2022Ridges, Neural Networks, and the Radon Transformcited by 18
- 2023Variation Spaces for Multi-Output Neural Networks: Insights on Multi-Task Learning and Network Compressioncited by 17
- 2022Duality for Neural Networks through Reproducing Kernel Banach Spacescited by 15
- 2023Sparse Representer Theorems for Learning in Reproducing Kernel Banach Spacescited by 10
- 2022Stability of Image-Reconstruction Algorithmscited by 7
- 2023Weighted variation spaces and approximation by shallow ReLU networkscited by 7
- 2023Function-Space Optimality of Neural Architectures with Multivariate Nonlinearitiescited by 5
- 2022From Kernel Methods to Neural Networks: A Unifying Variational Formulationcited by 4
- 2024Hypothesis Spaces for Deep Learningcited by 4
13 more
- 2024Neural reproducing kernel Banach spaces and representer theorems for deep networkscited by 4
- 2025Solving Nonlinear PDEs with Sparse Radial Basis Function Networkscited by 3
- 2021Sparsest Univariate Learning Models Under Lipschitz Constraintcited by 2
- 2024Solving the inverse problem of microscopy deconvolution with a residual Beylkin-Coifman-Rokhlin neural networkcited by 2
- 2024Nonuniform random feature models using derivative informationcited by 2
- 2024A Lipschitz spaces view of infinitely wide shallow neural networkscited by 2
- 2024Representation and Regression Problems in Neural Networks: Relaxation, Generalization, and Numericscited by 2
- 2025Vector-Valued Reproducing Kernel Banach Spaces for Neural Networks and Operatorscited by 2
- 2024Towards a Sampling Theory for Implicit Neural Representationscited by 1
- 2026Manifold limit for the training of shallow graph convolutional neural networkscited by 1
- 2024Decomposition of one-layer neural networks via the infinite sum of reproducing kernel Banach spacescited by 0
- 2026A Dual Certificate Approach to Sparsity in Infinite-Width Shallow Neural Networkscited by 0
- 2026Physics-Modeled Neural Networkscited by 0
- 2026Physics-Modeled Neural Networks5 May 2026
- 2026A Dual Certificate Approach to Sparsity in Infinite-Width Shallow Neural Networks18 Mar 2026
- 2026Manifold limit for the training of shallow graph convolutional neural networks9 Jan 2026
- 2025Vector-Valued Reproducing Kernel Banach Spaces for Neural Networks and Operators30 Sep 2025
- 2025Solving Nonlinear PDEs with Sparse Radial Basis Function Networks12 May 2025
- 2024Representation and Regression Problems in Neural Networks: Relaxation, Generalization, and Numerics2 Dec 2024
- 2024A Lipschitz spaces view of infinitely wide shallow neural networks18 Oct 2024
- 2024Nonuniform random feature models using derivative information3 Oct 2024
- 2024Decomposition of one-layer neural networks via the infinite sum of reproducing kernel Banach spaces9 Aug 2024
- 2024Solving the inverse problem of microscopy deconvolution with a residual Beylkin-Coifman-Rokhlin neural network3 Jul 2024
- 2024Towards a Sampling Theory for Implicit Neural Representations28 May 2024
- 2024Neural reproducing kernel Banach spaces and representer theorems for deep networks13 Mar 2024
13 more
- 2024Hypothesis Spaces for Deep Learning5 Mar 2024
- 2023Function-Space Optimality of Neural Architectures with Multivariate Nonlinearities5 Oct 2023
- 2023Weighted variation spaces and approximation by shallow ReLU networks28 Jul 2023
- 2023Variation Spaces for Multi-Output Neural Networks: Insights on Multi-Task Learning and Network Compression25 May 2023
- 2023Sparse Representer Theorems for Learning in Reproducing Kernel Banach Spaces21 May 2023
- 2022Duality for Neural Networks through Reproducing Kernel Banach Spaces9 Nov 2022
- 2022From Kernel Methods to Neural Networks: A Unifying Variational Formulation29 Jun 2022
- 2022Stability of Image-Reconstruction Algorithms14 Jun 2022
- 2022Ridges, Neural Networks, and the Radon Transform4 Mar 2022
- 2021Sparsest Univariate Learning Models Under Lipschitz Constraint27 Dec 2021
- 2021Understanding neural networks with reproducing kernel Banach spaces20 Sep 2021
- 2021What Kinds of Functions do Deep Neural Networks Learn? Insights from Variational Spline Theory7 May 2021
- 2021Two-layer neural networks with values in a Banach space5 May 2021
- 2021What Kinds of Functions do Deep Neural Networks Learn? Insights from Variational Spline Theorycited by 60
- 2021Understanding neural networks with reproducing kernel Banach spacescited by 50
- 2021Two-layer neural networks with values in a Banach spacecited by 26
- 2022Ridges, Neural Networks, and the Radon Transformcited by 18
- 2023Variation Spaces for Multi-Output Neural Networks: Insights on Multi-Task Learning and Network Compressioncited by 17
- 2022Duality for Neural Networks through Reproducing Kernel Banach Spacescited by 15
- 2023Sparse Representer Theorems for Learning in Reproducing Kernel Banach Spacescited by 10
- 2022Stability of Image-Reconstruction Algorithmscited by 7
- 2023Weighted variation spaces and approximation by shallow ReLU networkscited by 7
- 2023Function-Space Optimality of Neural Architectures with Multivariate Nonlinearitiescited by 5
- 2022From Kernel Methods to Neural Networks: A Unifying Variational Formulationcited by 4
- 2024Hypothesis Spaces for Deep Learningcited by 4
12 most cited of 24 All 24 (JSON)
- 2026Physics-Modeled Neural Networks5 May 2026
- 2026A Dual Certificate Approach to Sparsity in Infinite-Width Shallow Neural Networks18 Mar 2026
- 2026Manifold limit for the training of shallow graph convolutional neural networks9 Jan 2026
- 2025Vector-Valued Reproducing Kernel Banach Spaces for Neural Networks and Operators30 Sep 2025
- 2025Solving Nonlinear PDEs with Sparse Radial Basis Function Networks12 May 2025
- 2024Representation and Regression Problems in Neural Networks: Relaxation, Generalization, and Numerics2 Dec 2024
- 2024A Lipschitz spaces view of infinitely wide shallow neural networks18 Oct 2024
- 2024Nonuniform random feature models using derivative information3 Oct 2024
- 2024Decomposition of one-layer neural networks via the infinite sum of reproducing kernel Banach spaces9 Aug 2024
- 2024Towards a Sampling Theory for Implicit Neural Representations28 May 2024
- 2024Neural reproducing kernel Banach spaces and representer theorems for deep networks13 Mar 2024
- 2024Hypothesis Spaces for Deep Learning5 Mar 2024
12 newest of 24 All 24 (JSON)