A survey of sparse representation: algorithms and applications
Not on the map. Why?
Abstract (arXiv)
Sparse representation has attracted much attention from researchers in fields of signal processing, image processing, computer vision and pattern recognition. Sparse representation also has a good reputation in both theoretical research and practical applications. Many different algorithms have been proposed for sparse representation. The main purpose of this article is to provide a comprehensive study and an updated review on sparse representation and to supply a guidance for researchers. The taxonomy of sparse representation methods can be studied from various viewpoints. For example, in terms of different norm minimizations used in sparsity constraints, the methods can be roughly categorized into five groups: sparse representation with l0-norm minimization, sparse representation with lp-norm (0<p<1) minimization, sparse representation with l1-norm minimization and sparse representation with l2,1-norm minimization. In this paper, a comprehensive overview of sparse representation is provided. The available sparse representation algorithms can also be empirically categorized into four groups: greedy strategy approximation, constrained optimization, proximity algorithm-based optimization, and homotopy algorithm-based sparse representation. The rationales of different algorithms in each category are analyzed and a wide range of sparse representation applications are summarized, which could sufficiently reveal the potential nature of the sparse representation theory. Specifically, an experimentally comparative study of these sparse representation algorithms was presented. The Matlab code used in this paper can be available at: http://www.yongxu.org/lunwen.html.
Key facts. Cited by 58 papers in the map (data through 7 Oct 2026). First posted on arXiv 23 Feb 2016.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 9; 2022: 9; 2023: 8; 2024: 14; 2025: 11; 2026: 7.
58 papers.
Sort:
By area:
- 2022Learning Vector-Quantized Item Representation for Transferable Sequential Recommenderscited by 112
- 2023ViTMatte: Boosting Image Matting with Pretrained Plain Vision Transformerscited by 56
- 2021Tensor Methods in Computer Vision and Deep Learningcited by 52
- 2025Beyond Matryoshka: Revisiting Sparse Coding for Adaptive Representationcited by 25
- 2022Robust Structured Declarative Classifiers for 3D Point Clouds: Defending Adversarial Attacks with Implicit Gradientscited by 17
- 2022Explainable AI via Learning to Optimizecited by 14
- 2025Mirror, Mirror of the Flow: How Does Regularization Shape Implicit Bias?cited by 10
- 2021Temporal Graph Signal Decompositioncited by 8
- 2022Optimization-Derived Learning with Essential Convergence Analysis of Training and Hyper-trainingcited by 5
- 2023Do Not Train It: A Linear Neural Architecture Search of Graph Neural Networkscited by 5
- 2024Sparse and Faithful Explanations Without Sparse Modelscited by 5
- 2024MaVEn: An Effective Multi-granularity Hybrid Visual Encoding Framework for Multimodal Large Language Modelcited by 5
38 more
- 2024Beyond Label Attention: Transparency in Language Models for Automated Medical Coding via Dictionary Learningcited by 5
- 2021CSC-Unet: A Novel Convolutional Sparse Coding Strategy Based Neural Network for Semantic Segmentationcited by 3
- 2021Sparse Coding with Multi-Layer Decoders using Variance Regularizationcited by 3
- 2022Adaptive Cross-Layer Attention for Image Restorationcited by 3
- 2023SRATTA : Sample Re-ATTribution Attack of Secure Aggregation in Federated Learningcited by 3
- 2023Interactive Generalized Additive Model and Its Applications in Electric Load Forecastingcited by 3
- 2024DILA: Dictionary Label Attention for Mechanistic Interpretability in High-dimensional Multi-label Medical Coding Predictioncited by 3
- 2024Learning of Patch-Based Smooth-Plus-Sparse Models for Image Reconstructioncited by 3
- 2024Sparse Reconstruction of Optical Doppler Tomography with Alternative State Space Model and Attentioncited by 2
- 2024WARP-LCA: Efficient Convolutional Sparse Coding with Locally Competitive Algorithmcited by 2
- 2025DB-KSVD: Scalable Alternating Optimization for Disentangling High-Dimensional Embedding Spacescited by 2
- 2025Visual Exploration of Feature Relationships in Sparse Autoencoders with Curated Conceptscited by 2
- 2021Salt and pepper noise removal method based on stationary Framelet transform with non-convex sparsity regularizationcited by 1
- 2021Discriminative Dictionary Learning based on Statistical Methodscited by 1
- 2023Multi-Dictionary Tensor Decompositioncited by 1
- 2024Sparsity via Sparse Group k-max Regularizationcited by 1
- 2024Low Rank Multi-Dictionary Selection at Scalecited by 1
- 2025Robust Foreground-Background Separation for Severely-Degraded Videos Using Convolutional Sparse Representation Modelingcited by 1
- 2025WEEP: A Differentiable Nonconvex Sparse Regularizer via Weakly-Convex Envelopecited by 1
- 2026Where Concept Erasure Should Occur: Concept-Layer Alignment in Text-to-Video Diffusion Modelscited by 1
- 2021Knowledge Distillation By Sparse Representation Matchingcited by 0
- 2021Signal Processing Challenges and Examples for it in-situ Transmission Electron Microscopycited by 0
- 2021Cascaded Compressed Sensing Networks: A Reversible Architecture for Layerwise Learningcited by 0
- 20222D+3D facial expression recognition via embedded tensor manifold regularizationcited by 0
- 2022Multi-scale Sparse Representation-Based Shadow Inpainting for Retinal OCT Imagescited by 0
- 2022Cautious Learning of Multiattribute Preferencescited by 0
- 2022An adaptive shortest-solution guided decimation approach to sparse high-dimensional linear regressioncited by 0
- 20233D wind field profiles from hyperspectral sounders: revisiting optic-flow from a meteorological perspectivecited by 0
- 2023Harnessing Scalable Transactional Stream Processing for Managing Large Language Models [Vision]cited by 0
- 2023Robust Ordinal Regression for Subsets Comparisons with Interactionscited by 0
- 2024Automatic dimensionality reduction of Twin-in-the-Loop Observerscited by 0
- 2024In-Flight Estimation of Instrument Spectral Response Functions Using Sparse Representationscited by 0
- 2024Semi-adaptive Synergetic Two-way Pseudoinverse Learning Systemcited by 0
- 2024Dy-mer: An Explainable DNA Sequence Representation Scheme using Dictionary Learningcited by 0
- 2024Pareto Data Framework: Steps Towards Resource-Efficient Decision Making Using Minimum Viable Data (MVD)cited by 0
- 2025Kernel Recursive Least Squares Dictionary Learning Algorithmcited by 0
- 2025Robust Multi-Manifold Clustering via Simplex Pathscited by 0
- 2025Multi-Dictionary Learning for Low Rank Sparse Codingcited by 0
50 most cited of 58 All 58 (JSON)
- 2026Source-Prior-Driven Selective Adaptation for Efficient Diffusion Model Finetuning23 Jul 2026
- 2026Where Concept Erasure Should Occur: Concept-Layer Alignment in Text-to-Video Diffusion Models25 May 2026
- 2026Theoretical Analysis of Sparse Optimization with Reparameterization, Weight Decay, and Adaptive Learning Rate24 May 2026
- 2026PerFlow: Physics-Embedded Rectified Flow for Efficient Reconstruction and Uncertainty Quantification of Spatiotemporal Dynamics5 May 2026
- 2026Nonconvex Latent Optimally Partitioned Block-Sparse Recovery via Log-Sum and Minimax Concave Penalties1 Mar 2026
- 2026A Cosine Network for Image Super-Resolution23 Jan 2026
- 2026ASBA: A-line State Space Model and B-line Attention for Sparse Optical Doppler Tomography Reconstruction20 Jan 2026
- 2025SparsePixels: Efficient Convolution for Sparse Data on FPGAs5 Dec 2025
- 2025Visual Exploration of Feature Relationships in Sparse Autoencoders with Curated Concepts8 Nov 2025
- 2025Deformable Medical Image Registration with KAN-based Implicit Neural Representations26 Sep 2025
- 2025Multi-Dictionary Learning for Low Rank Sparse Coding12 Sep 2025
- 2025WEEP: A Differentiable Nonconvex Sparse Regularizer via Weakly-Convex Envelope28 Jul 2025
38 more
- 2025Robust Multi-Manifold Clustering via Simplex Paths14 Jul 2025
- 2025Kernel Recursive Least Squares Dictionary Learning Algorithm2 Jul 2025
- 2025Robust Foreground-Background Separation for Severely-Degraded Videos Using Convolutional Sparse Representation Modeling21 Jun 2025
- 2025DB-KSVD: Scalable Alternating Optimization for Disentangling High-Dimensional Embedding Spaces24 May 2025
- 2025Mirror, Mirror of the Flow: How Does Regularization Shape Implicit Bias?17 Apr 2025
- 2025Beyond Matryoshka: Revisiting Sparse Coding for Adaptive Representation3 Mar 2025
- 2024Learning of Patch-Based Smooth-Plus-Sparse Models for Image Reconstruction17 Dec 2024
- 2024Beyond Label Attention: Transparency in Language Models for Automated Medical Coding via Dictionary Learning31 Oct 2024
- 2024WARP-LCA: Efficient Convolutional Sparse Coding with Locally Competitive Algorithm24 Oct 2024
- 2024Pareto Data Framework: Steps Towards Resource-Efficient Decision Making Using Minimum Viable Data (MVD)18 Sep 2024
- 2024DILA: Dictionary Label Attention for Mechanistic Interpretability in High-dimensional Multi-label Medical Coding Prediction16 Sep 2024
- 2024MaVEn: An Effective Multi-granularity Hybrid Visual Encoding Framework for Multimodal Large Language Model22 Aug 2024
- 2024Dy-mer: An Explainable DNA Sequence Representation Scheme using Dictionary Learning6 Jul 2024
- 2024Semi-adaptive Synergetic Two-way Pseudoinverse Learning System27 Jun 2024
- 2024Low Rank Multi-Dictionary Selection at Scale11 Jun 2024
- 2024Sparse Reconstruction of Optical Doppler Tomography with Alternative State Space Model and Attention26 Apr 2024
- 2024In-Flight Estimation of Instrument Spectral Response Functions Using Sparse Representations8 Apr 2024
- 2024Sparse and Faithful Explanations Without Sparse Models15 Feb 2024
- 2024Sparsity via Sparse Group k-max Regularization13 Feb 2024
- 2024Automatic dimensionality reduction of Twin-in-the-Loop Observers18 Jan 2024
- 2023Interactive Generalized Additive Model and Its Applications in Electric Load Forecasting24 Oct 2023
- 2023Multi-Dictionary Tensor Decomposition18 Sep 2023
- 2023Robust Ordinal Regression for Subsets Comparisons with Interactions7 Aug 2023
- 2023Harnessing Scalable Transactional Stream Processing for Managing Large Language Models [Vision]17 Jul 2023
- 2023SRATTA : Sample Re-ATTribution Attack of Secure Aggregation in Federated Learning13 Jun 2023
- 2023ViTMatte: Boosting Image Matting with Pretrained Plain Vision Transformers24 May 2023
- 2023Do Not Train It: A Linear Neural Architecture Search of Graph Neural Networks23 May 2023
- 20233D wind field profiles from hyperspectral sounders: revisiting optic-flow from a meteorological perspective9 Mar 2023
- 2022An adaptive shortest-solution guided decimation approach to sparse high-dimensional linear regression28 Nov 2022
- 2022Learning Vector-Quantized Item Representation for Transferable Sequential Recommenders22 Oct 2022
- 2022Optimization-Derived Learning with Essential Convergence Analysis of Training and Hyper-training16 Jun 2022
- 2022Cautious Learning of Multiattribute Preferences15 Jun 2022
- 2022Explainable AI via Learning to Optimize29 Apr 2022
- 2022Robust Structured Declarative Classifiers for 3D Point Clouds: Defending Adversarial Attacks with Implicit Gradients29 Mar 2022
- 2022Adaptive Cross-Layer Attention for Image Restoration4 Mar 2022
- 2022Multi-scale Sparse Representation-Based Shadow Inpainting for Retinal OCT Images23 Feb 2022
- 20222D+3D facial expression recognition via embedded tensor manifold regularization29 Jan 2022
- 2021Sparse Coding with Multi-Layer Decoders using Variance Regularization16 Dec 2021
50 newest of 58 All 58 (JSON)
- 2026Where Concept Erasure Should Occur: Concept-Layer Alignment in Text-to-Video Diffusion Modelscited by 1
- 2026PerFlow: Physics-Embedded Rectified Flow for Efficient Reconstruction and Uncertainty Quantification of Spatiotemporal Dynamicscited by 0
- 2026Source-Prior-Driven Selective Adaptation for Efficient Diffusion Model Finetuningcited by 0
- 2026Source-Prior-Driven Selective Adaptation for Efficient Diffusion Model Finetuning23 Jul 2026
- 2026Where Concept Erasure Should Occur: Concept-Layer Alignment in Text-to-Video Diffusion Models25 May 2026
- 2026PerFlow: Physics-Embedded Rectified Flow for Efficient Reconstruction and Uncertainty Quantification of Spatiotemporal Dynamics5 May 2026
- 2022Learning Vector-Quantized Item Representation for Transferable Sequential Recommenderscited by 112
- 2023ViTMatte: Boosting Image Matting with Pretrained Plain Vision Transformerscited by 56
- 2021Tensor Methods in Computer Vision and Deep Learningcited by 52
- 2025Beyond Matryoshka: Revisiting Sparse Coding for Adaptive Representationcited by 25
- 2022Robust Structured Declarative Classifiers for 3D Point Clouds: Defending Adversarial Attacks with Implicit Gradientscited by 17
- 2022Explainable AI via Learning to Optimizecited by 14
- 2025Mirror, Mirror of the Flow: How Does Regularization Shape Implicit Bias?cited by 10
- 2021Temporal Graph Signal Decompositioncited by 8
- 2022Optimization-Derived Learning with Essential Convergence Analysis of Training and Hyper-trainingcited by 5
- 2023Do Not Train It: A Linear Neural Architecture Search of Graph Neural Networkscited by 5
- 2024Sparse and Faithful Explanations Without Sparse Modelscited by 5
- 2024Beyond Label Attention: Transparency in Language Models for Automated Medical Coding via Dictionary Learningcited by 5
12 most cited of 54 All 54 (JSON)
- 2026Theoretical Analysis of Sparse Optimization with Reparameterization, Weight Decay, and Adaptive Learning Rate24 May 2026
- 2026Nonconvex Latent Optimally Partitioned Block-Sparse Recovery via Log-Sum and Minimax Concave Penalties1 Mar 2026
- 2026A Cosine Network for Image Super-Resolution23 Jan 2026
- 2026ASBA: A-line State Space Model and B-line Attention for Sparse Optical Doppler Tomography Reconstruction20 Jan 2026
- 2025SparsePixels: Efficient Convolution for Sparse Data on FPGAs5 Dec 2025
- 2025Visual Exploration of Feature Relationships in Sparse Autoencoders with Curated Concepts8 Nov 2025
- 2025Deformable Medical Image Registration with KAN-based Implicit Neural Representations26 Sep 2025
- 2025Multi-Dictionary Learning for Low Rank Sparse Coding12 Sep 2025
- 2025WEEP: A Differentiable Nonconvex Sparse Regularizer via Weakly-Convex Envelope28 Jul 2025
- 2025Robust Multi-Manifold Clustering via Simplex Paths14 Jul 2025
- 2025Kernel Recursive Least Squares Dictionary Learning Algorithm2 Jul 2025
- 2025Robust Foreground-Background Separation for Severely-Degraded Videos Using Convolutional Sparse Representation Modeling21 Jun 2025
12 newest of 54 All 54 (JSON)