Sparse Modeling for Image and Vision Processing
Not on the map. Why?
Abstract (arXiv)
In recent years, a large amount of multi-disciplinary research has been conducted on sparse models and their applications. In statistics and machine learning, the sparsity principle is used to perform model selection---that is, automatically selecting a simple model among a large collection of them. In signal processing, sparse coding consists of representing data with linear combinations of a few dictionary elements. Subsequently, the corresponding tools have been widely adopted by several scientific communities such as neuroscience, bioinformatics, or computer vision. The goal of this monograph is to offer a self-contained view of sparse modeling for visual recognition and image processing. More specifically, we focus on applications where the dictionary is learned and adapted to data, yielding a compact representation that has been successful in various contexts.
Key facts. Cited by 48 papers in the map (data through 7 Oct 2026). First posted on arXiv 12 Nov 2014.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 8; 2022: 7; 2023: 10; 2024: 8; 2025: 7; 2026: 8.
48 papers.
Sort:
By area:
- 2024Scaling and evaluating sparse autoencoderscited by 530
- 2022The Lazy Neuron Phenomenon: On Emergence of Activation Sparsity in Transformerscited by 121
- 2021Toward Understanding the Feature Learning Process of Self-supervised Contrastive Learningcited by 119
- 2023A Holistic Approach to Unifying Automatic Concept Extraction and Concept Importance Estimationcited by 108
- 2025Archetypal SAE: Adaptive and Stable Dictionary Learning for Concept Extraction in Large Vision Modelscited by 67
- 2025Universal Sparse Autoencoders: Interpretable Cross-Model Concept Alignmentcited by 62
- 2021A Survey on Ensemble Learning under the Era of Deep Learningcited by 47
- 2021A Trainable Spectral-Spatial Sparse Coding Model for Hyperspectral Image Restorationcited by 34
- 2025Interpreting the linear structure of vision-language model embedding spacescited by 32
- 2023Which Features are Learnt by Contrastive Learning? On the Role of Simplicity Bias in Class Collapse and Feature Suppressioncited by 30
- 2024Decoding Dark Matter: Specialized Sparse Autoencoders for Interpreting Rare Concepts in Foundation Modelscited by 15
- 2022Revisiting Sparse Convolutional Model for Visual Recognitioncited by 13
36 more
- 2022Entropic Descent Archetypal Analysis for Blind Hyperspectral Unmixingcited by 11
- 2023Learning Sparse and Low-Rank Priors for Image Recovery via Iterative Reweighted Least Squares Minimizationcited by 10
- 2024Arbitrary-Scale Video Super-Resolution with Structural and Textural Priorscited by 9
- 2024Adaptive Sparse Allocation with Mutual Choice & Feature Choice Sparse Autoencoderscited by 9
- 2025Representations Shape Weak-to-Strong Generalization: Theoretical Insights and Empirical Predictionscited by 9
- 2026Cross-Modal Redundancy and the Geometry of Vision-Language Embeddingscited by 9
- 2022Can Querying for Bias Leak Protected Attributes? Achieving Privacy With Smooth Sensitivitycited by 8
- 2022Cross-Modality Neuroimage Synthesis: A Surveycited by 6
- 2022Optimal Regularization for a Data Sourcecited by 6
- 2022Reverse Engineering ℓp attacks: A block-sparse optimization approach with recovery guaranteescited by 4
- 2023Closed-Loop Transcription via Convolutional Sparse Codingcited by 4
- 2021Sparse Coding with Multi-Layer Decoders using Variance Regularizationcited by 3
- 2024The Star Geometry of Critic-Based Regularizer Learningcited by 3
- 2026Structuring Sparsity: Block-Sparse Featurizers Capture Visual Concept Manifoldscited by 3
- 2025Interpretable 3D Neural Object Volumes for Robust Conceptual Reasoningcited by 2
- 2023Recovering Simultaneously Structured Data via Non-Convex Iteratively Reweighted Least Squarescited by 1
- 2023Sparse Models for Machine Learningcited by 1
- 2023Fixing the NTK: From Neural Network Linearizations to Exact Convex Programscited by 1
- 2025Evaluating Sparse Autoencoders: From Shallow Design to Matching Pursuitcited by 1
- 2026SCoCCA: Multi-modal Sparse Concept Decomposition via Canonical Correlation Analysiscited by 1
- 2021Metalearning: Sparse Variable-Structure Automatacited by 0
- 2021Improved Image Generation via Sparse Modelingcited by 0
- 2021Screening for a Reweighted Penalized Conditional Gradient Methodcited by 0
- 2021Cascaded Compressed Sensing Networks: A Reversible Architecture for Layerwise Learningcited by 0
- 2023Structured Learning in Time-dependent Cox Modelscited by 0
- 2023Semi-sparsity Priors for Image Structure Analysis and Extractioncited by 0
- 2023Learning Sparse Codes with Entropy-Based ELBOscited by 0
- 2024Seismic Traveltime Tomography with Label-free Learningcited by 0
- 2024IB-AdCSCNet:Adaptive Convolutional Sparse Coding Network Driven by Information Bottleneckcited by 0
- 2024Few-Shot Airway-Tree Modeling using Data-Driven Sparse Priorscited by 0
- 2025BasicAVSR: Arbitrary-Scale Video Super-Resolution via Image Priors and Enhanced Motion Compensationcited by 0
- 2026Supervised sparse auto-encoders for interpretable and compositional representationscited by 0
- 2026Extending Occam's inversion with lasso fusion, overcomplete dictionaries, and isotropic total variation regularisationcited by 0
- 2026From Interpretability Methods to Interpretable Modelscited by 0
- 2026MARCEDES: Score-based causal discovery under non-Gaussianity with continuous optimizationcited by 0
- 2026Interference Beyond Geometry in Concept Extractioncited by 0
- 2026Interference Beyond Geometry in Concept Extraction28 Sep 2026
- 2026MARCEDES: Score-based causal discovery under non-Gaussianity with continuous optimization25 Sep 2026
- 2026From Interpretability Methods to Interpretable Models4 Sep 2026
- 2026Extending Occam's inversion with lasso fusion, overcomplete dictionaries, and isotropic total variation regularisation14 Aug 2026
- 2026Structuring Sparsity: Block-Sparse Featurizers Capture Visual Concept Manifolds23 Jun 2026
- 2026SCoCCA: Multi-modal Sparse Concept Decomposition via Canonical Correlation Analysis14 Mar 2026
- 2026Cross-Modal Redundancy and the Geometry of Vision-Language Embeddings5 Feb 2026
- 2026Supervised sparse auto-encoders for interpretable and compositional representations31 Jan 2026
- 2025BasicAVSR: Arbitrary-Scale Video Super-Resolution via Image Priors and Enhanced Motion Compensation30 Oct 2025
- 2025Evaluating Sparse Autoencoders: From Shallow Design to Matching Pursuit5 Jun 2025
- 2025Interpreting the linear structure of vision-language model embedding spaces16 Apr 2025
- 2025Interpretable 3D Neural Object Volumes for Robust Conceptual Reasoning17 Mar 2025
36 more
- 2025Archetypal SAE: Adaptive and Stable Dictionary Learning for Concept Extraction in Large Vision Models18 Feb 2025
- 2025Universal Sparse Autoencoders: Interpretable Cross-Model Concept Alignment6 Feb 2025
- 2025Representations Shape Weak-to-Strong Generalization: Theoretical Insights and Empirical Predictions2 Feb 2025
- 2024Adaptive Sparse Allocation with Mutual Choice & Feature Choice Sparse Autoencoders4 Nov 2024
- 2024Decoding Dark Matter: Specialized Sparse Autoencoders for Interpreting Rare Concepts in Foundation Models1 Nov 2024
- 2024The Star Geometry of Critic-Based Regularizer Learning29 Aug 2024
- 2024Arbitrary-Scale Video Super-Resolution with Structural and Textural Priors13 Jul 2024
- 2024Few-Shot Airway-Tree Modeling using Data-Driven Sparse Priors5 Jul 2024
- 2024Scaling and evaluating sparse autoencoders6 Jun 2024
- 2024IB-AdCSCNet:Adaptive Convolutional Sparse Coding Network Driven by Information Bottleneck23 May 2024
- 2024Seismic Traveltime Tomography with Label-free Learning1 Feb 2024
- 2023Learning Sparse Codes with Entropy-Based ELBOs3 Nov 2023
- 2023Fixing the NTK: From Neural Network Linearizations to Exact Convex Programs26 Sep 2023
- 2023Sparse Models for Machine Learning26 Aug 2023
- 2023Semi-sparsity Priors for Image Structure Analysis and Extraction17 Aug 2023
- 2023Structured Learning in Time-dependent Cox Models21 Jun 2023
- 2023A Holistic Approach to Unifying Automatic Concept Extraction and Concept Importance Estimation11 Jun 2023
- 2023Recovering Simultaneously Structured Data via Non-Convex Iteratively Reweighted Least Squares8 Jun 2023
- 2023Which Features are Learnt by Contrastive Learning? On the Role of Simplicity Bias in Class Collapse and Feature Suppression25 May 2023
- 2023Learning Sparse and Low-Rank Priors for Image Recovery via Iterative Reweighted Least Squares Minimization20 Apr 2023
- 2023Closed-Loop Transcription via Convolutional Sparse Coding18 Feb 2023
- 2022Optimal Regularization for a Data Source27 Dec 2022
- 2022Can Querying for Bias Leak Protected Attributes? Achieving Privacy With Smooth Sensitivity3 Nov 2022
- 2022Revisiting Sparse Convolutional Model for Visual Recognition24 Oct 2022
- 2022The Lazy Neuron Phenomenon: On Emergence of Activation Sparsity in Transformers12 Oct 2022
- 2022Entropic Descent Archetypal Analysis for Blind Hyperspectral Unmixing22 Sep 2022
- 2022Reverse Engineering ℓp attacks: A block-sparse optimization approach with recovery guarantees9 Mar 2022
- 2022Cross-Modality Neuroimage Synthesis: A Survey14 Feb 2022
- 2021Sparse Coding with Multi-Layer Decoders using Variance Regularization16 Dec 2021
- 2021A Trainable Spectral-Spatial Sparse Coding Model for Hyperspectral Image Restoration18 Nov 2021
- 2021Cascaded Compressed Sensing Networks: A Reversible Architecture for Layerwise Learning20 Oct 2021
- 2021Screening for a Reweighted Penalized Conditional Gradient Method2 Jul 2021
- 2021Toward Understanding the Feature Learning Process of Self-supervised Contrastive Learning31 May 2021
- 2021Improved Image Generation via Sparse Modeling1 Apr 2021
- 2021Metalearning: Sparse Variable-Structure Automata30 Jan 2021
- 2021A Survey on Ensemble Learning under the Era of Deep Learning21 Jan 2021
- 2024Scaling and evaluating sparse autoencoderscited by 530
- 2022The Lazy Neuron Phenomenon: On Emergence of Activation Sparsity in Transformerscited by 121
- 2021Toward Understanding the Feature Learning Process of Self-supervised Contrastive Learningcited by 119
- 2023A Holistic Approach to Unifying Automatic Concept Extraction and Concept Importance Estimationcited by 108
- 2025Archetypal SAE: Adaptive and Stable Dictionary Learning for Concept Extraction in Large Vision Modelscited by 67
- 2025Universal Sparse Autoencoders: Interpretable Cross-Model Concept Alignmentcited by 62
- 2021A Survey on Ensemble Learning under the Era of Deep Learningcited by 47
- 2021A Trainable Spectral-Spatial Sparse Coding Model for Hyperspectral Image Restorationcited by 34
- 2023Which Features are Learnt by Contrastive Learning? On the Role of Simplicity Bias in Class Collapse and Feature Suppressioncited by 30
- 2024Decoding Dark Matter: Specialized Sparse Autoencoders for Interpreting Rare Concepts in Foundation Modelscited by 15
- 2022Revisiting Sparse Convolutional Model for Visual Recognitioncited by 13
- 2022Entropic Descent Archetypal Analysis for Blind Hyperspectral Unmixingcited by 11
12 most cited of 45 All 45 (JSON)
- 2026Interference Beyond Geometry in Concept Extraction28 Sep 2026
- 2026MARCEDES: Score-based causal discovery under non-Gaussianity with continuous optimization25 Sep 2026
- 2026From Interpretability Methods to Interpretable Models4 Sep 2026
- 2026Extending Occam's inversion with lasso fusion, overcomplete dictionaries, and isotropic total variation regularisation14 Aug 2026
- 2026Structuring Sparsity: Block-Sparse Featurizers Capture Visual Concept Manifolds23 Jun 2026
- 2026Supervised sparse auto-encoders for interpretable and compositional representations31 Jan 2026
- 2025BasicAVSR: Arbitrary-Scale Video Super-Resolution via Image Priors and Enhanced Motion Compensation30 Oct 2025
- 2025Evaluating Sparse Autoencoders: From Shallow Design to Matching Pursuit5 Jun 2025
- 2025Interpretable 3D Neural Object Volumes for Robust Conceptual Reasoning17 Mar 2025
- 2025Archetypal SAE: Adaptive and Stable Dictionary Learning for Concept Extraction in Large Vision Models18 Feb 2025
- 2025Universal Sparse Autoencoders: Interpretable Cross-Model Concept Alignment6 Feb 2025
- 2025Representations Shape Weak-to-Strong Generalization: Theoretical Insights and Empirical Predictions2 Feb 2025
12 newest of 45 All 45 (JSON)