An Overview on Data Representation Learning: From Traditional Feature Learning to Recent Deep Learning
Not on the map. Why?
Abstract (arXiv)
Since about 100 years ago, to learn the intrinsic structure of data, many representation learning approaches have been proposed, including both linear ones and nonlinear ones, supervised ones and unsupervised ones. Particularly, deep architectures are widely applied for representation learning in recent years, and have delivered top results in many tasks, such as image classification, object detection and speech recognition. In this paper, we review the development of data representation learning methods. Specifically, we investigate both traditional feature learning algorithms and state-of-the-art deep learning models. The history of data representation learning is introduced, while available resources (e.g. online course, tutorial and book information) and toolboxes are provided. Finally, we conclude this paper with remarks and some interesting research directions on data representation learning.
Key facts. Cited by 29 papers in the map (data through 7 Oct 2026). First posted on arXiv 25 Nov 2016.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 5; 2022: 7; 2023: 1; 2024: 6; 2025: 8; 2026: 2.
29 papers.
Sort:
By area:
- 2024Dynamic and Adaptive Feature Generation with LLMcited by 27
- 2022Controllable Data Generation by Deep Learning: A Reviewcited by 20
- 2024A Survey on Statistical Theory of Deep Learning: Approximation, Training Dynamics, and Generative Modelscited by 20
- 2023Remote patient monitoring using artificial intelligence: Current state, applications, and challengescited by 14
- 2021Applications of Deep Learning Techniques for Automated Multiple Sclerosis Detection Using Magnetic Resonance Imaging: A Reviewcited by 10
- 2022A Penalty Approach for Normalizing Feature Distributions to Build Confounder-Free Modelscited by 8
- 2025Block-Biased Mamba for Long-Range Sequence Processingcited by 7
- 2022Empirical Evaluation and Theoretical Analysis for Representation Learning: A Surveycited by 5
- 2021Unsupervised Learning Architecture for Classifying the Transient Noise of Interferometric Gravitational-wave Detectorscited by 4
- 2024Machine Learning Analysis of Anomalous Diffusioncited by 3
- 2026Multi-Modal Data-Enhanced Foundation Models for Prediction and Control in Wireless Networks: A Surveycited by 3
- 2021Do Neural Network Weights account for Classes Centers?cited by 2
17 more
- 2024MLP-KAN: Unifying Deep Representation and Function Learningcited by 2
- 2025FELA: A Multi-Agent Evolutionary System for Feature Engineering of Industrial Event Log Datacited by 2
- 2021ODMTCNet: An Interpretable Multi-view Deep Neural Network Architecture for Image Feature Representationcited by 1
- 2022Training Process of Unsupervised Learning Architecture for Gravity Spy Datasetcited by 1
- 2022Learning an Ensemble of Deep Fingerprint Representationscited by 1
- 2025Interpretable Transformation and Analysis of Timelines through Learning via Surprisabilitycited by 1
- 2021A Novel Data Pre-processing Technique: Making Data Mining Robust to Different Units and Scales of Measurementcited by 0
- 2022Scientific Impact of Graph-Based Approaches in Deep Learning Studies -- A Bibliometric Comparisoncited by 0
- 2022Realization of Causal Representation Learning to Adjust Confounding Bias in Latent Spacecited by 0
- 2024TemporalPaD: a reinforcement-learning framework for temporal feature representation and dimension reductioncited by 0
- 2024Disentangling Genotype and Environment Specific Latent Features for Improved Trait Prediction using a Compositional Autoencodercited by 0
- 2025An Optimization Algorithm for Multimodal Data Alignmentcited by 0
- 2025Artificial Intelligence and Deep Learning Algorithms for Epigenetic Sequence Analysis: A Review for Epigeneticists and AI Expertscited by 0
- 2025Innovative tokenisation of structured data for LLM trainingcited by 0
- 2025Learning Representations of Satellite Images with Evaluations on Synoptic Weather Eventscited by 0
- 2025A Physics Prior-Guided Dual-Stream Attention Network for Motion Prediction of Elastic Bragg Breakwaterscited by 0
- 2026Computational Methods and Challenges in Cell-Free DNA Analysis for Multi-Cancer Early Detectioncited by 0
- 2026Computational Methods and Challenges in Cell-Free DNA Analysis for Multi-Cancer Early Detection18 Jun 2026
- 2026Multi-Modal Data-Enhanced Foundation Models for Prediction and Control in Wireless Networks: A Survey6 Jan 2026
- 2025FELA: A Multi-Agent Evolutionary System for Feature Engineering of Industrial Event Log Data29 Oct 2025
- 2025A Physics Prior-Guided Dual-Stream Attention Network for Motion Prediction of Elastic Bragg Breakwaters16 Oct 2025
- 2025Learning Representations of Satellite Images with Evaluations on Synoptic Weather Events8 Aug 2025
- 2025Innovative tokenisation of structured data for LLM training3 Aug 2025
- 2025Block-Biased Mamba for Long-Range Sequence Processing13 May 2025
- 2025Artificial Intelligence and Deep Learning Algorithms for Epigenetic Sequence Analysis: A Review for Epigeneticists and AI Experts1 Apr 2025
- 2025Interpretable Transformation and Analysis of Timelines through Learning via Surprisability6 Mar 2025
- 2025An Optimization Algorithm for Multimodal Data Alignment5 Mar 2025
- 2024Machine Learning Analysis of Anomalous Diffusion2 Dec 2024
- 2024Disentangling Genotype and Environment Specific Latent Features for Improved Trait Prediction using a Compositional Autoencoder25 Oct 2024
17 more
- 2024MLP-KAN: Unifying Deep Representation and Function Learning3 Oct 2024
- 2024TemporalPaD: a reinforcement-learning framework for temporal feature representation and dimension reduction27 Sep 2024
- 2024Dynamic and Adaptive Feature Generation with LLM4 Jun 2024
- 2024A Survey on Statistical Theory of Deep Learning: Approximation, Training Dynamics, and Generative Models14 Jan 2024
- 2023Remote patient monitoring using artificial intelligence: Current state, applications, and challenges19 Jan 2023
- 2022Realization of Causal Representation Learning to Adjust Confounding Bias in Latent Space15 Nov 2022
- 2022Scientific Impact of Graph-Based Approaches in Deep Learning Studies -- A Bibliometric Comparison13 Oct 2022
- 2022Learning an Ensemble of Deep Fingerprint Representations2 Sep 2022
- 2022Training Process of Unsupervised Learning Architecture for Gravity Spy Dataset7 Aug 2022
- 2022Controllable Data Generation by Deep Learning: A Review19 Jul 2022
- 2022A Penalty Approach for Normalizing Feature Distributions to Build Confounder-Free Models11 Jul 2022
- 2022Empirical Evaluation and Theoretical Analysis for Representation Learning: A Survey18 Apr 2022
- 2021Unsupervised Learning Architecture for Classifying the Transient Noise of Interferometric Gravitational-wave Detectors19 Nov 2021
- 2021A Novel Data Pre-processing Technique: Making Data Mining Robust to Different Units and Scales of Measurement8 Nov 2021
- 2021ODMTCNet: An Interpretable Multi-view Deep Neural Network Architecture for Image Feature Representation28 Oct 2021
- 2021Applications of Deep Learning Techniques for Automated Multiple Sclerosis Detection Using Magnetic Resonance Imaging: A Review11 May 2021
- 2021Do Neural Network Weights account for Classes Centers?14 Apr 2021
- 2025Block-Biased Mamba for Long-Range Sequence Processingcited by 7
- 2025Block-Biased Mamba for Long-Range Sequence Processing13 May 2025
- 2024Dynamic and Adaptive Feature Generation with LLMcited by 27
- 2022Controllable Data Generation by Deep Learning: A Reviewcited by 20
- 2024A Survey on Statistical Theory of Deep Learning: Approximation, Training Dynamics, and Generative Modelscited by 20
- 2023Remote patient monitoring using artificial intelligence: Current state, applications, and challengescited by 14
- 2021Applications of Deep Learning Techniques for Automated Multiple Sclerosis Detection Using Magnetic Resonance Imaging: A Reviewcited by 10
- 2022A Penalty Approach for Normalizing Feature Distributions to Build Confounder-Free Modelscited by 8
- 2022Empirical Evaluation and Theoretical Analysis for Representation Learning: A Surveycited by 5
- 2021Unsupervised Learning Architecture for Classifying the Transient Noise of Interferometric Gravitational-wave Detectorscited by 4
- 2024Machine Learning Analysis of Anomalous Diffusioncited by 3
- 2026Multi-Modal Data-Enhanced Foundation Models for Prediction and Control in Wireless Networks: A Surveycited by 3
- 2021Do Neural Network Weights account for Classes Centers?cited by 2
- 2021ODMTCNet: An Interpretable Multi-view Deep Neural Network Architecture for Image Feature Representationcited by 1
12 most cited of 26 All 26 (JSON)
- 2026Computational Methods and Challenges in Cell-Free DNA Analysis for Multi-Cancer Early Detection18 Jun 2026
- 2026Multi-Modal Data-Enhanced Foundation Models for Prediction and Control in Wireless Networks: A Survey6 Jan 2026
- 2025A Physics Prior-Guided Dual-Stream Attention Network for Motion Prediction of Elastic Bragg Breakwaters16 Oct 2025
- 2025Learning Representations of Satellite Images with Evaluations on Synoptic Weather Events8 Aug 2025
- 2025Innovative tokenisation of structured data for LLM training3 Aug 2025
- 2025Artificial Intelligence and Deep Learning Algorithms for Epigenetic Sequence Analysis: A Review for Epigeneticists and AI Experts1 Apr 2025
- 2025Interpretable Transformation and Analysis of Timelines through Learning via Surprisability6 Mar 2025
- 2025An Optimization Algorithm for Multimodal Data Alignment5 Mar 2025
- 2024Machine Learning Analysis of Anomalous Diffusion2 Dec 2024
- 2024Disentangling Genotype and Environment Specific Latent Features for Improved Trait Prediction using a Compositional Autoencoder25 Oct 2024
- 2024TemporalPaD: a reinforcement-learning framework for temporal feature representation and dimension reduction27 Sep 2024
- 2024Dynamic and Adaptive Feature Generation with LLM4 Jun 2024
12 newest of 26 All 26 (JSON)