# Unsupervised Concept Drift Detection from Deep Learning Representations in Real-time

arXiv: https://arxiv.org/abs/2406.17813 · HTML: https://mlsanity.com/paper/2406.17813/

## Key facts

- Cited by 16 papers in the map (data through 14 Oct 2026).
- Builds on 24 of its 98 references that are in the map.
- First posted on arXiv 24 Jun 2024.

## Builds on (most cited first, 24 of 24)

- [BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding](https://mlsanity.com/paper/1810.04805/) (2018)
- [An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale](https://mlsanity.com/paper/2010.11929/) (2020)
- [Very Deep Convolutional Networks for Large-Scale Image Recognition](https://mlsanity.com/paper/1409.1556/) (2014)
- [RoBERTa: A Robustly Optimized BERT Pretraining Approach](https://mlsanity.com/paper/1907.11692/) (2019)
- [DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lighter](https://mlsanity.com/paper/1910.01108/) (2019)
- [Character-level Convolutional Networks for Text Classification](https://mlsanity.com/paper/1509.01626/) (2015)
- [Common Voice: A Massively-Multilingual Speech Corpus](https://mlsanity.com/paper/1912.06670/) (2019)
- [A Survey Of Methods For Explaining Black Box Models](https://mlsanity.com/paper/1802.01933/) (2018)
- [Learning under Concept Drift: A Review](https://mlsanity.com/paper/2004.05785/) (2020)
- [Null It Out: Guarding Protected Attributes by Iterative Nullspace Projection](https://mlsanity.com/paper/2004.07667/) (2020)
- [Bias in Bios: A Case Study of Semantic Representation Bias in a High-Stakes Setting](https://mlsanity.com/paper/1901.09451/) (2019)
- [Failing Loudly: An Empirical Study of Methods for Detecting Dataset Shift](https://mlsanity.com/paper/1810.11953/) (2018)
- [Explaining Explanations in AI](https://mlsanity.com/paper/1811.01439/) (2018)
- [Measure and Improve Robustness in NLP Models: A Survey](https://mlsanity.com/paper/2112.08313/) (2021)
- [Concept-based Explainable Artificial Intelligence: A Survey](https://mlsanity.com/paper/2312.12936/) (2023)
- [From Concept Drift to Model Degradation: An Overview on Performance-Aware Drift Detectors](https://mlsanity.com/paper/2203.11070/) (2022)
- [Model Based Explanations of Concept Drift](https://mlsanity.com/paper/2303.09331/) (2023)
- [Concept Drift Adaptation by Exploiting Historical Knowledge](https://mlsanity.com/paper/1702.03500/) (2017)
- [Generalization of Change-Point Detection in Time Series Data Based on Direct Density Ratio Estimation](https://mlsanity.com/paper/2001.06386/) (2020)
- [ConceptExplorer: Visual Analysis of Concept Driftsin Multi-source Time-series Data](https://mlsanity.com/paper/2007.15272/) (2020)
- [Towards Observability for Production Machine Learning Pipelines](https://mlsanity.com/paper/2108.13557/) (2021)
- [Wise-SrNet: A Novel Architecture for Enhancing Image Classification by Learning Spatial Resolution of Feature Maps](https://mlsanity.com/paper/2104.12294/) (2021)
- [Autoregressive based Drift Detection Method](https://mlsanity.com/paper/2203.04769/) (2022)
- [Towards Computational Performance Engineering for Unsupervised Concept Drift Detection -- Complexities, Benchmarking, Performance Analysis](https://mlsanity.com/paper/2304.08319/) (2023)

## Built on by (most cited first, 16 of 16)

- [Holistic Continual Learning under Concept Drift with Adaptive Memory Realignment](https://mlsanity.com/paper/2507.02310/) (2025)
- [Improving Real-Time Concept Drift Detection using a Hybrid Transformer-Autoencoder Framework](https://mlsanity.com/paper/2508.07085/) (2025)
- [EpiEvolve: Self-Evolving Agents for Streaming Pandemic Forecasting under Regime Shifts](https://mlsanity.com/paper/2606.05513/) (2026)
- [A Representation Learning Approach to Feature Drift Detection in Wireless Networks](https://mlsanity.com/paper/2505.10325/) (2025)
- [PB-IAD: Utilizing multimodal foundation models for semantic industrial anomaly detection in dynamic manufacturing environments](https://mlsanity.com/paper/2508.14504/) (2025)
- [Counterfactual Reward Model Training for Bias Mitigation in Multimodal Reinforcement Learning](https://mlsanity.com/paper/2508.19567/) (2025)
- [Dataset Safety in Autonomous Driving: Requirements, Risks, and Assurance](https://mlsanity.com/paper/2511.08439/) (2025)
- [Online Regime-aware Calibration for Black-box Social Simulators via Posterior-assisted Evolutionary Dynamic Optimization](https://mlsanity.com/paper/2601.19481/) (2026)
- [Resilient Class-Incremental Learning: on the Interplay of Drifting, Unlabelled and Imbalanced Data Streams](https://mlsanity.com/paper/2602.09681/) (2026)
- [Drift-Aware Variational Autoencoder-based Anomaly Detection with Two-level Ensembling](https://mlsanity.com/paper/2602.12976/) (2026)
- [The Informational Cost of Agency: A Bounded Measure of Interaction Efficiency for Deployed Reinforcement Learning](https://mlsanity.com/paper/2603.01283/) (2026)
- [Autonomous Drift Learning in Data Streams: A Unified Perspective](https://mlsanity.com/paper/2605.01295/) (2026)
- [NAACA: Training-Free NeuroAuditory Attentive Cognitive Architecture with Oscillatory Working Memory for Salience-Driven Attention Gating](https://mlsanity.com/paper/2605.13651/) (2026)
- [Dimension-Calibrated Unexplained Mass: An Interpretable Drift Statistic for Contamination Monitoring in Data Streams](https://mlsanity.com/paper/2607.16811/) (2026)
- [Regime-Conditional Verification: Correctness Estimation for Adapting and Monitoring Safety Classifiers](https://mlsanity.com/paper/2608.14089/) (2026)
- [Performance Drift Detection in Machine Learning as a Service (MLaaS) for IoT Environments](https://mlsanity.com/paper/2608.18555/) (2026)

## Abstract (arXiv)

Concept drift is the phenomenon in which the underlying data distributions and statistical properties of a target domain change over time, leading to a degradation in model performance. Consequently, production models require continuous drift detection monitoring. Most drift detection methods to date are supervised, relying on ground-truth labels. However, they are inapplicable in many real-world scenarios, as true labels are often unavailable. Although recent efforts have proposed unsupervised drift detectors, many lack the accuracy required for reliable detection or are too computationally intensive for real-time use in high-dimensional, large-scale production environments. Moreover, they often fail to characterize or explain drift effectively. To address these limitations, we propose textscDriftLens, an unsupervised framework for real-time concept drift detection and characterization. Designed for deep learning classifiers handling unstructured data, textscDriftLens leverages distribution distances in deep learning representations to enable efficient and accurate detection. Additionally, it characterizes drift by analyzing and explaining its impact on each label. Our evaluation across classifiers and data-types demonstrates that textscDriftLens (i) outperforms previous methods in detecting drift in 15/17 use cases; (ii) runs at least 5 times faster; (iii) produces drift curves that align closely with actual drift (correlation ≥!0.85); (iv) effectively identifies representative drift samples as explanations.