Neural Transformation Learning for Deep Anomaly Detection Beyond Images
Not on the map. Why?
Abstract (arXiv)
Data transformations (e.g. rotations, reflections, and cropping) play an important role in self-supervised learning. Typically, images are transformed into different views, and neural networks trained on tasks involving these views produce useful feature representations for downstream tasks, including anomaly detection. However, for anomaly detection beyond image data, it is often unclear which transformations to use. Here we present a simple end-to-end procedure for anomaly detection with learnable transformations. The key idea is to embed the transformed data into a semantic space such that the transformed data still resemble their untransformed form, while different transformations are easily distinguishable. Extensive experiments on time series demonstrate that our proposed method outperforms existing approaches in the one-vs.-rest setting and is competitive in the more challenging n-vs.-rest anomaly detection task. On tabular datasets from the medical and cyber-security domains, our method learns domain-specific transformations and detects anomalies more accurately than previous work.
Key facts. Cited by 98 papers in the map (data through 7 Oct 2026). Builds on 34 of its 62 references that are in the map. First posted on arXiv 30 Mar 2021.
Builds on
34 of 62 references.
References · 34
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
- 2018Representation Learning with Contrastive Predictive Codingcited by 7,662
- 2018Unsupervised Representation Learning by Predicting Image Rotationscited by 1,586
- 2016Unsupervised Learning of Visual Representations by Solving Jigsaw Puzzlescited by 1,379
- 2018Learning deep representations by mutual information estimation and maximizationcited by 1,265
- 2015Unsupervised Visual Representation Learning by Context Predictioncited by 1,062
- 2018Deep Anomaly Detection with Outlier Exposurecited by 939
- 2019Learning Representations by Maximizing Mutual Information Across Viewscited by 733
- 2018AutoAugment: Learning Augmentation Policies from Datacited by 728
- 2017Unsupervised Anomaly Detection with Generative Adversarial Networks to Guide Marker Discoverycited by 566
- 2019Using Self-Supervised Learning Can Improve Model Robustness and Uncertaintycited by 511
- 2020A Unifying Review of Deep and Shallow Anomaly Detectioncited by 423
22 more
- 2018GANomaly: Semi-Supervised Anomaly Detection via Adversarial Trainingcited by 409
- 2018The UEA multivariate time series classification archive, 2018cited by 330
- 2019On Mutual Information Maximization for Representation Learningcited by 315
- 2019Deep Semi-Supervised Anomaly Detectioncited by 290
- 2018Deep Anomaly Detection Using Geometric Transformationscited by 269
- 2019Fast AutoAugmentcited by 243
- 2016Split-Brain Autoencoders: Unsupervised Learning by Cross-Channel Predictioncited by 217
- 2016LSTM-based Encoder-Decoder for Multi-sensor Anomaly Detectioncited by 213
- 2020Classification-Based Anomaly Detection for General Datacited by 210
- 2019OCGAN: One-class Novelty Detection Using GANs with Constrained Latent Representationscited by 199
- 2019Population Based Augmentation: Efficient Learning of Augmentation Policy Schedulescited by 153
- 2018Latent Space Autoregression for Novelty Detectioncited by 149
- 2020Benchmarking Multivariate Time Series Classification Algorithmscited by 145
- 2020Learning and Evaluating Representations for Deep One-class Classificationcited by 133
- 2020DROCC: Deep Robust One-Class Classificationcited by 121
- 2019Adversarial AutoAugmentcited by 111
- 2017Learning to Compose Domain-Specific Transformations for Data Augmentationcited by 91
- 2018Unsupervised Detection of Lesions in Brain MRI using constrained adversarial auto-encoderscited by 83
- 2017A Bayesian Data Augmentation Approach for Learning Deep Modelscited by 50
- 2020Learning perturbation sets for robust machine learningcited by 48
- 2020Viewmaker Networks: Learning Views for Unsupervised Representation Learningcited by 48
- 2020Extreme Classification via Adversarial Softmax Approximationcited by 10
Built on by
Citing papers per year: 2021: 1; 2022: 21; 2023: 24; 2024: 18; 2025: 18; 2026: 16.
98 papers.
Sort:
By area:
- 2022ADBench: Anomaly Detection Benchmarkcited by 230
- 2022Latent Outlier Exposure for Anomaly Detection with Contaminated Datacited by 48
- 2022Raising the Bar in Graph-level Anomaly Detectioncited by 45
- 2022Calibrated One-class Classification for Unsupervised Time Series Anomaly Detectioncited by 39
- 2023Fascinating Supervisory Signals and Where to Find Them: Deep Anomaly Detection with Scale Learningcited by 25
- 2022Self-Supervised Anomaly Detection in Computer Vision and Beyond: A Survey and Outlookcited by 24
- 2022Perturbation Learning Based Anomaly Detectioncited by 24
- 2022Hyperparameter Sensitivity in Deep Outlier Detection: Analysis and a Scalable Hyper-Ensemble Solutioncited by 24
- 2022Graph Anomaly Detection with Graph Neural Networks: Current Status and Challengescited by 23
- 2022Data-Efficient and Interpretable Tabular Anomaly Detectioncited by 15
- 2022Anomaly Detection Requires Better Representationscited by 14
- 2023Beyond Individual Input for Deep Anomaly Detection on Tabular Datacited by 14
38 more
- 2023Set Features for Fine-grained Anomaly Detectioncited by 13
- 2022Detecting Anomalies within Time Series using Local Neural Transformationscited by 12
- 2022Data Augmentation is a Hyperparameter: Cherry-picked Self-Supervision for Unsupervised Anomaly Detection is Creating the Illusion of Successcited by 11
- 2021Contrastive Predictive Coding for Anomaly Detectioncited by 10
- 2022A Revealing Large-Scale Evaluation of Unsupervised Anomaly Detection Algorithmscited by 10
- 2022Deep Contrastive One-Class Time Series Anomaly Detectioncited by 10
- 2023Deep Anomaly Detection under Labeling Budget Constraintscited by 9
- 2023Unsupervised Anomaly Detection with Rejectioncited by 9
- 2022TracInAD: Measuring Influence for Anomaly Detectioncited by 8
- 2023Anomaly Detection with Variance Stabilized Density Estimationcited by 8
- 2023Model Selection of Anomaly Detectors in the Absence of Labeled Validation Datacited by 8
- 2025Anomaly Detection and Generation with Diffusion Models: A Surveycited by 8
- 2023No Free Lunch: The Hazards of Over-Expressive Representations in Anomaly Detectioncited by 7
- 2023DSV: An Alignment Validation Loss for Self-supervised Outlier Model Selectioncited by 6
- 2023Self-Discriminative Modeling for Anomalous Graph Detectioncited by 6
- 2023Deep Anomaly Detection on Tennessee Eastman Process Datacited by 5
- 2023TabADM: Unsupervised Tabular Anomaly Detection with Diffusion Modelscited by 5
- 2026Towards One-for-All Anomaly Detection for Tabular Datacited by 5
- 2022Composite Convolution: a Flexible Operator for Deep Learning on 3D Point Cloudscited by 4
- 2023Self-Tuning Self-Supervised Image Anomaly Detectioncited by 4
- 2023Comparative Evaluation of Anomaly Detection Methods for Fraud Detection in Online Credit Card Paymentscited by 4
- 2024Disentangling Tabular Data Towards Better One-Class Anomaly Detectioncited by 4
- 2025A Review on Self-Supervised Learning for Time Series Anomaly Detection: Recent Advances and Open Challengescited by 4
- 2025RoCA: Robust Contrastive One-class Time Series Anomaly Detection with Contaminated Datacited by 4
- 2022Deep Federated Anomaly Detection for Multivariate Time Series Datacited by 3
- 2022Unsupervised Anomaly Detection for Auditing Data and Impact of Categorical Encodingscited by 3
- 2023Set Features for Anomaly Detectioncited by 3
- 2023Revisiting Non-separable Binary Classification and its Applications in Anomaly Detectioncited by 3
- 2024Domain Adaptive and Fine-grained Anomaly Detection for Single-cell Sequencing Data and Beyondcited by 3
- 2024EntropyStop: Unsupervised Deep Outlier Detection with Loss Entropycited by 3
- 2024Deep Learning for Network Anomaly Detection under Data Contamination: Evaluating Robustness and Mitigating Performance Degradationcited by 3
- 2024FedAD-Bench: A Unified Benchmark for Federated Unsupervised Anomaly Detection in Tabular Datacited by 3
- 2024Enhancing Anomaly Detection via Generating Diversified and Hard-to-distinguish Synthetic Anomaliescited by 3
- 2025Unsupervised Surrogate Anomaly Detectioncited by 3
- 2025An Evidence-Based Post-Hoc Adjustment Framework for Anomaly Detection Under Data Contaminationcited by 3
- 2026ICLAD: In-Context Learning for Unified Tabular Anomaly Detection Across Supervision Regimescited by 3
- 2026Decompose to Understand, Fuse to Detect: Frequency-Decoupled Anomaly Detection for Encrypted Network Trafficcited by 3
- 2022Robustness Evaluation of Deep Unsupervised Learning Algorithms for Intrusion Detection Systemscited by 2
50 most cited of 98 All 98 (JSON)
- 2026Unsupervised Anomaly Detection Using Flow Matching on Tabular Data20 Aug 2026
- 2026LLM as Detector: An In-context Learning Approach for Tabular Anomaly Detection19 Aug 2026
- 2026Federated Attention Autoencoders with a Stochastic Aggregation Scheme for Anomaly Detection9 Aug 2026
- 2026What Drives the Inlier-Memorization Effect? A Theory of Outlier Detection via Early Training Dynamics29 Jun 2026
- 2026RGLD: Randomized Global-Local Density Estimation for Tabular Anomaly Detection27 Jun 2026
- 2026ProtoX-AD: Self-Explainable Time Series Anomaly Detection and Characterization11 Jun 2026
- 2026When Normality Shifts: Risk-Aware Test-Time Adaptation for Unsupervised Tabular Anomaly Detection11 May 2026
- 2026Kurtosis-Guided Denoising Score Matching for Tabular Anomaly Detection7 May 2026
- 2026Decompose to Understand, Fuse to Detect: Frequency-Decoupled Anomaly Detection for Encrypted Network Traffic3 May 2026
- 2026EventADL: Open-Box Anomaly Detection and Localization Framework for Events in Cloud-Based Service Systems1 May 2026
- 2026Enhancing Tabular Anomaly Detection via Pseudo-Label-Guided Generation20 Apr 2026
- 2026ICLAD: In-Context Learning for Unified Tabular Anomaly Detection Across Supervision Regimes19 Mar 2026
38 more
- 2026Towards One-for-All Anomaly Detection for Tabular Data15 Mar 2026
- 2026Why the Counterintuitive Phenomenon of Likelihood Rarely Appears in Tabular Anomaly Detection with Deep Generative Models?10 Feb 2026
- 2026CausalTAD: Injecting Causal Knowledge into Large Language Models for Tabular Anomaly Detection8 Feb 2026
- 2026Calibrating Tabular Anomaly Detection via Optimal Transport6 Feb 2026
- 2025ICAD-LLM: One-for-All Anomaly Detection via In-Context Learning with Large Language Models1 Dec 2025
- 2025An Evidence-Based Post-Hoc Adjustment Framework for Anomaly Detection Under Data Contamination24 Oct 2025
- 2025ReTabAD: A Benchmark for Restoring Semantic Context in Tabular Anomaly Detection2 Oct 2025
- 2025Contextual Learning for Anomaly Detection in Tabular Data10 Sep 2025
- 2025Hypergraph-Guided Regex Filter Synthesis for Event-Based Anomaly Detection8 Sep 2025
- 2025NeuCoReClass AD: Redefining Self-Supervised Time Series Anomaly Detection29 Jul 2025
- 2025Text-ADBench: Text Anomaly Detection Benchmark Based on LLM Embeddings16 Jul 2025
- 2025UniOD: A Universal Model for Outlier Detection across Diverse Domains9 Jul 2025
- 2025Bridging Unsupervised and Semi-Supervised Anomaly Detection: A Theoretically-Grounded and Practical Framework with Synthetic Anomalies16 Jun 2025
- 2025Polyra Swarms: A Shape-Based Approach to Machine Learning16 Jun 2025
- 2025Anomaly Detection and Generation with Diffusion Models: A Survey11 Jun 2025
- 2025Investigating Mask-aware Prototype Learning for Tabular Anomaly Detection3 Jun 2025
- 2025Unsupervised Surrogate Anomaly Detection29 Apr 2025
- 2025RoCA: Robust Contrastive One-class Time Series Anomaly Detection with Contaminated Data24 Mar 2025
- 2025A Radon-Nikod'ym Perspective on Anomaly Detection: Theory and Implications25 Feb 2025
- 2025Harnessing Feature Resonance under Arbitrary Target Alignment for Out-of-Distribution Node Detection22 Feb 2025
- 2025Contrastive Learning-Based privacy metrics in Tabular Synthetic Datasets19 Feb 2025
- 2025A Review on Self-Supervised Learning for Time Series Anomaly Detection: Recent Advances and Open Challenges25 Jan 2025
- 2024GradStop: Exploring Training Dynamics in Unsupervised Outlier Detection through Gradient11 Dec 2024
- 2024Disentangling Tabular Data Towards Better One-Class Anomaly Detection12 Nov 2024
- 2024Angel or Devil: Discriminating Hard Samples and Anomaly Contaminations for Unsupervised Time Series Anomaly Detection26 Oct 2024
- 2024Enhancing Anomaly Detection via Generating Diversified and Hard-to-distinguish Synthetic Anomalies16 Sep 2024
- 2024Low-Quality Image Detection by Hierarchical VAE20 Aug 2024
- 2024FedAD-Bench: A Unified Benchmark for Federated Unsupervised Anomaly Detection in Tabular Data8 Aug 2024
- 2024Deep Learning for Network Anomaly Detection under Data Contamination: Evaluating Robustness and Mitigating Performance Degradation11 Jul 2024
- 2024Rethinking Unsupervised Outlier Detection via Multiple Thresholding7 Jul 2024
- 2024From Zero to Hero: Cold-Start Anomaly Detection30 May 2024
- 2024Deep Positive-Unlabeled Anomaly Detection for Contaminated Unlabeled Data29 May 2024
- 2024Uncertainty-aware Evaluation of Auxiliary Anomalies with the Expected Anomaly Posterior22 May 2024
- 2024EntropyStop: Unsupervised Deep Outlier Detection with Loss Entropy21 May 2024
- 2024Domain Adaptive and Fine-grained Anomaly Detection for Single-cell Sequencing Data and Beyond26 Apr 2024
- 2024Deep Transductive Outlier Detection4 Apr 2024
- 2024End-To-End Self-Tuning Self-Supervised Time Series Anomaly Detection3 Apr 2024
- 2024DACR: Distribution-Augmented Contrastive Reconstruction for Time-Series Anomaly Detection20 Jan 2024
50 newest of 98 All 98 (JSON)
- 2022ADBench: Anomaly Detection Benchmarkcited by 230
- 2022Latent Outlier Exposure for Anomaly Detection with Contaminated Datacited by 48
- 2022Raising the Bar in Graph-level Anomaly Detectioncited by 45
- 2022Calibrated One-class Classification for Unsupervised Time Series Anomaly Detectioncited by 39
- 2023Fascinating Supervisory Signals and Where to Find Them: Deep Anomaly Detection with Scale Learningcited by 25
- 2022Self-Supervised Anomaly Detection in Computer Vision and Beyond: A Survey and Outlookcited by 24
- 2022Perturbation Learning Based Anomaly Detectioncited by 24
- 2022Hyperparameter Sensitivity in Deep Outlier Detection: Analysis and a Scalable Hyper-Ensemble Solutioncited by 24
- 2022Graph Anomaly Detection with Graph Neural Networks: Current Status and Challengescited by 23
- 2022Data-Efficient and Interpretable Tabular Anomaly Detectioncited by 15
- 2022Anomaly Detection Requires Better Representationscited by 14
- 2023Beyond Individual Input for Deep Anomaly Detection on Tabular Datacited by 14
12 most cited of 96 All 96 (JSON)
- 2026Unsupervised Anomaly Detection Using Flow Matching on Tabular Data20 Aug 2026
- 2026LLM as Detector: An In-context Learning Approach for Tabular Anomaly Detection19 Aug 2026
- 2026Federated Attention Autoencoders with a Stochastic Aggregation Scheme for Anomaly Detection9 Aug 2026
- 2026What Drives the Inlier-Memorization Effect? A Theory of Outlier Detection via Early Training Dynamics29 Jun 2026
- 2026RGLD: Randomized Global-Local Density Estimation for Tabular Anomaly Detection27 Jun 2026
- 2026ProtoX-AD: Self-Explainable Time Series Anomaly Detection and Characterization11 Jun 2026
- 2026When Normality Shifts: Risk-Aware Test-Time Adaptation for Unsupervised Tabular Anomaly Detection11 May 2026
- 2026Kurtosis-Guided Denoising Score Matching for Tabular Anomaly Detection7 May 2026
- 2026Decompose to Understand, Fuse to Detect: Frequency-Decoupled Anomaly Detection for Encrypted Network Traffic3 May 2026
- 2026EventADL: Open-Box Anomaly Detection and Localization Framework for Events in Cloud-Based Service Systems1 May 2026
- 2026Enhancing Tabular Anomaly Detection via Pseudo-Label-Guided Generation20 Apr 2026
- 2026ICLAD: In-Context Learning for Unified Tabular Anomaly Detection Across Supervision Regimes19 Mar 2026
12 newest of 96 All 96 (JSON)