mlsanityData to 7 Oct 2026

Neural Transformation Learning for Deep Anomaly Detection Beyond Images

arXiv 2103.16440 ↗First posted 30 Mar 2021cs.LG cs.AIcited by 98

Not on the map. Why?

Abstract (arXiv)

Data transformations (e.g. rotations, reflections, and cropping) play an important role in self-supervised learning. Typically, images are transformed into different views, and neural networks trained on tasks involving these views produce useful feature representations for downstream tasks, including anomaly detection. However, for anomaly detection beyond image data, it is often unclear which transformations to use. Here we present a simple end-to-end procedure for anomaly detection with learnable transformations. The key idea is to embed the transformed data into a semantic space such that the transformed data still resemble their untransformed form, while different transformations are easily distinguishable. Extensive experiments on time series demonstrate that our proposed method outperforms existing approaches in the one-vs.-rest setting and is competitive in the more challenging n-vs.-rest anomaly detection task. On tabular datasets from the medical and cyber-security domains, our method learns domain-specific transformations and detects anomalies more accurately than previous work.

Key facts. Cited by 98 papers in the map (data through 7 Oct 2026). Builds on 34 of its 62 references that are in the map. First posted on arXiv 30 Mar 2021.

Builds on

34 of 62 references.

References · 34

  1. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
  2. 2018Representation Learning with Contrastive Predictive Codingcited by 7,662
  3. 2018Unsupervised Representation Learning by Predicting Image Rotationscited by 1,586
  4. 2016Unsupervised Learning of Visual Representations by Solving Jigsaw Puzzlescited by 1,379
  5. 2018Learning deep representations by mutual information estimation and maximizationcited by 1,265
  6. 2015Unsupervised Visual Representation Learning by Context Predictioncited by 1,062
  7. 2018Deep Anomaly Detection with Outlier Exposurecited by 939
  8. 2019Learning Representations by Maximizing Mutual Information Across Viewscited by 733
  9. 2018AutoAugment: Learning Augmentation Policies from Datacited by 728
  10. 2017Unsupervised Anomaly Detection with Generative Adversarial Networks to Guide Marker Discoverycited by 566
  11. 2019Using Self-Supervised Learning Can Improve Model Robustness and Uncertaintycited by 511
  12. 2020A Unifying Review of Deep and Shallow Anomaly Detectioncited by 423
22 more
  1. 2018GANomaly: Semi-Supervised Anomaly Detection via Adversarial Trainingcited by 409
  2. 2018The UEA multivariate time series classification archive, 2018cited by 330
  3. 2019On Mutual Information Maximization for Representation Learningcited by 315
  4. 2019Deep Semi-Supervised Anomaly Detectioncited by 290
  5. 2018Deep Anomaly Detection Using Geometric Transformationscited by 269
  6. 2019Fast AutoAugmentcited by 243
  7. 2016Split-Brain Autoencoders: Unsupervised Learning by Cross-Channel Predictioncited by 217
  8. 2016LSTM-based Encoder-Decoder for Multi-sensor Anomaly Detectioncited by 213
  9. 2020Classification-Based Anomaly Detection for General Datacited by 210
  10. 2019OCGAN: One-class Novelty Detection Using GANs with Constrained Latent Representationscited by 199
  11. 2019Population Based Augmentation: Efficient Learning of Augmentation Policy Schedulescited by 153
  12. 2018Latent Space Autoregression for Novelty Detectioncited by 149
  13. 2020Benchmarking Multivariate Time Series Classification Algorithmscited by 145
  14. 2020Learning and Evaluating Representations for Deep One-class Classificationcited by 133
  15. 2020DROCC: Deep Robust One-Class Classificationcited by 121
  16. 2019Adversarial AutoAugmentcited by 111
  17. 2017Learning to Compose Domain-Specific Transformations for Data Augmentationcited by 91
  18. 2018Unsupervised Detection of Lesions in Brain MRI using constrained adversarial auto-encoderscited by 83
  19. 2017A Bayesian Data Augmentation Approach for Learning Deep Modelscited by 50
  20. 2020Learning perturbation sets for robust machine learningcited by 48
  21. 2020Viewmaker Networks: Learning Views for Unsupervised Representation Learningcited by 48
  22. 2020Extreme Classification via Adversarial Softmax Approximationcited by 10

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 1; 2022: 21; 2023: 24; 2024: 18; 2025: 18; 2026: 16.

98 papers.

Sort:

By area:

  1. 2022ADBench: Anomaly Detection Benchmarkcited by 230
  2. 2022Latent Outlier Exposure for Anomaly Detection with Contaminated Datacited by 48
  3. 2022Raising the Bar in Graph-level Anomaly Detectioncited by 45
  4. 2022Calibrated One-class Classification for Unsupervised Time Series Anomaly Detectioncited by 39
  5. 2023Fascinating Supervisory Signals and Where to Find Them: Deep Anomaly Detection with Scale Learningcited by 25
  6. 2022Self-Supervised Anomaly Detection in Computer Vision and Beyond: A Survey and Outlookcited by 24
  7. 2022Perturbation Learning Based Anomaly Detectioncited by 24
  8. 2022Hyperparameter Sensitivity in Deep Outlier Detection: Analysis and a Scalable Hyper-Ensemble Solutioncited by 24
  9. 2022Graph Anomaly Detection with Graph Neural Networks: Current Status and Challengescited by 23
  10. 2022Data-Efficient and Interpretable Tabular Anomaly Detectioncited by 15
  11. 2022Anomaly Detection Requires Better Representationscited by 14
  12. 2023Beyond Individual Input for Deep Anomaly Detection on Tabular Datacited by 14
38 more
  1. 2023Set Features for Fine-grained Anomaly Detectioncited by 13
  2. 2022Detecting Anomalies within Time Series using Local Neural Transformationscited by 12
  3. 2022Data Augmentation is a Hyperparameter: Cherry-picked Self-Supervision for Unsupervised Anomaly Detection is Creating the Illusion of Successcited by 11
  4. 2021Contrastive Predictive Coding for Anomaly Detectioncited by 10
  5. 2022A Revealing Large-Scale Evaluation of Unsupervised Anomaly Detection Algorithmscited by 10
  6. 2022Deep Contrastive One-Class Time Series Anomaly Detectioncited by 10
  7. 2023Deep Anomaly Detection under Labeling Budget Constraintscited by 9
  8. 2023Unsupervised Anomaly Detection with Rejectioncited by 9
  9. 2022TracInAD: Measuring Influence for Anomaly Detectioncited by 8
  10. 2023Anomaly Detection with Variance Stabilized Density Estimationcited by 8
  11. 2023Model Selection of Anomaly Detectors in the Absence of Labeled Validation Datacited by 8
  12. 2025Anomaly Detection and Generation with Diffusion Models: A Surveycited by 8
  13. 2023No Free Lunch: The Hazards of Over-Expressive Representations in Anomaly Detectioncited by 7
  14. 2023DSV: An Alignment Validation Loss for Self-supervised Outlier Model Selectioncited by 6
  15. 2023Self-Discriminative Modeling for Anomalous Graph Detectioncited by 6
  16. 2023Deep Anomaly Detection on Tennessee Eastman Process Datacited by 5
  17. 2023TabADM: Unsupervised Tabular Anomaly Detection with Diffusion Modelscited by 5
  18. 2026Towards One-for-All Anomaly Detection for Tabular Datacited by 5
  19. 2022Composite Convolution: a Flexible Operator for Deep Learning on 3D Point Cloudscited by 4
  20. 2023Self-Tuning Self-Supervised Image Anomaly Detectioncited by 4
  21. 2023Comparative Evaluation of Anomaly Detection Methods for Fraud Detection in Online Credit Card Paymentscited by 4
  22. 2024Disentangling Tabular Data Towards Better One-Class Anomaly Detectioncited by 4
  23. 2025A Review on Self-Supervised Learning for Time Series Anomaly Detection: Recent Advances and Open Challengescited by 4
  24. 2025RoCA: Robust Contrastive One-class Time Series Anomaly Detection with Contaminated Datacited by 4
  25. 2022Deep Federated Anomaly Detection for Multivariate Time Series Datacited by 3
  26. 2022Unsupervised Anomaly Detection for Auditing Data and Impact of Categorical Encodingscited by 3
  27. 2023Set Features for Anomaly Detectioncited by 3
  28. 2023Revisiting Non-separable Binary Classification and its Applications in Anomaly Detectioncited by 3
  29. 2024Domain Adaptive and Fine-grained Anomaly Detection for Single-cell Sequencing Data and Beyondcited by 3
  30. 2024EntropyStop: Unsupervised Deep Outlier Detection with Loss Entropycited by 3
  31. 2024Deep Learning for Network Anomaly Detection under Data Contamination: Evaluating Robustness and Mitigating Performance Degradationcited by 3
  32. 2024FedAD-Bench: A Unified Benchmark for Federated Unsupervised Anomaly Detection in Tabular Datacited by 3
  33. 2024Enhancing Anomaly Detection via Generating Diversified and Hard-to-distinguish Synthetic Anomaliescited by 3
  34. 2025Unsupervised Surrogate Anomaly Detectioncited by 3
  35. 2025An Evidence-Based Post-Hoc Adjustment Framework for Anomaly Detection Under Data Contaminationcited by 3
  36. 2026ICLAD: In-Context Learning for Unified Tabular Anomaly Detection Across Supervision Regimescited by 3
  37. 2026Decompose to Understand, Fuse to Detect: Frequency-Decoupled Anomaly Detection for Encrypted Network Trafficcited by 3
  38. 2022Robustness Evaluation of Deep Unsupervised Learning Algorithms for Intrusion Detection Systemscited by 2

50 most cited of 98 All 98 (JSON)