ADBench: Anomaly Detection Benchmark
Not on the map. Why?
Abstract (arXiv)
Given a long list of anomaly detection algorithms developed in the last few decades, how do they perform with regard to (i) varying levels of supervision, (ii) different types of anomalies, and (iii) noisy and corrupted data? In this work, we answer these key questions by conducting (to our best knowledge) the most comprehensive anomaly detection benchmark with 30 algorithms on 57 benchmark datasets, named ADBench. Our extensive experiments (98,436 in total) identify meaningful insights into the role of supervision and anomaly types, and unlock future directions for researchers in algorithm selection and design. With ADBench, researchers can easily conduct comprehensive and fair evaluations for newly proposed methods on the datasets (including our contributed ones from natural language and computer vision domains) against the existing baselines. To foster accessibility and reproducibility, we fully open-source ADBench and the corresponding results.
Key facts. Cited by 232 papers in the map (data through 14 Oct 2026). Builds on 94 of its 203 references that are in the map. First posted on arXiv 19 Jun 2022.
Builds on
94 of 203 references.
References · 94
- 2017Attention Is All You Needcited by 60,361
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
- 2016XGBoost: A Scalable Tree Boosting Systemcited by 5,166
- 2017Fashion-MNIST: a Novel Image Dataset for Benchmarking Machine Learning Algorithmscited by 4,349
- 2016A Baseline for Detecting Misclassified and Out-of-Distribution Examples in Neural Networkscited by 2,385
- 2015Character-level Convolutional Networks for Text Classificationcited by 2,330
- 2016Enriching Word Vectors with Subword Informationcited by 1,583
- 2018A Simple Unified Framework for Detecting Out-of-Distribution Samples and Adversarial Attackscited by 1,485
- 2020Energy-based Out-of-distribution Detectioncited by 1,299
38 more
- 2016An overview of gradient descent optimization algorithmscited by 1,033
- 2021Generalized Out-of-Distribution Detection: A Surveycited by 802
- 2021Revisiting Deep Learning Models for Tabular Datacited by 740
- 2018Deep learning for time series classification: a reviewcited by 576
- 2021Deep Neural Networks and Tabular Data: A Surveycited by 491
- 2020A Unifying Review of Deep and Shallow Anomaly Detectioncited by 425
- 2018GANomaly: Semi-Supervised Anomaly Detection via Adversarial Trainingcited by 409
- 2018Recent Advances in Open Set Recognition: A Surveycited by 310
- 2019Deep Semi-Supervised Anomaly Detectioncited by 291
- 2021Therapeutics Data Commons: Machine Learning Datasets and Tasks for Drug Discovery and Developmentcited by 264
- 2021SSD: A Unified Framework for Self-Supervised Outlier Detectioncited by 264
- 2020Enhancing Graph Neural Network-based Fraud Detectors against Camouflaged Fraudsterscited by 250
- 2021A Comprehensive Survey on Graph Anomaly Detection with Deep Learningcited by 230
- 2019PyOD: A Python Toolbox for Scalable Outlier Detectioncited by 222
- 2020Classification-Based Anomaly Detection for General Datacited by 211
- 2018Adversarially Learned One-Class Classifier for Novelty Detectioncited by 202
- 2019OCGAN: One-class Novelty Detection Using GANs with Constrained Latent Representationscited by 199
- 2020PANDA: Adapting Pretrained Features for Anomaly Detection and Segmentationcited by 175
- 2019SELF: Learning to Filter Noisy Labels with Self-Ensemblingcited by 164
- 2021A Unified Survey on Anomaly, Novelty, Open-Set, and Out-of-Distribution Detection: Solutions and Future Challengescited by 154
- 2019Deep Anomaly Detection with Deviation Networkscited by 153
- 2022ECOD: Unsupervised Outlier Detection Using Empirical Cumulative Distribution Functionscited by 153
- 2021SegmentMeIfYouCan: A Benchmark for Anomaly Segmentationcited by 150
- 2020COPOD: Copula-Based Outlier Detectioncited by 146
- 2020Adversarial Self-Supervised Contrastive Learningcited by 139
- 2019MNIST-C: A Robustness Benchmark for Computer Visioncited by 138
- 2020Explainable Deep One-Class Classificationcited by 127
- 2021Learning Placeholders for Open-Set Recognitioncited by 121
- 2018Adversarially Learned Anomaly Detectioncited by 115
- 2019Meta Label Correction for Noisy Label Learningcited by 108
- 2019Skip-GANomaly: Skip Connected and Adversarially Trained Encoder-Decoder Anomaly Detectioncited by 100
- 2021Neural Transformation Learning for Deep Anomaly Detection Beyond Imagescited by 99
- 2015Evaluating Real-time Anomaly Detection Algorithms - the Numenta Anomaly Benchmarkcited by 88
- 2018Learning Representations of Ultrahigh-dimensional Data for Random Distance-based Outlier Detectioncited by 79
- 2020Do Wider Neural Networks Really Help Adversarial Robustness?cited by 79
- 2021When Does Contrastive Learning Preserve Adversarial Robustness from Pretraining to Finetuning?cited by 77
- 2022Anomalib: A Deep Learning Library for Anomaly Detectioncited by 75
- 2014Toward Supervised Anomaly Detectioncited by 73
50 most cited of 94 All 94 (JSON)
Built on by
Citing papers per year: 2022: 17; 2023: 57; 2024: 51; 2025: 58; 2026: 49.
232 papers.
Sort:
By area:
- 2022Diffusion Models: A Comprehensive Survey of Methods and Applicationscited by 1,114
- 2023How Close is ChatGPT to Human Experts? Comparison Corpus, Evaluation, and Detectioncited by 481
- 2022OpenOOD: Benchmarking Generalized Out-of-Distribution Detectioncited by 268
- 2023BMAD: Benchmarks for Medical Anomaly Detectioncited by 82
- 2022BOND: Benchmarking Unsupervised Outlier Node Detection on Static Attributed Graphscited by 80
- 2023On Diffusion Modeling for Anomaly Detectioncited by 72
- 2023IM-IAD: Industrial Image Anomaly Detection Benchmark in Manufacturingcited by 64
- 2023GADBench: Revisiting and Benchmarking Supervised Graph Anomaly Detectioncited by 58
- 2022Prototypical Residual Networks for Anomaly Detection and Localizationcited by 56
- 2024SoftPatch: Unsupervised Anomaly Detection with Noisy Datacited by 55
- 2025Representation Learning for Tabular Data: A Comprehensive Surveycited by 36
- 2023ImbSAM: A Closer Look at Sharpness-Aware Minimization in Class-Imbalanced Recognitioncited by 31
38 more
- 2024MultiOOD: Scaling Out-of-Distribution Detection for Multiple Modalitiescited by 28
- 2024MANTA: A Large-Scale Multi-View and Visual-Text Anomaly Detection Dataset for Tiny Objectscited by 26
- 2023Fascinating Supervisory Signals and Where to Find Them: Deep Anomaly Detection with Scale Learningcited by 25
- 2024M3DM-NR: RGB-3D Noisy-Resistant Industrial Anomaly Detection via Multimodal Denoisingcited by 24
- 2023Weakly Supervised Anomaly Detection: A Surveycited by 22
- 2023Unsupervised anomaly detection algorithms on real-world data: how many do we need?cited by 20
- 2022Toward Unsupervised Outlier Model Selectioncited by 19
- 2024Building AI Agents for Autonomous Clouds: Challenges and Design Principlescited by 19
- 2023Energy-Based Models for Anomaly Detection: A Manifold Diffusion Recovery Approachcited by 18
- 2024Supervised Anomaly Detection for Complex Industrial Imagescited by 18
- 2024PyOD 2: A Python Library for Outlier Detection with LLM-powered Model Selectioncited by 17
- 2025Deep Learning Advancements in Anomaly Detection: A Comprehensive Surveycited by 17
- 2023Beyond Individual Input for Deep Anomaly Detection on Tabular Datacited by 16
- 2022ADMoE: Anomaly Detection with Mixture-of-Experts from Noisy Labelscited by 15
- 2023AI for IT Operations (AIOps) on Cloud Platforms: Reviews, Opportunities and Challengescited by 15
- 2022Estimating the Contamination Factor's Distribution in Unsupervised Anomaly Detectioncited by 14
- 2023NNG-Mix: Improving Semi-supervised Anomaly Detection with Pseudo-anomaly Generationcited by 14
- 2023Deep Orthogonal Hypersphere Compression for Anomaly Detectioncited by 12
- 2022Adversarial Camouflage for Node Injection Attack on Graphscited by 11
- 2023DP-SGD Without Clipping: The Lipschitz Neural Network Waycited by 11
- 2023Improving Generalizability of Graph Anomaly Detection Models via Data Augmentationcited by 11
- 2023RoSAS: Deep Semi-Supervised Anomaly Detection with Contamination-Resilient Continuous Supervisioncited by 11
- 2023ADGym: Design Choices for Deep Anomaly Detectioncited by 11
- 2023Robust One-Class Classification with Signed Distance Function using 1-Lipschitz Neural Networkscited by 10
- 2024Weakly Supervised Anomaly Detection via Knowledge-Data Alignmentcited by 10
- 2024Anomaly Detection Based on Isolation Mechanisms: A Surveycited by 10
- 2026SREGym: A Live Benchmark for AI SRE Agents with High-Fidelity Failure Scenarioscited by 10
- 2022Towards Automated Imbalanced Learning with Deep Hierarchical Reinforcement Learningcited by 9
- 2023Unsupervised Anomaly Detection with Rejectioncited by 9
- 2023Visual Data-Type Understanding does not emerge from Scaling Vision-Language Modelscited by 9
- 2024Attention versus Contrastive Learning of Tabular Data -- A Data-centric Benchmarkingcited by 9
- 2024Exploring What Why and How: A Multifaceted Benchmark for Causation Understanding of Video Anomalycited by 9
- 2025ClimateLLM: Efficient Weather Forecasting via Frequency-Aware Large Language Modelscited by 9
- 2025Multi-Modal View Enhanced Large Vision Models for Long-Term Time Series Forecastingcited by 9
- 2026From Zero to Hero: Advancing Zero-Shot Foundation Models for Tabular Outlier Detectioncited by 9
- 2022Anomaly Detection through Unsupervised Federated Learningcited by 8
- 2023Intrinsic Self-Supervision for Data Quality Auditscited by 8
- 2023Anomaly Detection with Variance Stabilized Density Estimationcited by 8
50 most cited of 232 All 232 (JSON)
- 2026Text-Informed Training Data Filtering for Enhanced Virtual Flow Meter Performance14 Oct 2026
- 2026TaskBridge: Bridging Unsupervised Tabular Anomaly Detection and In-Context Learning via Virtual Tasks29 Sep 2026
- 2026MAADBench: The Refreshable Paradigm for Anomaly Detection in Multi-Agent Systems29 Sep 2026
- 2026When Less Compute Is More: Adaptive Early Exit Improves Pretrained Outlier Detection26 Sep 2026
- 2026SIM: Subspace Interaction-based Method for Token-Level Text Anomaly Detection8 Sep 2026
- 2026Differentiable Interval Bottlenecks for Interpretable Anomaly Detection in Numerical Data3 Sep 2026
- 2026Witnesses Explain Anomalies3 Sep 2026
- 2026When Identical Rows Disagree: From Benchmark Identifiability to Replication-Robust Anomaly Detection27 Aug 2026
- 2026CatchBench: When Can an Agent Failure Be Caught?24 Aug 2026
- 2026Unsupervised Anomaly Detection Using Flow Matching on Tabular Data20 Aug 2026
- 2026LLM as Detector: An In-context Learning Approach for Tabular Anomaly Detection19 Aug 2026
- 2026Revisiting Energy-based Tabular Anomaly Detection: Energy and Reconstruction are Complementary14 Aug 2026
38 more
- 2026Wasserstein Filtering: A Sample Selection Method for Robust Distribution Learning13 Aug 2026
- 2026Why Ranking Anomaly Detection Algorithms Isn't as Reliable as You May Think5 Aug 2026
- 2026Localized Anomaly Detection via Differentiable D-vine Copulas27 Jul 2026
- 2026Dimension-Calibrated Unexplained Mass: An Interpretable Drift Statistic for Contamination Monitoring in Data Streams18 Jul 2026
- 2026CLOE: Christoffel Loss Autoencoder for Anomaly Detection10 Jul 2026
- 2026Towards Principled Continual Anomaly Detection: A Systematic Framework and Benchmark Scenarios30 Jun 2026
- 2026What Drives the Inlier-Memorization Effect? A Theory of Outlier Detection via Early Training Dynamics29 Jun 2026
- 2026RGLD: Randomized Global-Local Density Estimation for Tabular Anomaly Detection27 Jun 2026
- 2026Finite Resources False Discovery Rate Control in Structured Hypothesis Spaces13 Jun 2026
- 2026Scalable anomaly detection via a univariate Christoffel function10 Jun 2026
- 2026TaskFusion: Continual Anomaly Detection for Heterogeneous Tabular Data10 Jun 2026
- 2026Masked Diffusion Modeling for Anomaly Detection28 May 2026
- 2026Stream Assembly Is an Uncontrolled Treatment in Streaming Intrusion-Detection Benchmarks23 May 2026
- 2026SilIF: Silhouette-Augmented Isolation Forest for Unsupervised Transaction Fraud Detection21 May 2026
- 2026Automatic Unsupervised Ensemble Outlier Model Selection--Extended Version15 May 2026
- 2026When Normality Shifts: Risk-Aware Test-Time Adaptation for Unsupervised Tabular Anomaly Detection11 May 2026
- 2026Toward Privileged Foundation Models:LUPI for Accelerated and Improved Learning8 May 2026
- 2026SREGym: A Live Benchmark for AI SRE Agents with High-Fidelity Failure Scenarios8 May 2026
- 2026Kurtosis-Guided Denoising Score Matching for Tabular Anomaly Detection7 May 2026
- 2026VAE-Inf: A statistically interpretable generative paradigm for imbalanced classification28 Apr 2026
- 2026ARFBench: Benchmarking Time Series Question Answering Ability for Software Incident Response23 Apr 2026
- 2026Enhancing Tabular Anomaly Detection via Pseudo-Label-Guided Generation20 Apr 2026
- 2026Between Resolution Collapse and Variance Inflation: Weighted Conformal Anomaly Detection in Low-Data Regimes24 Mar 2026
- 2026ICLAD: In-Context Learning for Unified Tabular Anomaly Detection Across Supervision Regimes19 Mar 2026
- 2026RangeAD: Fast On-Model Anomaly Detection18 Mar 2026
- 2026Unsupervised Symbolic Anomaly Detection18 Mar 2026
- 2026FoMo X: Modular Explainability Signals for Outlier Detection Foundation Models18 Mar 2026
- 2026Towards One-for-All Anomaly Detection for Tabular Data15 Mar 2026
- 2026TACTIC for Navigating the Unknown: Tabular Anomaly deteCTion via In-Context inference15 Mar 2026
- 2026Multi-Agent Debate: A Unified Agentic Framework for Tabular Anomaly Detection15 Feb 2026
- 2026Why the Counterintuitive Phenomenon of Likelihood Rarely Appears in Tabular Anomaly Detection with Deep Generative Models?10 Feb 2026
- 2026MacrOData: New Benchmarks of Thousands of Datasets for Tabular Outlier Detection10 Feb 2026
- 2026Anomaly Detection via Mean Shift Density Enhancement3 Feb 2026
- 2026From Zero to Hero: Advancing Zero-Shot Foundation Models for Tabular Outlier Detection3 Feb 2026
- 2026Analyzing Shapley Additive Explanations to Understand Anomaly Detection Algorithm Behaviors and Their Complementarity30 Jan 2026
- 2026QUPID: A Partitioned Quantum Neural Network for Anomaly Detection in Smart Grid16 Jan 2026
- 2026Stochastic Voronoi Ensembles for Anomaly Detection7 Jan 2026
- 2025Debugging Tabular Log as Dynamic Graphs28 Dec 2025
50 newest of 232 All 232 (JSON)
- 2022Diffusion Models: A Comprehensive Survey of Methods and Applicationscited by 1,114
- 2023On Diffusion Modeling for Anomaly Detectioncited by 72
- 2025Diffusion and Flow Matching Models for Tabular Data: A Surveycited by 8
- 2025Anomaly Detection and Generation with Diffusion Models: A Surveycited by 8
- 2023TabADM: Unsupervised Tabular Anomaly Detection with Diffusion Modelscited by 5
- 2024FRRffusion: Unveiling Authenticity with Diffusion-Based Face Retouching Reversalcited by 0
- 2026Masked Diffusion Modeling for Anomaly Detectioncited by 0
- 2026Masked Diffusion Modeling for Anomaly Detection28 May 2026
- 2025Anomaly Detection and Generation with Diffusion Models: A Survey11 Jun 2025
- 2025Diffusion and Flow Matching Models for Tabular Data: A Survey24 Feb 2025
- 2024FRRffusion: Unveiling Authenticity with Diffusion-Based Face Retouching Reversal13 May 2024
- 2023TabADM: Unsupervised Tabular Anomaly Detection with Diffusion Models23 Jul 2023
- 2023On Diffusion Modeling for Anomaly Detection29 May 2023
- 2022Diffusion Models: A Comprehensive Survey of Methods and Applications2 Sep 2022
- 2024Building AI Agents for Autonomous Clouds: Challenges and Design Principlescited by 19
- 2026SREGym: A Live Benchmark for AI SRE Agents with High-Fidelity Failure Scenarioscited by 10
- 2025Human-Centered LLM-Agent System for Detecting Anomalous Digital Asset Transactionscited by 1
- 2026Multi-Agent Debate: A Unified Agentic Framework for Tabular Anomaly Detectioncited by 0
- 2026MAADBench: The Refreshable Paradigm for Anomaly Detection in Multi-Agent Systemscited by 0
- 2026MAADBench: The Refreshable Paradigm for Anomaly Detection in Multi-Agent Systems29 Sep 2026
- 2026SREGym: A Live Benchmark for AI SRE Agents with High-Fidelity Failure Scenarios8 May 2026
- 2026Multi-Agent Debate: A Unified Agentic Framework for Tabular Anomaly Detection15 Feb 2026
- 2025Human-Centered LLM-Agent System for Detecting Anomalous Digital Asset Transactions23 Oct 2025
- 2024Building AI Agents for Autonomous Clouds: Challenges and Design Principles16 Jul 2024
- 2023How Close is ChatGPT to Human Experts? Comparison Corpus, Evaluation, and Detectioncited by 481
- 2022OpenOOD: Benchmarking Generalized Out-of-Distribution Detectioncited by 268
- 2023BMAD: Benchmarks for Medical Anomaly Detectioncited by 82
- 2022BOND: Benchmarking Unsupervised Outlier Node Detection on Static Attributed Graphscited by 80
- 2023IM-IAD: Industrial Image Anomaly Detection Benchmark in Manufacturingcited by 64
- 2023GADBench: Revisiting and Benchmarking Supervised Graph Anomaly Detectioncited by 58
- 2022Prototypical Residual Networks for Anomaly Detection and Localizationcited by 56
- 2024SoftPatch: Unsupervised Anomaly Detection with Noisy Datacited by 55
- 2025Representation Learning for Tabular Data: A Comprehensive Surveycited by 36
- 2023ImbSAM: A Closer Look at Sharpness-Aware Minimization in Class-Imbalanced Recognitioncited by 31
- 2024MultiOOD: Scaling Out-of-Distribution Detection for Multiple Modalitiescited by 28
- 2024MANTA: A Large-Scale Multi-View and Visual-Text Anomaly Detection Dataset for Tiny Objectscited by 26
12 most cited of 213 All 213 (JSON)
- 2026Text-Informed Training Data Filtering for Enhanced Virtual Flow Meter Performance14 Oct 2026
- 2026TaskBridge: Bridging Unsupervised Tabular Anomaly Detection and In-Context Learning via Virtual Tasks29 Sep 2026
- 2026SIM: Subspace Interaction-based Method for Token-Level Text Anomaly Detection8 Sep 2026
- 2026Differentiable Interval Bottlenecks for Interpretable Anomaly Detection in Numerical Data3 Sep 2026
- 2026Witnesses Explain Anomalies3 Sep 2026
- 2026When Identical Rows Disagree: From Benchmark Identifiability to Replication-Robust Anomaly Detection27 Aug 2026
- 2026CatchBench: When Can an Agent Failure Be Caught?24 Aug 2026
- 2026Unsupervised Anomaly Detection Using Flow Matching on Tabular Data20 Aug 2026
- 2026LLM as Detector: An In-context Learning Approach for Tabular Anomaly Detection19 Aug 2026
- 2026Revisiting Energy-based Tabular Anomaly Detection: Energy and Reconstruction are Complementary14 Aug 2026
- 2026Wasserstein Filtering: A Sample Selection Method for Robust Distribution Learning13 Aug 2026
- 2026Why Ranking Anomaly Detection Algorithms Isn't as Reliable as You May Think5 Aug 2026
12 newest of 213 All 213 (JSON)