mlsanityData to 7 Oct 2026

Friend or Foe? Harnessing Controllable Overfitting for Anomaly Detection

arXiv 2412.00560 ↗First posted 30 Nov 2024cs.LG cs.AIcited by 2

Not on the map. Why?

Abstract (arXiv)

Overfitting has traditionally been viewed as detrimental to anomaly detection, where excessive generalization often limits models' sensitivity to subtle anomalies. Our work challenges this conventional view by introducing Controllable Overfitting-based Anomaly Detection (COAD), a novel framework that strategically leverages overfitting to enhance anomaly discrimination capabilities. We propose the Aberrance Retention Quotient (ARQ), a novel metric that systematically quantifies the extent of overfitting, enabling the identification of an optimal golden overfitting interval wherein model sensitivity to anomalies is maximized without sacrificing generalization. To comprehensively capture how overfitting affects detection performance, we further propose the Relative Anomaly Distribution Index (RADI), a metric superior to traditional AUROC by explicitly modeling the separation between normal and anomalous score distributions. Theoretically, RADI leverages ARQ to track and evaluate how overfitting impacts anomaly detection, offering an integrated approach to understanding the relationship between overfitting dynamics and model efficacy. We also rigorously validate the statistical efficacy of Gaussian noise as pseudo-anomaly generators, reinforcing the method's broad applicability. Empirical evaluations demonstrate that our controllable overfitting method achieves State-Of-The-Art(SOTA) performance in both one-class and multi-class anomaly detection tasks, thus redefining overfitting as a powerful strategy rather than a limitation.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 25 of its 37 references that are in the map. First posted on arXiv 30 Nov 2024.

Builds on

25 of 37 references.

References · 25

  1. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  2. 2021Towards Total Recall in Industrial Anomaly Detectioncited by 772
  3. 2020PaDiM: a Patch Distribution Modeling Framework for Anomaly Detection and Localizationcited by 591
  4. 2021CutPaste: Self-Supervised Learning for Anomaly Detection and Localizationcited by 529
  5. 2021DRAEM -- A discriminatively trained reconstruction embedding for surface anomaly detectioncited by 510
  6. 2022Anomaly Detection via Reverse Distillation from One-Class Embeddingcited by 419
  7. 2019Uninformed Students: Student-Teacher Anomaly Detection with Discriminative Latent Embeddingscited by 386
  8. 2021CFLOW-AD: Real-Time Unsupervised Anomaly Detection with Localization via Conditional Normalizing Flowscited by 320
  9. 2020Multiresolution Knowledge Distillation for Anomaly Detectioncited by 285
  10. 2022A Unified Model for Multi-class Anomaly Detectioncited by 267
  11. 2023SimpleNet: A Simple Network for Image Anomaly Detection and Localizationcited by 256
  12. 2020Patch SVDD: Patch-level SVDD for Anomaly Detection and Segmentationcited by 212
13 more
  1. 2024RealNet: A Feature Selection Network with Realistic Synthetic Anomaly for Anomaly Detectioncited by 116
  2. 2023AnomalyDiffusion: Few-Shot Anomaly Image Generation with Diffusion Modelcited by 110
  3. 2022DSR -- A dual subspace re-projection network for surface anomaly detectioncited by 89
  4. 2022Omni-frequency Channel-selection Representations for Unsupervised Anomaly Detectioncited by 79
  5. 2023PyramidFlow: High-Resolution Defect Contrastive Localization using Pyramid Normalizing Flowcited by 74
  6. 2024A Unified Anomaly Synthesis Strategy with Gradient Ascent for Industrial Anomaly Detection and Localizationcited by 74
  7. 2022Explicit Boundary Guided Semi-Push-Pull Contrastive Learning for Supervised Anomaly Detectioncited by 72
  8. 2023Hierarchical Vector Quantized Transformer for Multi-class Unsupervised Anomaly Detectioncited by 66
  9. 2022Rethinking Reconstruction Autoencoder-Based Out-of-Distribution Detectioncited by 59
  10. 2023TransFusion -- A Transparency-Based Diffusion Model for Anomaly Detectioncited by 43
  11. 2023DiAD: A Diffusion-based Framework for Multi-class Anomaly Detectioncited by 33
  12. 2024Dual-Modeling Decouple Distillation for Unsupervised Anomaly Detectioncited by 10
  13. 2023Restricted Generative Projection for One-Class Classification and Anomaly Detectioncited by 2

Built on by

Cited by year

Citing papers per year: 2025: 2.

2 papers.