mlsanityData to 7 Oct 2026

Context Enhancement with Reconstruction as Sequence for Unified Unsupervised Anomaly Detection

arXiv 2409.06285 ↗First posted 10 Sep 2024cs.CVcited by 1

Not on the map. Why?

Abstract (arXiv)

Unsupervised anomaly detection (AD) aims to train robust detection models using only normal samples, while can generalize well to unseen anomalies. Recent research focuses on a unified unsupervised AD setting in which only one model is trained for all classes, i.e., n-class-one-model paradigm. Feature-reconstruction-based methods achieve state-of-the-art performance in this scenario. However, existing methods often suffer from a lack of sufficient contextual awareness, thereby compromising the quality of the reconstruction. To address this issue, we introduce a novel Reconstruction as Sequence (RAS) method, which enhances the contextual correspondence during feature reconstruction from a sequence modeling perspective. In particular, based on the transformer technique, we integrate a specialized RASFormer block into RAS. This block enables the capture of spatial relationships among different image regions and enhances sequential dependencies throughout the reconstruction process. By incorporating the RASFormer block, our RAS method achieves superior contextual awareness capabilities, leading to remarkable performance. Experimental results show that our RAS significantly outperforms competing methods, well demonstrating the effectiveness and superiority of our method. Our code is available at https://github.com/Nothingtolose9979/RAS.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 40 of its 49 references that are in the map. First posted on arXiv 10 Sep 2024.

Builds on

40 of 49 references.

References · 40

  1. 2017Attention Is All You Needcited by 59,932
  2. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  3. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  4. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  5. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
  6. 2020End-to-End Object Detection with Transformerscited by 7,384
  7. 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,415
  8. 2016Layer Normalizationcited by 5,579
  9. 2020On Layer Normalization in the Transformer Architecturecited by 906
  10. 2020PaDiM: a Patch Distribution Modeling Framework for Anomaly Detection and Localizationcited by 591
  11. 2021CutPaste: Self-Supervised Learning for Anomaly Detection and Localizationcited by 529
  12. 2021DRAEM -- A discriminatively trained reconstruction embedding for surface anomaly detectioncited by 510
28 more
  1. 2024YOLOv10: Real-Time End-to-End Object Detectioncited by 508
  2. 2018GANomaly: Semi-Supervised Anomaly Detection via Adversarial Trainingcited by 409
  3. 2022SPot-the-Difference Self-Supervised Pre-training for Anomaly Detection and Segmentationcited by 397
  4. 2019Uninformed Students: Student-Teacher Anomaly Detection with Discriminative Latent Embeddingscited by 386
  5. 2020Multiresolution Knowledge Distillation for Anomaly Detectioncited by 285
  6. 2018Deep Anomaly Detection Using Geometric Transformationscited by 269
  7. 2022A Unified Model for Multi-class Anomaly Detectioncited by 267
  8. 2018Improving Unsupervised Defect Segmentation by Applying Structural Similarity to Autoencoderscited by 263
  9. 2023SimpleNet: A Simple Network for Image Anomaly Detection and Localizationcited by 256
  10. 2022Diffusion Models for Medical Anomaly Detectioncited by 231
  11. 2021VT-ADL: A Vision Transformer Network for Image Anomaly Detection and Localizationcited by 222
  12. 2020Patch SVDD: Patch-level SVDD for Anomaly Detection and Segmentationcited by 212
  13. 2022DeSTSeg: Segmentation Guided Denoising Student-Teacher for Anomaly Detectioncited by 153
  14. 2022Registration based Few-Shot Anomaly Detectioncited by 133
  15. 2020Deep Learning for Medical Anomaly Detection -- A Surveycited by 127
  16. 2023RepViT: Revisiting Mobile CNN From ViT Perspectivecited by 123
  17. 2020IMRAM: Iterative Matching with Recurrent Attention Memory for Cross-Modal Image-Text Retrievalcited by 115
  18. 2020Modeling the Distribution of Normal Data in Pre-Trained Deep Features for Anomaly Detectioncited by 115
  19. 2019Towards Visually Explaining Variational Autoencoderscited by 113
  20. 2022MGFN: Magnitude-Contrastive Glance-and-Focus Network for Weakly-Supervised Video Anomaly Detectioncited by 87
  21. 2022PNI : Industrial Anomaly Detection using Position and Neighborhood Informationcited by 69
  22. 2020G2D: Generate to Detect Anomalycited by 42
  23. 2020Improved anomaly detection by training an autoencoder with skip connections on images corrupted with Stain-shaped noisecited by 39
  24. 2019GRN: Gated Relation Network to Enhance Convolutional Neural Network for Named Entity Recognitioncited by 18
  25. 2022Learning from Multiple Expert Annotators for Enhancing Anomaly Detection in Medical Image Analysiscited by 13
  26. 2023Learning Weakly Supervised Audio-Visual Violence Detection in Hyperbolic Spacecited by 12
  27. 2023Unilaterally Aggregated Contrastive Learning with Hierarchical Augmentation for Anomaly Detectioncited by 5
  28. 2023Divide and Conquer in Video Anomaly Detection: A Comprehensive Review and New Approachcited by 1

Built on by

Cited by year

Citing papers per year: 2025: 1.

1 paper.