Context Enhancement with Reconstruction as Sequence for Unified Unsupervised Anomaly Detection
Not on the map. Why?
Abstract (arXiv)
Unsupervised anomaly detection (AD) aims to train robust detection models using only normal samples, while can generalize well to unseen anomalies. Recent research focuses on a unified unsupervised AD setting in which only one model is trained for all classes, i.e., n-class-one-model paradigm. Feature-reconstruction-based methods achieve state-of-the-art performance in this scenario. However, existing methods often suffer from a lack of sufficient contextual awareness, thereby compromising the quality of the reconstruction. To address this issue, we introduce a novel Reconstruction as Sequence (RAS) method, which enhances the contextual correspondence during feature reconstruction from a sequence modeling perspective. In particular, based on the transformer technique, we integrate a specialized RASFormer block into RAS. This block enables the capture of spatial relationships among different image regions and enhances sequential dependencies throughout the reconstruction process. By incorporating the RASFormer block, our RAS method achieves superior contextual awareness capabilities, leading to remarkable performance. Experimental results show that our RAS significantly outperforms competing methods, well demonstrating the effectiveness and superiority of our method. Our code is available at https://github.com/Nothingtolose9979/RAS.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 40 of its 49 references that are in the map. First posted on arXiv 10 Sep 2024.
Builds on
40 of 49 references.
References · 40
- 2017Attention Is All You Needcited by 59,932
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
- 2020End-to-End Object Detection with Transformerscited by 7,384
- 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,415
- 2016Layer Normalizationcited by 5,579
- 2020On Layer Normalization in the Transformer Architecturecited by 906
- 2020PaDiM: a Patch Distribution Modeling Framework for Anomaly Detection and Localizationcited by 591
- 2021CutPaste: Self-Supervised Learning for Anomaly Detection and Localizationcited by 529
- 2021DRAEM -- A discriminatively trained reconstruction embedding for surface anomaly detectioncited by 510
28 more
- 2024YOLOv10: Real-Time End-to-End Object Detectioncited by 508
- 2018GANomaly: Semi-Supervised Anomaly Detection via Adversarial Trainingcited by 409
- 2022SPot-the-Difference Self-Supervised Pre-training for Anomaly Detection and Segmentationcited by 397
- 2019Uninformed Students: Student-Teacher Anomaly Detection with Discriminative Latent Embeddingscited by 386
- 2020Multiresolution Knowledge Distillation for Anomaly Detectioncited by 285
- 2018Deep Anomaly Detection Using Geometric Transformationscited by 269
- 2022A Unified Model for Multi-class Anomaly Detectioncited by 267
- 2018Improving Unsupervised Defect Segmentation by Applying Structural Similarity to Autoencoderscited by 263
- 2023SimpleNet: A Simple Network for Image Anomaly Detection and Localizationcited by 256
- 2022Diffusion Models for Medical Anomaly Detectioncited by 231
- 2021VT-ADL: A Vision Transformer Network for Image Anomaly Detection and Localizationcited by 222
- 2020Patch SVDD: Patch-level SVDD for Anomaly Detection and Segmentationcited by 212
- 2022DeSTSeg: Segmentation Guided Denoising Student-Teacher for Anomaly Detectioncited by 153
- 2022Registration based Few-Shot Anomaly Detectioncited by 133
- 2020Deep Learning for Medical Anomaly Detection -- A Surveycited by 127
- 2023RepViT: Revisiting Mobile CNN From ViT Perspectivecited by 123
- 2020IMRAM: Iterative Matching with Recurrent Attention Memory for Cross-Modal Image-Text Retrievalcited by 115
- 2020Modeling the Distribution of Normal Data in Pre-Trained Deep Features for Anomaly Detectioncited by 115
- 2019Towards Visually Explaining Variational Autoencoderscited by 113
- 2022MGFN: Magnitude-Contrastive Glance-and-Focus Network for Weakly-Supervised Video Anomaly Detectioncited by 87
- 2022PNI : Industrial Anomaly Detection using Position and Neighborhood Informationcited by 69
- 2020G2D: Generate to Detect Anomalycited by 42
- 2020Improved anomaly detection by training an autoencoder with skip connections on images corrupted with Stain-shaped noisecited by 39
- 2019GRN: Gated Relation Network to Enhance Convolutional Neural Network for Named Entity Recognitioncited by 18
- 2022Learning from Multiple Expert Annotators for Enhancing Anomaly Detection in Medical Image Analysiscited by 13
- 2023Learning Weakly Supervised Audio-Visual Violence Detection in Hyperbolic Spacecited by 12
- 2023Unilaterally Aggregated Contrastive Learning with Hierarchical Augmentation for Anomaly Detectioncited by 5
- 2023Divide and Conquer in Video Anomaly Detection: A Comprehensive Review and New Approachcited by 1
Built on by
Citing papers per year: 2025: 1.
1 paper.