Maskomaly:Zero-Shot Mask Anomaly Segmentation
Not on the map. Why?
Abstract (arXiv)
We present a simple and practical framework for anomaly segmentation called Maskomaly. It builds upon mask-based standard semantic segmentation networks by adding a simple inference-time post-processing step which leverages the raw mask outputs of such networks. Maskomaly does not require additional training and only adds a small computational overhead to inference. Most importantly, it does not require anomalous data at training. We show top results for our method on SMIYC, RoadAnomaly, and StreetHazards. On the most central benchmark, SMIYC, Maskomaly outperforms all directly comparable approaches. Further, we introduce a novel metric that benefits the development of robust anomaly segmentation methods and demonstrate its informativeness on RoadAnomaly.
Key facts. Cited by 34 papers in the map (data through 7 Oct 2026). Builds on 41 of its 52 references that are in the map. First posted on arXiv 26 May 2023.
Builds on
41 of 52 references.
References · 41
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
- 2014Explaining and Harnessing Adversarial Examplescited by 7,287
- 2016Simple and Scalable Predictive Uncertainty Estimation using Deep Ensemblescited by 3,888
- 2018Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentationcited by 3,210
- 2021SegFormer: Simple and Efficient Design for Semantic Segmentation with Transformerscited by 2,923
- 2016Pyramid Scene Parsing Networkcited by 2,472
- 2017CARLA: An Open Urban Driving Simulatorcited by 2,431
- 2016A Baseline for Detecting Misclassified and Out-of-Distribution Examples in Neural Networkscited by 2,362
- 2021Masked-attention Mask Transformer for Universal Image Segmentationcited by 2,338
- 2017Rethinking Atrous Convolution for Semantic Image Segmentationcited by 2,154
- 2017Enhancing The Reliability of Out-of-distribution Image Detection in Neural Networkscited by 1,325
29 more
- 2020Energy-based Out-of-distribution Detectioncited by 1,296
- 2021Per-Pixel Classification is Not All You Need for Semantic Segmentationcited by 1,148
- 2018Deep Anomaly Detection with Outlier Exposurecited by 939
- 2019Scaling Out-of-Distribution Detection for Real-World Settingscited by 465
- 2018Do Deep Generative Models Know What They Don't Know?cited by 443
- 2017Training Confidence-calibrated Classifiers for Detecting Out-of-Distribution Samplescited by 389
- 2019Input complexity and out-of-distribution detection with likelihood-based generative modelscited by 186
- 2021SegmentMeIfYouCan: A Benchmark for Anomaly Segmentationcited by 150
- 2019Detecting the Unexpected via Image Resynthesiscited by 137
- 2018Improving Semantic Segmentation via Video Propagation and Label Relaxationcited by 134
- 2020Entropy Maximization and Meta Classification for Out-Of-Distribution Detection in Semantic Segmentationcited by 133
- 2019The Fishyscapes Benchmark: Measuring Blind Spots in Semantic Segmentationcited by 122
- 2021Pixel-wise Anomaly Detection in Complex Driving Scenescited by 109
- 2022Is Out-of-Distribution Detection Learnable?cited by 109
- 2020Synthesize then Compare: Detecting Failures and Anomalies for Semantic Segmentationcited by 96
- 2021Understanding Failures in Out-of-Distribution Detection with Deep Generative Modelscited by 89
- 2022GMMSeg: Gaussian Mixture based Generative Semantic Segmentation Modelscited by 87
- 2021Pixel-wise Energy-biased Abstention Learning for Anomaly Segmentation on Complex Urban Driving Scenescited by 83
- 2021Standardized Max Logits: A Simple yet Effective Approach for Identifying Unexpected Road Obstacles in Urban-Scene Segmentationcited by 77
- 2019Simultaneous Semantic Segmentation and Outlier Detection in Presence of Domain Shiftcited by 54
- 2021Deep Metric Learning for Open World Semantic Segmentationcited by 51
- 2022DenseHybrid: Hybrid Anomaly Detection for Dense Open-set Recognitioncited by 42
- 2021Triggering Failures: Out-Of-Distribution detection by learning from local adversarial attacks in Semantic Segmentationcited by 40
- 2019TRADI: Tracking deep neural network weight distributions for uncertainty estimationcited by 39
- 2020Dense open-set recognition with synthetic outliers generated by Real NVPcited by 29
- 2020Detection and Retrieval of Out-of-Distribution Objects in Semantic Segmentationcited by 20
- 2019Efficient Ladder-style DenseNets for Semantic Segmentation of Large Imagescited by 17
- 2020One Versus all for deep Neural Network Incertitude (OVNNI) quantificationcited by 17
- 2023Hybrid Open-set Segmentation with Synthetic Negative Datacited by 8
Built on by
Citing papers per year: 2023: 3; 2024: 14; 2025: 11; 2026: 6.
34 papers.
Sort:
By area:
- 2024Outlier detection by ensembling uncertainty with negative objectnesscited by 34
- 2023Target before Shooting: Accurate Anomaly Detection and Localization under One Millisecond via Cascade Patch Retrievalcited by 22
- 2024Open-World Semantic Segmentation Including Class Similaritycited by 22
- 2023Mask2Anomaly: Mask Transformer for Universal Open-set Segmentationcited by 18
- 2024AnoVox: A Benchmark for Multimodal Anomaly Detection in Autonomous Drivingcited by 14
- 2025Out-of-Distribution Segmentation in Autonomous Driving: Problems and State of the Artcited by 13
- 2024A Likelihood Ratio-Based Approach to Segmenting Unknown Objectscited by 12
- 2023CoralVOS: Dataset and Benchmark for Coral Video Segmentationcited by 9
- 2024Diffusion for Out-of-Distribution Detection on Road Scenes and Beyondcited by 9
- 2025Prior2Former -- Evidential Modeling of Mask Transformers for Assumption-Free Open-World Panoptic Segmentationcited by 7
- 2024Finding Dino: A Plug-and-Play Framework for Zero-Shot Detection of Out-of-Distribution Objects Using Prototypescited by 5
- 2024MC-PanDA: Mask Confidence for Panoptic Domain Adaptationcited by 4
22 more
- 2024VL4AD: Vision-Language Models Improve Pixel-wise Anomaly Detectioncited by 4
- 2024UMAD: Unsupervised Mask-Level Anomaly Detection for Autonomous Drivingcited by 3
- 2024Segment-Level Road Obstacle Detection Using Visual Foundation Model Priors and Likelihood Ratioscited by 3
- 2024Multi-Scale Foreground-Background Confidence for Out-of-Distribution Segmentationcited by 3
- 2025Uncertainty-Aware Likelihood Ratio Estimation for Pixel-Wise Out-of-Distribution Detectioncited by 3
- 2024Open-World Panoptic Segmentationcited by 2
- 2025Out-of-Distribution Semantic Occupancy Predictioncited by 2
- 2025Road Obstacle Video Segmentationcited by 2
- 2024Random Walk on Pixel Manifolds for Anomaly Segmentation of Complex Driving Scenescited by 1
- 2025Anomalies by Synthesis: Anomaly Detection using Generative Diffusion Models for Off-Road Navigationcited by 1
- 2024Neural Network Meta Classifier: Improving the Reliability of Anomaly Segmentationcited by 0
- 2025Multi-modality Anomaly Segmentation on the Roadcited by 0
- 2025Panoramic Out-of-Distribution Segmentationcited by 0
- 2025Objectomaly: Objectness-Aware Refinement for OoD Segmentation with Structural Consistency and Boundary Precisioncited by 0
- 2025Training-Free Out-Of-Distribution Segmentation With Foundation Modelscited by 0
- 2025Language-Guided Open-World Anomaly Segmentationcited by 0
- 2026Vision-Language Feature Alignment for Road Anomaly Segmentationcited by 0
- 2026Road-Aware Anomaly Segmentation with Query-Guided Polygons and CLIP in Autonomous Drivingcited by 0
- 2026LARAD: Layout-Aware Road Anomaly Detection via Spatial-Logic Reasoningcited by 0
- 2026Combining Foundation Model Confidence and Monocular Depth for Training-Free Out-of-Distribution Segmentationcited by 0
- 2026SAFe: Segment-guided Aggregation of Feature Densities for Anomaly-aware Segmentationcited by 0
- 2026MC-PanDA++: Simpler, Stronger, and More Robust Domain-Adaptive Panoptic Segmentationcited by 0
- 2026MC-PanDA++: Simpler, Stronger, and More Robust Domain-Adaptive Panoptic Segmentation30 Sep 2026
- 2026SAFe: Segment-guided Aggregation of Feature Densities for Anomaly-aware Segmentation21 Sep 2026
- 2026Combining Foundation Model Confidence and Monocular Depth for Training-Free Out-of-Distribution Segmentation19 Sep 2026
- 2026LARAD: Layout-Aware Road Anomaly Detection via Spatial-Logic Reasoning14 Jul 2026
- 2026Road-Aware Anomaly Segmentation with Query-Guided Polygons and CLIP in Autonomous Driving5 Jul 2026
- 2026Vision-Language Feature Alignment for Road Anomaly Segmentation1 Mar 2026
- 2025Language-Guided Open-World Anomaly Segmentation1 Dec 2025
- 2025Training-Free Out-Of-Distribution Segmentation With Foundation Models3 Oct 2025
- 2025Road Obstacle Video Segmentation16 Sep 2025
- 2025Uncertainty-Aware Likelihood Ratio Estimation for Pixel-Wise Out-of-Distribution Detection1 Aug 2025
- 2025Objectomaly: Objectness-Aware Refinement for OoD Segmentation with Structural Consistency and Boundary Precision10 Jul 2025
- 2025Out-of-Distribution Semantic Occupancy Prediction26 Jun 2025
22 more
- 2025Anomalies by Synthesis: Anomaly Detection using Generative Diffusion Models for Off-Road Navigation28 May 2025
- 2025Panoramic Out-of-Distribution Segmentation6 May 2025
- 2025Prior2Former -- Evidential Modeling of Mask Transformers for Assumption-Free Open-World Panoptic Segmentation7 Apr 2025
- 2025Multi-modality Anomaly Segmentation on the Road22 Mar 2025
- 2025Out-of-Distribution Segmentation in Autonomous Driving: Problems and State of the Art4 Mar 2025
- 2024Multi-Scale Foreground-Background Confidence for Out-of-Distribution Segmentation22 Dec 2024
- 2024Open-World Panoptic Segmentation17 Dec 2024
- 2024Neural Network Meta Classifier: Improving the Reliability of Anomaly Segmentation14 Dec 2024
- 2024Segment-Level Road Obstacle Detection Using Visual Foundation Model Priors and Likelihood Ratios7 Dec 2024
- 2024VL4AD: Vision-Language Models Improve Pixel-wise Anomaly Detection25 Sep 2024
- 2024A Likelihood Ratio-Based Approach to Segmenting Unknown Objects10 Sep 2024
- 2024Diffusion for Out-of-Distribution Detection on Road Scenes and Beyond22 Jul 2024
- 2024MC-PanDA: Mask Confidence for Panoptic Domain Adaptation19 Jul 2024
- 2024UMAD: Unsupervised Mask-Level Anomaly Detection for Autonomous Driving10 Jun 2024
- 2024AnoVox: A Benchmark for Multimodal Anomaly Detection in Autonomous Driving13 May 2024
- 2024Random Walk on Pixel Manifolds for Anomaly Segmentation of Complex Driving Scenes27 Apr 2024
- 2024Finding Dino: A Plug-and-Play Framework for Zero-Shot Detection of Out-of-Distribution Objects Using Prototypes11 Apr 2024
- 2024Open-World Semantic Segmentation Including Class Similarity12 Mar 2024
- 2024Outlier detection by ensembling uncertainty with negative objectness23 Feb 2024
- 2023CoralVOS: Dataset and Benchmark for Coral Video Segmentation3 Oct 2023
- 2023Mask2Anomaly: Mask Transformer for Universal Open-set Segmentation8 Sep 2023
- 2023Target before Shooting: Accurate Anomaly Detection and Localization under One Millisecond via Cascade Patch Retrieval13 Aug 2023
- 2024Outlier detection by ensembling uncertainty with negative objectnesscited by 34
- 2023Target before Shooting: Accurate Anomaly Detection and Localization under One Millisecond via Cascade Patch Retrievalcited by 22
- 2024Open-World Semantic Segmentation Including Class Similaritycited by 22
- 2023Mask2Anomaly: Mask Transformer for Universal Open-set Segmentationcited by 18
- 2024AnoVox: A Benchmark for Multimodal Anomaly Detection in Autonomous Drivingcited by 14
- 2025Out-of-Distribution Segmentation in Autonomous Driving: Problems and State of the Artcited by 13
- 2024A Likelihood Ratio-Based Approach to Segmenting Unknown Objectscited by 12
- 2023CoralVOS: Dataset and Benchmark for Coral Video Segmentationcited by 9
- 2024Diffusion for Out-of-Distribution Detection on Road Scenes and Beyondcited by 9
- 2025Prior2Former -- Evidential Modeling of Mask Transformers for Assumption-Free Open-World Panoptic Segmentationcited by 7
- 2024Finding Dino: A Plug-and-Play Framework for Zero-Shot Detection of Out-of-Distribution Objects Using Prototypescited by 5
- 2024MC-PanDA: Mask Confidence for Panoptic Domain Adaptationcited by 4
12 most cited of 31 All 31 (JSON)
- 2026MC-PanDA++: Simpler, Stronger, and More Robust Domain-Adaptive Panoptic Segmentation30 Sep 2026
- 2026SAFe: Segment-guided Aggregation of Feature Densities for Anomaly-aware Segmentation21 Sep 2026
- 2026Combining Foundation Model Confidence and Monocular Depth for Training-Free Out-of-Distribution Segmentation19 Sep 2026
- 2026LARAD: Layout-Aware Road Anomaly Detection via Spatial-Logic Reasoning14 Jul 2026
- 2026Road-Aware Anomaly Segmentation with Query-Guided Polygons and CLIP in Autonomous Driving5 Jul 2026
- 2026Vision-Language Feature Alignment for Road Anomaly Segmentation1 Mar 2026
- 2025Language-Guided Open-World Anomaly Segmentation1 Dec 2025
- 2025Training-Free Out-Of-Distribution Segmentation With Foundation Models3 Oct 2025
- 2025Road Obstacle Video Segmentation16 Sep 2025
- 2025Uncertainty-Aware Likelihood Ratio Estimation for Pixel-Wise Out-of-Distribution Detection1 Aug 2025
- 2025Objectomaly: Objectness-Aware Refinement for OoD Segmentation with Structural Consistency and Boundary Precision10 Jul 2025
- 2025Out-of-Distribution Semantic Occupancy Prediction26 Jun 2025
12 newest of 31 All 31 (JSON)