Watermarking for Out-of-distribution Detection
Not on the map. Why?
Abstract (arXiv)
Out-of-distribution (OOD) detection aims to identify OOD data based on representations extracted from well-trained deep models. However, existing methods largely ignore the reprogramming property of deep models and thus may not fully unleash their intrinsic strength: without modifying parameters of a well-trained deep model, we can reprogram this model for a new purpose via data-level manipulation (e.g., adding a specific feature perturbation to the data). This property motivates us to reprogram a classification model to excel at OOD detection (a new task), and thus we propose a general methodology named watermarking in this paper. Specifically, we learn a unified pattern that is superimposed onto features of original data, and the model's detection capability is largely boosted after watermarking. Extensive experiments verify the effectiveness of watermarking, demonstrating the significance of the reprogramming property of deep models in OOD detection.
Key facts. Cited by 28 papers in the map (data through 14 Oct 2026). Builds on 52 of its 77 references that are in the map. First posted on arXiv 27 Oct 2022.
Builds on
52 of 77 references.
References · 52
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2014ImageNet Large Scale Visual Recognition Challengecited by 8,498
- 2014Explaining and Harnessing Adversarial Examplescited by 7,364
- 2017Towards Deep Learning Models Resistant to Adversarial Attackscited by 6,415
- 2016Wide Residual Networkscited by 3,070
- 2016A Baseline for Detecting Misclassified and Out-of-Distribution Examples in Neural Networkscited by 2,385
- 2013Describing Textures in the Wildcited by 2,125
- 2018A Simple Unified Framework for Detecting Out-of-Distribution Samples and Adversarial Attackscited by 1,485
- 2020Sharpness-Aware Minimization for Efficiently Improving Generalizationcited by 1,417
- 2015LSUN: Construction of a Large-scale Image Dataset using Deep Learning with Humans in the Loopcited by 1,355
- 2016On Large-Batch Training for Deep Learning: Generalization Gap and Sharp Minimacited by 1,352
38 more
- 2017Enhancing The Reliability of Out-of-distribution Image Detection in Neural Networkscited by 1,328
- 2020Energy-based Out-of-distribution Detectioncited by 1,299
- 2018Deep Anomaly Detection with Outlier Exposurecited by 942
- 2019AugMix: A Simple Data Processing Method to Improve Robustness and Uncertaintycited by 901
- 2021Generalized Out-of-Distribution Detection: A Surveycited by 802
- 2014Deep Neural Networks are Easily Fooled: High Confidence Predictions for Unrecognizable Imagescited by 776
- 2021ReAct: Out-of-distribution Detection With Rectified Activationscited by 486
- 2019Likelihood Ratios for Out-of-Distribution Detectioncited by 453
- 2018Do Deep Generative Models Know What They Don't Know?cited by 443
- 2020CSI: Novelty Detection via Contrastive Learning on Distributionally Shifted Instancescited by 441
- 2020Backdoor Learning: A Surveycited by 426
- 2019Hidden Trigger Backdoor Attackscited by 371
- 2020Invisible Backdoor Attack with Sample-Specific Triggerscited by 353
- 2020Reflection Backdoor: A Natural Backdoor Attack on Deep Neural Networkscited by 349
- 2021On the Importance of Gradients for Detecting Distributional Shifts in the Wildcited by 339
- 2018Why ReLU networks yield high-confidence predictions far away from the training data and how to mitigate the problemcited by 323
- 2019On Mixup Training: Improved Calibration and Predictive Uncertainty for Deep Neural Networkscited by 305
- 2018Learning Confidence for Out-of-Distribution Detection in Neural Networkscited by 245
- 2021MOS: Towards Scaling Out-of-distribution Detection for Large Semantic Spacecited by 233
- 2020Why Normalizing Flows Fail to Detect Out-of-Distribution Datacited by 221
- 2021WARP: Word-level Adversarial ReProgrammingcited by 221
- 2021A Simple Fix to Mahalanobis Distance for Improving Near-OOD Detectioncited by 207
- 2019Input complexity and out-of-distribution detection with likelihood-based generative modelscited by 186
- 2020Contrastive Training for Improved Out-of-Distribution Detectioncited by 186
- 2015TurkerGaze: Crowdsourcing Saliency with Webcam based Eye Trackingcited by 165
- 2020Likelihood Regret: An Out-of-Distribution Detection Score For Variational Auto-encodercited by 145
- 2018Adversarial Reprogramming of Neural Networkscited by 116
- 2021Can multi-label classification networks know what they don't know?cited by 100
- 2021Voice2Series: Reprogramming Acoustic Models for Time Series Classificationcited by 91
- 2021Understanding Failures in Out-of-Distribution Detection with Deep Generative Modelscited by 89
- 2020Transfer Learning without Knowing: Reprogramming Black-box Machine Learning Models with Scarce Data and Limited Resourcescited by 83
- 2021Provable Guarantees for Understanding Out-of-distribution Detectioncited by 78
- 2021Probabilistic Margins for Instance Reweighting in Adversarial Trainingcited by 57
- 2019Out-of-distribution Detection in Classifiers via Generationcited by 49
- 2020Feature Space Singularity for Out-of-Distribution Detectioncited by 49
- 2021Energy-Based Open-World Uncertainty Modeling for Confidence Calibrationcited by 46
- 2022Harnessing Out-Of-Distribution Examples via Augmenting Content and Stylecited by 43
- 2020A Boundary Based Out-of-Distribution Classifier for Generalized Zero-Shot Learningcited by 34
50 most cited of 52 All 52 (JSON)
Built on by
Citing papers per year: 2023: 10; 2024: 14; 2025: 1; 2026: 3.
28 papers.
Sort:
By area:
- 2023Out-of-distribution Detection with Implicit Outlier Transformationcited by 43
- 2024How Does Unlabeled Data Provably Help Out-of-Distribution Detection?cited by 36
- 2024Envisioning Outlier Exposure by Large Language Models for Out-of-Distribution Detectioncited by 32
- 2023Out-of-distribution Detection Learning with Unreliable Out-of-distribution Sourcescited by 31
- 2023Robust Generalization against Photon-Limited Corruptions via Worst-Case Sharpness Minimizationcited by 29
- 2024Unexplored Faces of Robustness and Out-of-Distribution: Covariate Shifts in Environment and Sensor Domainscited by 22
- 2023FlatMatch: Bridging Labeled Data and Unlabeled Data with Cross-Sharpness for Semi-Supervised Learningcited by 20
- 2024Sample-specific Masks for Visual Reprogramming-based Promptingcited by 18
- 2023Plugin estimators for selective classification with out-of-distribution detectioncited by 14
- 2023Winning Prize Comes from Losing Tickets: Improve Invariant Learning by Exploring Variant Parameters for Out-of-Distribution Generalizationcited by 12
- 2024Bayesian-guided Label Mapping for Visual Reprogrammingcited by 12
- 2023Meta OOD Learning for Continuously Adaptive OOD Detectioncited by 10
16 more
- 2023Moderately Distributional Exploration for Domain Generalizationcited by 8
- 2024RAW: A Robust and Agile Plug-and-Play Watermark Framework for AI-Generated Images with Provable Guaranteescited by 8
- 2024CLIP-driven Outliers Synthesis for few-shot OOD detectioncited by 6
- 2024When and How Does In-Distribution Label Help Out-of-Distribution Detection?cited by 6
- 2024What If the Input is Expanded in OOD Detection?cited by 4
- 2024HGOE: Hybrid External and Internal Graph Outlier Exposure for Graph Out-of-Distribution Detectioncited by 3
- 2024Enhancing Joint Motion Prediction for Individuals with Limb Loss Through Model Reprogrammingcited by 2
- 2024Improving Out-of-Distribution Detection by Combining Existing Post-hoc Methodscited by 2
- 2025Medix: Out-of-Distribution Detection from Unlabeled Wild Data via Robust Gradient Statisticscited by 2
- 2023SODA: Robust Training of Test-Time Data Adaptorscited by 1
- 2024BlockDoor: Blocking Backdoor Based Watermarks in Deep Neural Networkscited by 1
- 2023Distilling the Unknown to Unveil Certaintycited by 0
- 2024DataCook: Crafting Anti-Adversarial Examples for Healthcare Data Copyright Protectioncited by 0
- 2026Vision Also You Need: Navigating Out-of-Distribution Detection with Multimodal Large Language Modelcited by 0
- 2026Disentangled Graph Prompting for Out-Of-Distribution Detectioncited by 0
- 2026Neural Distribution Prior for LiDAR Out-of-Distribution Detectioncited by 0
- 2026Neural Distribution Prior for LiDAR Out-of-Distribution Detection10 Apr 2026
- 2026Disentangled Graph Prompting for Out-Of-Distribution Detection31 Mar 2026
- 2026Vision Also You Need: Navigating Out-of-Distribution Detection with Multimodal Large Language Model20 Jan 2026
- 2025Medix: Out-of-Distribution Detection from Unlabeled Wild Data via Robust Gradient Statistics7 Oct 2025
- 2024BlockDoor: Blocking Backdoor Based Watermarks in Deep Neural Networks14 Dec 2024
- 2024Bayesian-guided Label Mapping for Visual Reprogramming31 Oct 2024
- 2024What If the Input is Expanded in OOD Detection?24 Oct 2024
- 2024HGOE: Hybrid External and Internal Graph Outlier Exposure for Graph Out-of-Distribution Detection31 Jul 2024
- 2024Improving Out-of-Distribution Detection by Combining Existing Post-hoc Methods9 Jul 2024
- 2024Sample-specific Masks for Visual Reprogramming-based Prompting5 Jun 2024
- 2024Envisioning Outlier Exposure by Large Language Models for Out-of-Distribution Detection2 Jun 2024
- 2024When and How Does In-Distribution Label Help Out-of-Distribution Detection?28 May 2024
16 more
- 2024Unexplored Faces of Robustness and Out-of-Distribution: Covariate Shifts in Environment and Sensor Domains24 Apr 2024
- 2024CLIP-driven Outliers Synthesis for few-shot OOD detection30 Mar 2024
- 2024DataCook: Crafting Anti-Adversarial Examples for Healthcare Data Copyright Protection26 Mar 2024
- 2024Enhancing Joint Motion Prediction for Individuals with Limb Loss Through Model Reprogramming11 Mar 2024
- 2024How Does Unlabeled Data Provably Help Out-of-Distribution Detection?5 Feb 2024
- 2024RAW: A Robust and Agile Plug-and-Play Watermark Framework for AI-Generated Images with Provable Guarantees23 Jan 2024
- 2023Distilling the Unknown to Unveil Certainty14 Nov 2023
- 2023Out-of-distribution Detection Learning with Unreliable Out-of-distribution Sources6 Nov 2023
- 2023FlatMatch: Bridging Labeled Data and Unlabeled Data with Cross-Sharpness for Semi-Supervised Learning25 Oct 2023
- 2023Winning Prize Comes from Losing Tickets: Improve Invariant Learning by Exploring Variant Parameters for Out-of-Distribution Generalization25 Oct 2023
- 2023SODA: Robust Training of Test-Time Data Adaptors17 Oct 2023
- 2023Meta OOD Learning for Continuously Adaptive OOD Detection21 Sep 2023
- 2023Moderately Distributional Exploration for Domain Generalization27 Apr 2023
- 2023Robust Generalization against Photon-Limited Corruptions via Worst-Case Sharpness Minimization23 Mar 2023
- 2023Out-of-distribution Detection with Implicit Outlier Transformation9 Mar 2023
- 2023Plugin estimators for selective classification with out-of-distribution detection29 Jan 2023
- 2023Out-of-distribution Detection with Implicit Outlier Transformationcited by 43
- 2024How Does Unlabeled Data Provably Help Out-of-Distribution Detection?cited by 36
- 2024Envisioning Outlier Exposure by Large Language Models for Out-of-Distribution Detectioncited by 32
- 2023Out-of-distribution Detection Learning with Unreliable Out-of-distribution Sourcescited by 31
- 2023Robust Generalization against Photon-Limited Corruptions via Worst-Case Sharpness Minimizationcited by 29
- 2024Unexplored Faces of Robustness and Out-of-Distribution: Covariate Shifts in Environment and Sensor Domainscited by 22
- 2023FlatMatch: Bridging Labeled Data and Unlabeled Data with Cross-Sharpness for Semi-Supervised Learningcited by 20
- 2024Sample-specific Masks for Visual Reprogramming-based Promptingcited by 18
- 2023Plugin estimators for selective classification with out-of-distribution detectioncited by 14
- 2023Winning Prize Comes from Losing Tickets: Improve Invariant Learning by Exploring Variant Parameters for Out-of-Distribution Generalizationcited by 12
- 2024Bayesian-guided Label Mapping for Visual Reprogrammingcited by 12
- 2023Meta OOD Learning for Continuously Adaptive OOD Detectioncited by 10
12 most cited of 26 All 26 (JSON)
- 2026Neural Distribution Prior for LiDAR Out-of-Distribution Detection10 Apr 2026
- 2026Disentangled Graph Prompting for Out-Of-Distribution Detection31 Mar 2026
- 2025Medix: Out-of-Distribution Detection from Unlabeled Wild Data via Robust Gradient Statistics7 Oct 2025
- 2024BlockDoor: Blocking Backdoor Based Watermarks in Deep Neural Networks14 Dec 2024
- 2024Bayesian-guided Label Mapping for Visual Reprogramming31 Oct 2024
- 2024What If the Input is Expanded in OOD Detection?24 Oct 2024
- 2024HGOE: Hybrid External and Internal Graph Outlier Exposure for Graph Out-of-Distribution Detection31 Jul 2024
- 2024Improving Out-of-Distribution Detection by Combining Existing Post-hoc Methods9 Jul 2024
- 2024Sample-specific Masks for Visual Reprogramming-based Prompting5 Jun 2024
- 2024Envisioning Outlier Exposure by Large Language Models for Out-of-Distribution Detection2 Jun 2024
- 2024When and How Does In-Distribution Label Help Out-of-Distribution Detection?28 May 2024
- 2024Unexplored Faces of Robustness and Out-of-Distribution: Covariate Shifts in Environment and Sensor Domains24 Apr 2024
12 newest of 26 All 26 (JSON)
Similar, not cited
Close in wording, no citation either way
- 2024Exploiting Diffusion Prior for Out-of-Distribution Detection
- 2025Revisiting Likelihood-Based Out-of-Distribution Detection by Modeling Representations
- 2025Recent Advances in Out-of-Distribution Detection with CLIP-Like Models: A Survey
- 2025COOkeD: Ensemble-based OOD detection in the era of zero-shot CLIP
- 2023Safe and Robust Watermark Injection with a Single OoD Image
- 2024Beyond Perceptual Distance: Discrepancy Assessment on Deep Representation for Out-of-Distribution Detection with Diffusion Model
- 2024Detecting Out-of-Distribution Objects through Class-Conditioned Inpainting
- 2024Can OOD Object Detectors Learn from Foundation Models?