Toward Unsupervised Outlier Model Selection
Not on the map. Why?
Abstract (arXiv)
Today there exists no shortage of outlier detection algorithms in the literature, yet the complementary and critical problem of unsupervised outlier model selection (UOMS) is vastly understudied. In this work we propose ELECT, a new approach to select an effective candidate model, i.e. an outlier detection algorithm and its hyperparameter(s), to employ on a new dataset without any labels. At its core, ELECT is based on meta-learning; transferring prior knowledge (e.g. model performance) on historical datasets that are similar to the new one to facilitate UOMS. Uniquely, it employs a dataset similarity measure that is performance-based, which is more direct and goal-driven than other measures used in the past. ELECT adaptively searches for similar historical datasets, as such, it can serve an output on-demand, being able to accommodate varying time budgets. Extensive experiments show that ELECT significantly outperforms a wide range of basic UOMS baselines, including no model selection (always using the same popular model such as iForest) as well as more recent selection strategies based on meta-features.
Key facts. Cited by 19 papers in the map (data through 14 Oct 2026). Builds on 15 of its 49 references that are in the map. First posted on arXiv 3 Nov 2022.
Builds on
15 of 49 references.
References · 15
- 2016Hyperband: A Novel Bandit-Based Approach to Hyperparameter Optimizationcited by 699
- 2019AutoML: A Survey of the State-of-the-Artcited by 390
- 2018Meta-Learning: A Surveycited by 256
- 2022ADBench: Anomaly Detection Benchmarkcited by 232
- 2019PyOD: A Python Toolbox for Scalable Outlier Detectioncited by 222
- 2020On Hyperparameter Optimization of Machine Learning Algorithms: Theory and Practicecited by 182
- 2020Deep Learning for Anomaly Detection: A Reviewcited by 159
- 2018Model Evaluation, Model Selection, and Algorithm Selection in Machine Learningcited by 157
- 2022Constrained Efficient Global Optimization of Expensive Black-box Functionscited by 49
- 2019Unsupervised Model Selection for Variational Disentangled Representation Learningcited by 46
- 2020Benchmarking Unsupervised Outlier Detection with Realistic Synthetic Datacited by 25
- 2016How to Evaluate the Quality of Unsupervised Anomaly Detection Algorithms?cited by 24
Built on by
Citing papers per year: 2023: 7; 2024: 5; 2025: 4; 2026: 3.
19 papers.
Sort:
By area:
- 2024MetaOOD: Automatic Selection of OOD Detection Modelscited by 16
- 2023ADGym: Design Choices for Deep Anomaly Detectioncited by 11
- 2025ClimateLLM: Efficient Weather Forecasting via Frequency-Aware Large Language Modelscited by 9
- 2026From Zero to Hero: Advancing Zero-Shot Foundation Models for Tabular Outlier Detectioncited by 9
- 2023Model Selection of Anomaly Detectors in the Absence of Labeled Validation Datacited by 8
- 2024On the Detection of Reviewer-Author Collusion Rings From Paper Biddingcited by 7
- 2025mTSBench: Benchmarking Multivariate Time Series Anomaly Detection and Model Selection at Scalecited by 7
- 2023DSV: An Alignment Validation Loss for Self-supervised Outlier Model Selectioncited by 6
- 2023Fast Unsupervised Deep Outlier Model Selection with Hypernetworkscited by 6
- 2023Towards Robust Multi-Modal Reasoning via Model Selectioncited by 6
- 2024Ranked from Within: Ranking Large Multimodal Models Without Labelscited by 5
- 2023Self-Supervision for Tackling Unsupervised Anomaly Detection: Pitfalls and Opportunitiescited by 2
7 more
- 2024Robust Statistical Scaling of Outlier Scores: Improving the Quality of Outlier Probabilities for Outliers (Extended Version)cited by 1
- 2023Do Ensembling and Meta-Learning Improve Outlier Detection in Randomized Controlled Trials?cited by 0
- 2024End-To-End Self-Tuning Self-Supervised Time Series Anomaly Detectioncited by 0
- 2025UniOD: A Universal Model for Outlier Detection across Diverse Domainscited by 0
- 2025Reasoning-based Anomaly Detection Framework: A Real-time, Scalable, and Automated Approach to Anomaly Detection Across Domainscited by 0
- 2026Automatic Unsupervised Ensemble Outlier Model Selection--Extended Versioncited by 0
- 2026OneShot: Label-Efficient Detector Weighting for Time Series Anomaly Detectioncited by 0
- 2026OneShot: Label-Efficient Detector Weighting for Time Series Anomaly Detection12 Oct 2026
- 2026Automatic Unsupervised Ensemble Outlier Model Selection--Extended Version15 May 2026
- 2026From Zero to Hero: Advancing Zero-Shot Foundation Models for Tabular Outlier Detection3 Feb 2026
- 2025Reasoning-based Anomaly Detection Framework: A Real-time, Scalable, and Automated Approach to Anomaly Detection Across Domains3 Oct 2025
- 2025UniOD: A Universal Model for Outlier Detection across Diverse Domains9 Jul 2025
- 2025mTSBench: Benchmarking Multivariate Time Series Anomaly Detection and Model Selection at Scale26 Jun 2025
- 2025ClimateLLM: Efficient Weather Forecasting via Frequency-Aware Large Language Models16 Feb 2025
- 2024Ranked from Within: Ranking Large Multimodal Models Without Labels9 Dec 2024
- 2024MetaOOD: Automatic Selection of OOD Detection Models4 Oct 2024
- 2024Robust Statistical Scaling of Outlier Scores: Improving the Quality of Outlier Probabilities for Outliers (Extended Version)28 Aug 2024
- 2024End-To-End Self-Tuning Self-Supervised Time Series Anomaly Detection3 Apr 2024
- 2024On the Detection of Reviewer-Author Collusion Rings From Paper Bidding12 Feb 2024
7 more
- 2023Do Ensembling and Meta-Learning Improve Outlier Detection in Randomized Controlled Trials?9 Nov 2023
- 2023Model Selection of Anomaly Detectors in the Absence of Labeled Validation Data16 Oct 2023
- 2023Towards Robust Multi-Modal Reasoning via Model Selection12 Oct 2023
- 2023ADGym: Design Choices for Deep Anomaly Detection27 Sep 2023
- 2023Self-Supervision for Tackling Unsupervised Anomaly Detection: Pitfalls and Opportunities28 Aug 2023
- 2023Fast Unsupervised Deep Outlier Model Selection with Hypernetworks20 Jul 2023
- 2023DSV: An Alignment Validation Loss for Self-supervised Outlier Model Selection13 Jul 2023
- 2023Towards Robust Multi-Modal Reasoning via Model Selectioncited by 6
- 2023Towards Robust Multi-Modal Reasoning via Model Selection12 Oct 2023
- 2024MetaOOD: Automatic Selection of OOD Detection Modelscited by 16
- 2023ADGym: Design Choices for Deep Anomaly Detectioncited by 11
- 2026From Zero to Hero: Advancing Zero-Shot Foundation Models for Tabular Outlier Detectioncited by 9
- 2023Model Selection of Anomaly Detectors in the Absence of Labeled Validation Datacited by 8
- 2024On the Detection of Reviewer-Author Collusion Rings From Paper Biddingcited by 7
- 2025mTSBench: Benchmarking Multivariate Time Series Anomaly Detection and Model Selection at Scalecited by 7
- 2023DSV: An Alignment Validation Loss for Self-supervised Outlier Model Selectioncited by 6
- 2023Fast Unsupervised Deep Outlier Model Selection with Hypernetworkscited by 6
- 2023Self-Supervision for Tackling Unsupervised Anomaly Detection: Pitfalls and Opportunitiescited by 2
- 2024Robust Statistical Scaling of Outlier Scores: Improving the Quality of Outlier Probabilities for Outliers (Extended Version)cited by 1
- 2023Do Ensembling and Meta-Learning Improve Outlier Detection in Randomized Controlled Trials?cited by 0
- 2024End-To-End Self-Tuning Self-Supervised Time Series Anomaly Detectioncited by 0
12 most cited of 16 All 16 (JSON)
- 2026OneShot: Label-Efficient Detector Weighting for Time Series Anomaly Detection12 Oct 2026
- 2026Automatic Unsupervised Ensemble Outlier Model Selection--Extended Version15 May 2026
- 2026From Zero to Hero: Advancing Zero-Shot Foundation Models for Tabular Outlier Detection3 Feb 2026
- 2025Reasoning-based Anomaly Detection Framework: A Real-time, Scalable, and Automated Approach to Anomaly Detection Across Domains3 Oct 2025
- 2025UniOD: A Universal Model for Outlier Detection across Diverse Domains9 Jul 2025
- 2025mTSBench: Benchmarking Multivariate Time Series Anomaly Detection and Model Selection at Scale26 Jun 2025
- 2024MetaOOD: Automatic Selection of OOD Detection Models4 Oct 2024
- 2024Robust Statistical Scaling of Outlier Scores: Improving the Quality of Outlier Probabilities for Outliers (Extended Version)28 Aug 2024
- 2024End-To-End Self-Tuning Self-Supervised Time Series Anomaly Detection3 Apr 2024
- 2024On the Detection of Reviewer-Author Collusion Rings From Paper Bidding12 Feb 2024
- 2023Do Ensembling and Meta-Learning Improve Outlier Detection in Randomized Controlled Trials?9 Nov 2023
- 2023Model Selection of Anomaly Detectors in the Absence of Labeled Validation Data16 Oct 2023
12 newest of 16 All 16 (JSON)