mlsanityData to 14 Oct 2026

EnSolver: Uncertainty-Aware Ensemble CAPTCHA Solvers with Theoretical Guarantees

arXiv 2307.15180 ↗First posted 27 Jul 2023cs.CV cs.CRcited by 0

Not on the map. Why?

Abstract (arXiv)

The popularity of text-based CAPTCHA as a security mechanism to protect websites from automated bots has prompted researches in CAPTCHA solvers, with the aim of understanding its failure cases and subsequently making CAPTCHAs more secure. Recently proposed solvers, built on advances in deep learning, are able to crack even the very challenging CAPTCHAs with high accuracy. However, these solvers often perform poorly on out-of-distribution samples that contain visual features different from those in the training set. Furthermore, they lack the ability to detect and avoid such samples, making them susceptible to being locked out by defense systems after a certain number of failed attempts. In this paper, we propose EnSolver, a family of CAPTCHA solvers that use deep ensemble uncertainty to detect and skip out-of-distribution CAPTCHAs, making it harder to be detected. We prove novel theoretical bounds on the effectiveness of our solvers and demonstrate their use with state-of-the-art CAPTCHA solvers. Our experiments show that the proposed approaches perform well when cracking CAPTCHA datasets that contain both in-distribution and out-of-distribution samples.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 23 of its 41 references that are in the map. First posted on arXiv 27 Jul 2023.

Builds on

23 of 41 references.

References · 23

  1. 2017On Calibration of Modern Neural Networkscited by 4,960
  2. 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,527
  3. 2015Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learningcited by 4,448
  4. 2016Simple and Scalable Predictive Uncertainty Estimation using Deep Ensemblescited by 3,926
  5. 2016A Baseline for Detecting Misclassified and Out-of-Distribution Examples in Neural Networkscited by 2,385
  6. 2019MMDetection: Open MMLab Detection Toolbox and Benchmarkcited by 1,385
  7. 2019Can You Trust Your Model's Uncertainty? Evaluating Predictive Uncertainty Under Dataset Shiftcited by 1,287
  8. 2021YOLOX: Exceeding YOLO Series in 2021cited by 1,071
  9. 2020A Review of Uncertainty Quantification in Deep Learning: Techniques, Applications and Challengescited by 819
  10. 2020Bayesian Deep Learning and a Probabilistic Perspective of Generalizationcited by 480
  11. 2017Regularizing Neural Networks by Penalizing Confident Output Distributionscited by 464
  12. 2019Deep Ensembles: A Loss Landscape Perspectivecited by 443
11 more
  1. 2014Stochastic Gradient Hamiltonian Monte Carlocited by 343
  2. 2019Cyclical Stochastic Gradient MCMC for Bayesian Deep Learningcited by 203
  3. 2021Repulsive Deep Ensembles are Bayesiancited by 104
  4. 2015Risk Bounds for the Majority Vote: From a PAC-Bayesian Analysis to a Learning Algorithmcited by 50
  5. 2020Second Order PAC-Bayesian Bounds for the Weighted Majority Votecited by 34
  6. 2021Diversity and Generalization in Neural Network Ensemblescited by 32
  7. 2023When are ensembles really effective?cited by 21
  8. 2020Deep-CAPTCHA: a deep learning based CAPTCHA solver for vulnerability assessmentcited by 11
  9. 2014Generalization and Robustness of Batched Weighted Average Algorithm with V-geometrically Ergodic Markov Datacited by 4
  10. 2020An End-to-End Attack on Text-based CAPTCHAs Based on Cycle-Consistent Generative Adversarial Networkcited by 4
  11. 2021Posterior concentration and fast convergence rates for generalized Bayesian learningcited by 2

Built on by

Not cited yet.