mlsanityData to 14 Oct 2026

Diff-CAPTCHA: An Image-based CAPTCHA with Security Enhanced by Denoising Diffusion Model

arXiv 2308.08367 ↗First posted 16 Aug 2023cs.CR cs.CVcited by 3

On the map: Diffusion models → Image generation, text-to-image and editing

Abstract (arXiv)

To enhance the security of text CAPTCHAs, various methods have been employed, such as adding the interference lines on the text, randomly distorting the characters, and overlapping multiple characters. These methods partly increase the difficulty of automated segmentation and recognition attacks. However, facing the rapid development of the end-to-end breaking algorithms, their security has been greatly weakened. The diffusion model is a novel image generation model that can generate the text images with deep fusion of characters and background images. In this paper, an image-click CAPTCHA scheme called Diff-CAPTCHA is proposed based on denoising diffusion models. The background image and characters of the CAPTCHA are treated as a whole to guide the generation process of a diffusion model, thus weakening the character features available for machine learning, enhancing the diversity of character features in the CAPTCHA, and increasing the difficulty of breaking algorithms. To evaluate the security of Diff-CAPTCHA, this paper develops several attack methods, including end-to-end attacks based on Faster R-CNN and two-stage attacks, and Diff-CAPTCHA is compared with three baseline schemes, including commercial CAPTCHA scheme and security-enhanced CAPTCHA scheme based on style transfer. The experimental results show that diffusion models can effectively enhance CAPTCHA security while maintaining good usability in human testing.

Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Placed in Image generation, text-to-image and editing, one of 14 directions in Diffusion models. Builds on 15 of its 37 references that are in the map. First posted on arXiv 16 Aug 2023.

Builds on

15 of 37 references.

References · 15

  1. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  2. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  3. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
  4. 2020Denoising Diffusion Implicit Modelscited by 9,781
  5. 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,639
  6. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
  7. 2017Mask R-CNNcited by 7,277
  8. 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,442
  9. 2022Classifier-Free Diffusion Guidancecited by 5,847
  10. 2016Feature Pyramid Networks for Object Detectioncited by 5,036
  11. 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,937
  12. 2019Adversarial Training for Free!cited by 643
3 more
  1. 2021Recent Advances in Adversarial Training for Adversarial Robustnesscited by 279
  2. 2020An End-to-End Attack on Text-based CAPTCHAs Based on Cycle-Consistent Generative Adversarial Networkcited by 4
  3. 2021Robust Text CAPTCHAs Using Adversarial Examplescited by 4

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 2; 2026: 1.

3 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2022CLIP-Diffusion-LM: Apply Diffusion Model on Image Captioning
  2. 2023DiffCap: Exploring Continuous Diffusion on Image Captioning
  3. 2022Exploring Discrete Diffusion Models for Image Captioning
  4. 2023Intriguing Properties of Diffusion Models: An Empirical Study of the Natural Attack Capability in Text-to-Image Generative Models
  5. 2025COGNITION: From Evaluation to Defense against Multimodal LLM CAPTCHA Solvers
  6. 2023Prefix-diffusion: A Lightweight Diffusion Model for Diverse Image Captioning
  7. 2023Mitigate Replication and Copying in Diffusion Models with Generalized Caption and Dual Fusion Enhancement
  8. 2024DiffGuard: Text-Based Safety Checker for Diffusion Models