Diff-CAPTCHA: An Image-based CAPTCHA with Security Enhanced by Denoising Diffusion Model
On the map: Diffusion models → Image generation, text-to-image and editing
Abstract (arXiv)
To enhance the security of text CAPTCHAs, various methods have been employed, such as adding the interference lines on the text, randomly distorting the characters, and overlapping multiple characters. These methods partly increase the difficulty of automated segmentation and recognition attacks. However, facing the rapid development of the end-to-end breaking algorithms, their security has been greatly weakened. The diffusion model is a novel image generation model that can generate the text images with deep fusion of characters and background images. In this paper, an image-click CAPTCHA scheme called Diff-CAPTCHA is proposed based on denoising diffusion models. The background image and characters of the CAPTCHA are treated as a whole to guide the generation process of a diffusion model, thus weakening the character features available for machine learning, enhancing the diversity of character features in the CAPTCHA, and increasing the difficulty of breaking algorithms. To evaluate the security of Diff-CAPTCHA, this paper develops several attack methods, including end-to-end attacks based on Faster R-CNN and two-stage attacks, and Diff-CAPTCHA is compared with three baseline schemes, including commercial CAPTCHA scheme and security-enhanced CAPTCHA scheme based on style transfer. The experimental results show that diffusion models can effectively enhance CAPTCHA security while maintaining good usability in human testing.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Placed in Image generation, text-to-image and editing, one of 14 directions in Diffusion models. Builds on 15 of its 37 references that are in the map. First posted on arXiv 16 Aug 2023.
Builds on
15 of 37 references.
References · 15
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
- 2020Denoising Diffusion Implicit Modelscited by 9,781
- 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,639
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
- 2017Mask R-CNNcited by 7,277
- 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,442
- 2022Classifier-Free Diffusion Guidancecited by 5,847
- 2016Feature Pyramid Networks for Object Detectioncited by 5,036
- 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,937
- 2019Adversarial Training for Free!cited by 643
Built on by
Citing papers per year: 2025: 2; 2026: 1.
3 papers.
- 2025MCA-Bench: A Multimodal Benchmark for Evaluating CAPTCHA Robustness Against VLM-based Attackscited by 11
- 2025Spatial CAPTCHA: Generatively Benchmarking Spatial Reasoning for Human-Machine Differentiationcited by 3
- 2026Adversarial Attacks for Good: A Survey of Proactive Protection across the Visual Content Lifecyclecited by 2
- 2026Adversarial Attacks for Good: A Survey of Proactive Protection across the Visual Content Lifecycle5 Aug 2026
- 2025Spatial CAPTCHA: Generatively Benchmarking Spatial Reasoning for Human-Machine Differentiation4 Oct 2025
- 2025MCA-Bench: A Multimodal Benchmark for Evaluating CAPTCHA Robustness Against VLM-based Attacks6 Jun 2025
Similar, not cited
Close in wording, no citation either way
- 2022CLIP-Diffusion-LM: Apply Diffusion Model on Image Captioning
- 2023DiffCap: Exploring Continuous Diffusion on Image Captioning
- 2022Exploring Discrete Diffusion Models for Image Captioning
- 2023Intriguing Properties of Diffusion Models: An Empirical Study of the Natural Attack Capability in Text-to-Image Generative Models
- 2025COGNITION: From Evaluation to Defense against Multimodal LLM CAPTCHA Solvers
- 2023Prefix-diffusion: A Lightweight Diffusion Model for Diverse Image Captioning
- 2023Mitigate Replication and Copying in Diffusion Models with Generalized Caption and Dual Fusion Enhancement
- 2024DiffGuard: Text-Based Safety Checker for Diffusion Models