mlsanityData to 14 Oct 2026

CaptchaMind: Training CAPTCHA Solvers via Reinforcement Learning with Explicit Reasoning Supervision

arXiv 2605.19538 ↗First posted 19 May 2026cs.CV cs.AIcited by 1

Not on the map. Why?

Abstract (arXiv)

CAPTCHAs are widely deployed as human verification mechanisms and frequently block intelligent agents from completing end-to-end automation in real-world web environments. Solving modern CAPTCHAs requires robust multi-step visual reasoning and interaction capabilities, yet training-based approaches have remained absent due to the lack of large-scale training data and process-level annotations. We introduce CaptchaBench, the first CAPTCHA benchmark designed to support large-scale training, comprising 16,000 programmatically generated samples across eight task categories with detailed region and process-level annotations. Systematic evaluation on CaptchaBench reveals that existing methods fail consistently on tasks requiring fine-grained visual detail capture and region-level comparison. We therefore present CaptchaMind, an RL-based solver trained with explicit reasoning process supervision, achieving 82.9% average success rate across eight tasks and 71.0% on real-world instances, substantially outperforming all existing methods without closed-source APIs.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 19 of its 37 references that are in the map. First posted on arXiv 19 May 2026.

Builds on

19 of 37 references.

References · 19

  1. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
  2. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
  3. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
  4. 2023Qwen-VL: A Versatile Vision-Language Model for Understanding, Localization, Text Reading, and Beyondcited by 2,224
  5. 2023Mind2Web: Towards a Generalist Agent for the Webcited by 1,242
  6. 2024SeeClick: Harnessing GUI Grounding for Advanced Visual GUI Agentscited by 567
  7. 2018Behavioral Cloning from Observationcited by 492
  8. 2024Aguvis: Unified Pure Vision Agents for Autonomous GUI Interactioncited by 278
  9. 2025GUI-R1 : A Generalist R1-Style Vision-Language Action Model For GUI Agentscited by 244
  10. 2024ShowUI: One Vision-Language-Action Model for GUI Visual Agentcited by 232
  11. 2025UI-TARS-2 Technical Report: Advancing GUI Agent with Multi-Turn Reinforcement Learningcited by 215
  12. 2025UI-R1: Enhancing Efficient Action Prediction of GUI Agents by Reinforcement Learningcited by 168
7 more
  1. 2025OpenThinkIMG: Learning to Think with Images via Visual Tool Reinforcement Learningcited by 163
  2. 2025InfiGUI-R1: Advancing Multimodal GUI Agents from Reactive Actors to Deliberative Reasonerscited by 140
  3. 2025Mini-o3: Scaling Up Reasoning Patterns and Interaction Turns for Visual Searchcited by 120
  4. 2025InfiGUIAgent: A Multimodal Generalist GUI Agent with Native Reasoning and Reflectioncited by 67
  5. 2025ACTIVE-o3: Empowering MLLMs with Active Perception via Pure Reinforcement Learningcited by 43
  6. 2024Oedipus: LLM-enchanced Reasoning CAPTCHA Solvercited by 22
  7. 2025Open CaptchaWorld: A Comprehensive Web-based Platform for Testing and Benchmarking Multimodal LLM Agentscited by 16

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026CAPTCHA Solving for Native GUI Agents: Automated Reasoning-Action Data Generation and Self-Corrective Training
  2. 2026CaptchaAgent: Verifiable Visual Reasoning for CAPTCHA Solving
  3. 2025COGNITION: From Evaluation to Defense against Multimodal LLM CAPTCHA Solvers
  4. 2026CAPTCHAs in the Agentic Era: Solvers That Learn from Every Encounter
  5. 2025Spatial CAPTCHA: Generatively Benchmarking Spatial Reasoning for Human-Machine Differentiation
  6. 2025Reasoning under Vision: Understanding Visual-Spatial Cognition in Vision-Language Models for CAPTCHA
  7. 2025CAPTURE: A Benchmark and Evaluation for LVLMs in CAPTCHA Resolving
  8. 2026Next-Gen CAPTCHAs: Leveraging the Cognitive Gap for Scalable and Diverse GUI-Agent Defense