VIPER Strike: Defeating Visual Reasoning CAPTCHAs via Structured Vision-Language Inference
On the map: LLM reasoning → Multimodal reasoning
Abstract (arXiv)
Visual Reasoning CAPTCHAs (VRCs) combine visual scenes with natural-language queries that demand compositional inference over objects, attributes, and spatial relations. They are increasingly deployed as a primary defense against automated bots. Existing solvers fall into two paradigms: vision-centric, which rely on template-specific detectors but fail on novel layouts, and reasoning-centric, which leverage LLMs but struggle with fine-grained visual perception. Both lack the generality needed to handle heterogeneous VRC deployments. We present ViPer, a unified attack framework that integrates structured multi-object visual perception with adaptive LLM-based reasoning. ViPer parses visual layouts, grounds attributes to question semantics, and infers target coordinates within a modular pipeline. Evaluated on six major VRC providers (VTT, Geetest, NetEase, Dingxiang, Shumei, Xiaodun), ViPer achieves up to 93.2% success, approaching human-level performance across multiple benchmarks. Compared to prior solvers, GraphNet (83.2%), Oedipus (65.8%), and the Holistic approach (89.5%), ViPer consistently outperforms all baselines. The framework further maintains robustness across alternative LLM backbones (GPT, Grok, DeepSeek, Kimi), sustaining accuracy above 90%. To anticipate defense, we further introduce Template-Space Randomization (TSR), a lightweight strategy that perturbs linguistic templates without altering task semantics. TSR measurably reduces solver (i.e., attacker) performance. Our proposed design suggests directions for human-solvable but machine-resistant CAPTCHAs.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 26 of its 69 references that are in the map. First posted on arXiv 10 Jan 2026.
Builds on
26 of 69 references.
References · 26
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2023GPT-4 Technical Reportcited by 18,396
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
- 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,137
- 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,326
- 2022Flamingo: a Visual Language Model for Few-Shot Learningcited by 4,386
- 2016Making the V in VQA Matter: Elevating the Role of Image Understanding in Visual Question Answeringcited by 2,516
- 2015VQA: Visual Question Answeringcited by 2,506
- 2023PaLM-E: An Embodied Multimodal Language Modelcited by 2,071
- 2023A Survey on Evaluation of Large Language Modelscited by 1,242
- 2019OK-VQA: A Visual Question Answering Benchmark Requiring External Knowledgecited by 1,121
- 2022A-OKVQA: A Benchmark for Visual Question Answering using World Knowledgecited by 710
14 more
- 2023Harnessing the Power of LLMs in Practice: A Survey on ChatGPT and Beyondcited by 411
- 2022Multimodal Learning with Transformers: A Surveycited by 400
- 2019Visual Entailment: A Novel Task for Fine-Grained Image Understandingcited by 252
- 2025A Survey on Trustworthy LLM Agents: Threats and Countermeasurescited by 96
- 2024Large Language Model (LLM) for Telecommunications: A Comprehensive Survey on Principles, Key Techniques, and Opportunitiescited by 83
- 2024Oedipus: LLM-enchanced Reasoning CAPTCHA Solvercited by 22
- 2019Adversarial CAPTCHAscited by 16
- 2023An Empirical Study & Evaluation of Modern CAPTCHAscited by 13
- 2025IllusionCAPTCHA: A CAPTCHA based on Visual Illusioncited by 13
- 2021Gotta CAPTCHA 'Em All: A Survey of Twenty years of the Human-or-Computer Dilemmacited by 10
- 2021An Object Detection based Solver for Google's Image reCAPTCHA v2cited by 8
- 2020An End-to-End Attack on Text-based CAPTCHAs Based on Cycle-Consistent Generative Adversarial Networkcited by 4
- 2022Counteracting Dark Web Text-Based CAPTCHA with Generative Adversarial Learning for Proactive Cyber Threat Intelligencecited by 3
- 2021vrCAPTCHA: Exploring CAPTCHA Designs in Virtual Realitycited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026CaptchaAgent: Verifiable Visual Reasoning for CAPTCHA Solving
- 2025COGNITION: From Evaluation to Defense against Multimodal LLM CAPTCHA Solvers
- 2025Reasoning under Vision: Understanding Visual-Spatial Cognition in Vision-Language Models for CAPTCHA
- 2023ViperGPT: Visual Inference via Python Execution for Reasoning
- 2025CodeV: Code with Images for Faithful Visual Reasoning via Tool-Aware Policy Optimization
- 2025TAIJI: Textual Anchoring for Immunizing Jailbreak Images in Vision Language Models
- 2025Open CaptchaWorld: A Comprehensive Web-based Platform for Testing and Benchmarking Multimodal LLM Agents
- 2026Physical Prompt Injection Attacks on Large Vision-Language Models