mlsanityData to 14 Oct 2026

Throttling Web Agents Using Reasoning Gates

arXiv 2509.01619 ↗First posted 1 Sep 2025cs.AI cs.CR cs.LGcited by 2

On the map: LLM reasoning → Reasoning for agents, planning and code

also in 1 more
Abstract (arXiv)

AI web agents use Internet resources at far greater speed, scale, and complexity -- changing how users and services interact. Deployed maliciously or erroneously, these agents could overload content providers. At the same time, web agents can bypass CAPTCHAs and other defenses by mimicking user behavior or flood authentication systems with fake accounts. Yet providers must protect their services and content from denial-of-service attacks and scraping by web agents. In this paper, we design a framework that imposes tunable costs on agents before providing access to resources; we call this Web Agent Throttling. We start by formalizing Throttling Gates as challenges issued to an agent that are asymmetric, scalable, robust, and compatible with any agent. Focusing on a common component -- the language model -- we require the agent to solve reasoning puzzles, thereby incurring excessive token-generation costs. However, we find that using existing puzzles, e.g., coding or math, as throttling gates fails to satisfy our properties. To address this, we introduce rebus-based Reasoning Gates, synthetic text puzzles that require multi-hop reasoning over world knowledge (thereby throttling an agent's model). We design a scalable generation and verification protocol for such reasoning gates. Our framework achieves computational asymmetry, i.e., the response-generation cost is 9.2x higher than the generation cost for SOTA models. We further deploy reasoning gates on a custom website and Model Context Protocol (MCP) servers and evaluate with real-world web agents. Finally, we discuss the limitations and environmental impact of real-world deployment of our framework.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Placed in Reasoning for agents, planning and code, one of 17 directions in LLM reasoning. Builds on 46 of its 111 references that are in the map. First posted on arXiv 1 Sep 2025.

Builds on

46 of 111 references.

Closest ancestors · 1

Same direction, newest first

  1. 2025OverThink: Slowdown Attacks on Reasoning LLMs4 Feb

Other references · 45

  1. 2021Evaluating Large Language Models Trained on Codecited by 8,320
  2. 2021Measuring Mathematical Problem Solving With the MATH Datasetcited by 5,371
  3. 2023WebArena: A Realistic Web Environment for Building Autonomous Agentscited by 2,006
  4. 2025s1: Simple test-time scalingcited by 1,341
  5. 2024OlympiadBench: A Challenging Benchmark for Promoting AGI with Olympiad-Level Bilingual Multimodal Scientific Problemscited by 1,136
  6. 2025Humanity's Last Examcited by 491
  7. 2023Logic-LM: Empowering Large Language Models with Symbolic Solvers for Faithful Logical Reasoningcited by 391
  8. 2024Omni-MATH: A Universal Olympiad Level Mathematic Benchmark For Large Language Modelscited by 284
  9. 2025Model Context Protocol (MCP): Landscape, Security Threats, and Future Research Directionscited by 265
  10. 2025Survey on Evaluation of LLM-based Agentscited by 204
  11. 2023MuSR: Testing the Limits of Chain-of-thought with Multistep Soft Reasoningcited by 201
  12. 2025AI Agents vs. Agentic AI: A Conceptual Taxonomy, Applications and Challengescited by 169
33 more
  1. 2024On Memorization of Large Language Models in Logical Reasoningcited by 117
  2. 2025Soft Thinking: Unlocking the Reasoning Potential of LLMs in Continuous Concept Spacecited by 117
  3. 2023LLMCarbon: Modeling the end-to-end Carbon Footprint of Large Language Modelscited by 72
  4. 2025Challenging the Boundaries of Reasoning: An Olympiad-Level Math Benchmark for Large Language Modelscited by 70
  5. 2024Inducing High Energy-Latency of Large Vision-Language Models with Verbose Imagescited by 69
  6. 2025Authenticated Delegation and Authorized AI Agentscited by 65
  7. 2025Model Context Protocol (MCP) at First Glance: Studying the Security and Maintainability of MCP Serverscited by 65
  8. 2024SUPER: Evaluating Agents on Setting Up and Executing Tasks from Research Repositoriescited by 52
  9. 2025Commercial LLM Agents Are Already Vulnerable to Simple Yet Dangerous Attackscited by 49
  10. 2024VisualWebArena: Evaluating Multimodal Agents on Realistic Visual Web Taskscited by 47
  11. 2025Agentic Web: Weaving the Next Web with AI Agentscited by 45
  12. 2024Multi-LogiEval: Towards Evaluating Multi-Step Logical Reasoning Ability of Large Language Modelscited by 39
  13. 2019Quizbowl: The Case for Incremental Question Answeringcited by 36
  14. 2024Denial-of-Service Poisoning Attacks against Large Language Modelscited by 35
  15. 2025SATBench: Benchmarking LLMs' Logical Reasoning via Automated Puzzle Generation from SAT Formulascited by 33
  16. 2025Benchmarking Reasoning Robustness in Large Language Modelscited by 30
  17. 2023Language Models can be Logical Solverscited by 24
  18. 2025Finding Flawed Fictions: Evaluating Complex Reasoning in Language Models via Plot Hole Detectioncited by 24
  19. 2024Oedipus: LLM-enchanced Reasoning CAPTCHA Solvercited by 22
  20. 2023Learning to Solve Constraint Satisfaction Problems with Recurrent Transformercited by 21
  21. 2024AutoScraper: A Progressive Understanding Web Agent for Web Scraper Generationcited by 20
  22. 2025EpiCoder: Encompassing Diversity and Complexity in Code Generationcited by 20
  23. 2020Deep-CAPTCHA: a deep learning based CAPTCHA solver for vulnerability assessmentcited by 11
  24. 2025The Hidden Dangers of Browsing AI Agentscited by 11
  25. 2025MCA-Bench: A Multimodal Benchmark for Evaluating CAPTCHA Robustness Against VLM-based Attackscited by 11
  26. 2025Enhancing LLM-Based Code Generation with Complexity Metrics: A Feedback-Driven Approachcited by 10
  27. 2024REBUS: A Robust Evaluation Benchmark of Understanding Symbolscited by 8
  28. 2025VAR-MATH: Probing True Mathematical Reasoning in LLMS via Symbolic Multi-Instance Benchmarkscited by 8
  29. 2025Memorize or Generalize? Evaluating LLM Code Generation with Code Rewritingcited by 7
  30. 2024ExpShield: Safeguarding Web Text from Unauthorized Crawling and LLM Exploitationcited by 3
  31. 2019JSON Web Token (JWT) based client authentication in Message Queuing Telemetry Transport (MQTT)cited by 1
  32. 2025Proof of Work With External Utilitiescited by 1
  33. 2025Threadbox: Sandboxing for Modular Securitycited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025WebCoT: Enhancing Web Agent Reasoning by Reconstructing Chain-of-Thought in Reflection, Branching, and Rollback
  2. 2025WASP: Benchmarking Web Agent Security Against Prompt Injection Attacks
  3. 2026WebAgentGuard: A Reasoning-Driven Guard Model for Detecting Prompt Injection Attacks in Web Agents
  4. 2026Agent Harness Distillation: Inference-Time Harness Extraction and Exploitation in Autonomous Multi-Agent Systems
  5. 2026aCAPTCHA: Verifying That an Entity Is a Capable Agent via Asymmetric Hardness
  6. 2026WebFactory: Automated Compression of Foundational Language Intelligence into Grounded Web Agents
  7. 2025It's a TRAP! Task-Redirecting Agent Persuasion Benchmark for Web Agents
  8. 2026When Bots Take the Bait: Exposing and Mitigating the Emerging Social Engineering Attack in Web Automation Agent