Hidden Tail: Adversarial Image Causing Stealthy Resource Consumption in Vision-Language Models
On the map: Multimodal LLMs / vision-language models → MLLM jailbreaks and adversarial robustness
Abstract (arXiv)
Vision-Language Models (VLMs) are increasingly deployed in real-world applications, but their high inference cost makes them vulnerable to resource consumption attacks. Prior attacks attempt to extend VLM output sequences by optimizing adversarial images, thereby increasing inference costs. However, these extended outputs often introduce irrelevant abnormal content, compromising attack stealthiness. This trade-off between effectiveness and stealthiness poses a major limitation for existing attacks. To address this challenge, we propose textitHidden Tail, a stealthy resource consumption attack that crafts prompt-agnostic adversarial images, inducing VLMs to generate maximum-length outputs by appending special tokens invisible to users. Our method employs a composite loss function that balances semantic preservation, repetitive special token induction, and suppression of the end-of-sequence (EOS) token, optimized via a dynamic weighting strategy. Extensive experiments show that textitHidden Tail outperforms existing attacks, increasing output length by up to 19.2× and reaching the maximum token limit, while preserving attack stealthiness. These results highlight the urgent need to improve the robustness of VLMs against efficiency-oriented adversarial threats. Our code is available at https://github.com/zhangrui4041/HiddenTail.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Placed in MLLM jailbreaks and adversarial robustness, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 31 of its 34 references that are in the map. First posted on arXiv 26 Aug 2025.
Builds on
31 of 34 references.
Closest ancestors · 4
Same direction, newest first
- 2025VLMInferSlow: Evaluating the Efficiency Robustness of Large Vision-Language Models as a Service18 Jun
- 2024Self-interpreting Adversarial Images12 Jul
- 2024Inducing High Energy-Latency of Large Vision-Language Models with Verbose Images20 Jan
- 2023Visual Adversarial Examples Jailbreak Aligned Large Language Models22 Jun
Other references · 27
- 2014Microsoft COCO: Common Objects in Contextcited by 17,608
- 2023Visual Instruction Tuningcited by 7,869
- 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,733
- 2017Towards Deep Learning Models Resistant to Adversarial Attackscited by 6,415
- 2025Qwen2.5-VL Technical Reportcited by 5,587
- 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generationcited by 4,322
- 2023InstructBLIP: Towards General-purpose Vision-Language Models with Instruction Tuningcited by 2,876
- 2023MiniGPT-4: Enhancing Vision-Language Understanding with Advanced Large Language Modelscited by 2,711
- 2024Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phonecited by 1,917
- 2025Gemma 3 Technical Reportcited by 1,824
- 2018End-to-End Multi-Task Learning with Attentioncited by 534
- 2022Visual Programming: Compositional visual reasoning without trainingcited by 516
15 more
- 2021From Show to Tell: A Survey on Deep Learning-based Image Captioningcited by 138
- 2025MiMo-VL Technical Reportcited by 115
- 2020Sponge Examples: Energy-Latency Attacks on Neural Networkscited by 111
- 2025OverThink: Slowdown Attacks on Reasoning LLMscited by 96
- 2024MMed-RAG: Versatile Multimodal RAG System for Medical Vision Language Modelscited by 85
- 2024Instruction Backdoor Attacks Against Customized LLMscited by 62
- 2024From Pixels to Insights: A Survey on Automatic Chart Understanding in the Era of Large Foundation Modelscited by 53
- 2024Multi-modal Agent Tuning: Building a VLM-Driven Agent for Efficient Tool Usagecited by 51
- 2025Adversarial Attacks against Closed-Source MLLMs via Feature Optimal Alignmentcited by 43
- 2024Denial-of-Service Poisoning Attacks against Large Language Modelscited by 35
- 2024Crabs: Consuming Resource via Auto-generation for LLM-DoS Attack under Black-box Settingscited by 35
- 2024DocVLM: Make Your VLM an Efficient Readercited by 28
- 2024Vision Search Assistant: Empower Vision-Language Models as Multimodal Search Enginescited by 16
- 2025In-Context Watermarks for Large Language Modelscited by 10
- 2024Backdoor Attacks against Image-to-Image Networkscited by 7
Built on by
Citing papers per year: 2026: 3.
3 papers.
- 2026BenchOverflow: Measuring Overflow in Large Language Models via Plain-Text Promptscited by 3
- 2026Overthink-Triggered Slowdown Attacks on LVLM-Based Robotic Systemscited by 0
- 2026Hiding in Plain Sight: An Effective Physical Adversarial Patch Attack against Visual-Infrared Fused Face Detectioncited by 0
- 2026Hiding in Plain Sight: An Effective Physical Adversarial Patch Attack against Visual-Infrared Fused Face Detection25 Jul 2026
- 2026Overthink-Triggered Slowdown Attacks on LVLM-Based Robotic Systems1 Jul 2026
- 2026BenchOverflow: Measuring Overflow in Large Language Models via Plain-Text Prompts13 Jan 2026
Similar, not cited
Close in wording, no citation either way
- 2024Break the Visual Perception: Adversarial Attacks Targeting Encoded Visual Tokens of Large Vision-Language Models
- 2025VIP: Visual Information Protection through Adversarial Attacks on Vision-Language Models
- 2025Attention! Your Vision Language Model Could Be Maliciously Manipulated
- 2025VEAttack: Downstream-agnostic Vision Encoder Attack against Large Vision Language Models
- 2025Backdoor Attack on Vision Language Models with Stealthy Semantic Manipulation
- 2026GhostPrompt: Cross-Image Adversarial Prompt for Vision-Language Models
- 2025Invisible Injections: Exploiting Vision-Language Models Through Steganographic Prompt Embedding
- 2025Safeguarding Vision-Language Models: Mitigating Vulnerabilities to Gaussian Noise in Perturbation-based Attacks