mlsanityData to 14 Oct 2026

Hidden Tail: Adversarial Image Causing Stealthy Resource Consumption in Vision-Language Models

arXiv 2508.18805 ↗First posted 26 Aug 2025cs.CR cs.CVcited by 3

On the map: Multimodal LLMs / vision-language models → MLLM jailbreaks and adversarial robustness

Abstract (arXiv)

Vision-Language Models (VLMs) are increasingly deployed in real-world applications, but their high inference cost makes them vulnerable to resource consumption attacks. Prior attacks attempt to extend VLM output sequences by optimizing adversarial images, thereby increasing inference costs. However, these extended outputs often introduce irrelevant abnormal content, compromising attack stealthiness. This trade-off between effectiveness and stealthiness poses a major limitation for existing attacks. To address this challenge, we propose textitHidden Tail, a stealthy resource consumption attack that crafts prompt-agnostic adversarial images, inducing VLMs to generate maximum-length outputs by appending special tokens invisible to users. Our method employs a composite loss function that balances semantic preservation, repetitive special token induction, and suppression of the end-of-sequence (EOS) token, optimized via a dynamic weighting strategy. Extensive experiments show that textitHidden Tail outperforms existing attacks, increasing output length by up to 19.2× and reaching the maximum token limit, while preserving attack stealthiness. These results highlight the urgent need to improve the robustness of VLMs against efficiency-oriented adversarial threats. Our code is available at https://github.com/zhangrui4041/HiddenTail.

Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Placed in MLLM jailbreaks and adversarial robustness, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 31 of its 34 references that are in the map. First posted on arXiv 26 Aug 2025.

Builds on

31 of 34 references.

Closest ancestors · 4

Same direction, newest first

  1. 2025VLMInferSlow: Evaluating the Efficiency Robustness of Large Vision-Language Models as a Service18 Jun
  2. 2024Self-interpreting Adversarial Images12 Jul
  3. 2024Inducing High Energy-Latency of Large Vision-Language Models with Verbose Images20 Jan
  4. 2023Visual Adversarial Examples Jailbreak Aligned Large Language Models22 Jun

Other references · 27

  1. 2014Microsoft COCO: Common Objects in Contextcited by 17,608
  2. 2023Visual Instruction Tuningcited by 7,869
  3. 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,733
  4. 2017Towards Deep Learning Models Resistant to Adversarial Attackscited by 6,415
  5. 2025Qwen2.5-VL Technical Reportcited by 5,587
  6. 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generationcited by 4,322
  7. 2023InstructBLIP: Towards General-purpose Vision-Language Models with Instruction Tuningcited by 2,876
  8. 2023MiniGPT-4: Enhancing Vision-Language Understanding with Advanced Large Language Modelscited by 2,711
  9. 2024Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phonecited by 1,917
  10. 2025Gemma 3 Technical Reportcited by 1,824
  11. 2018End-to-End Multi-Task Learning with Attentioncited by 534
  12. 2022Visual Programming: Compositional visual reasoning without trainingcited by 516
15 more
  1. 2021From Show to Tell: A Survey on Deep Learning-based Image Captioningcited by 138
  2. 2025MiMo-VL Technical Reportcited by 115
  3. 2020Sponge Examples: Energy-Latency Attacks on Neural Networkscited by 111
  4. 2025OverThink: Slowdown Attacks on Reasoning LLMscited by 96
  5. 2024MMed-RAG: Versatile Multimodal RAG System for Medical Vision Language Modelscited by 85
  6. 2024Instruction Backdoor Attacks Against Customized LLMscited by 62
  7. 2024From Pixels to Insights: A Survey on Automatic Chart Understanding in the Era of Large Foundation Modelscited by 53
  8. 2024Multi-modal Agent Tuning: Building a VLM-Driven Agent for Efficient Tool Usagecited by 51
  9. 2025Adversarial Attacks against Closed-Source MLLMs via Feature Optimal Alignmentcited by 43
  10. 2024Denial-of-Service Poisoning Attacks against Large Language Modelscited by 35
  11. 2024Crabs: Consuming Resource via Auto-generation for LLM-DoS Attack under Black-box Settingscited by 35
  12. 2024DocVLM: Make Your VLM an Efficient Readercited by 28
  13. 2024Vision Search Assistant: Empower Vision-Language Models as Multimodal Search Enginescited by 16
  14. 2025In-Context Watermarks for Large Language Modelscited by 10
  15. 2024Backdoor Attacks against Image-to-Image Networkscited by 7

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 3.

3 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2024Break the Visual Perception: Adversarial Attacks Targeting Encoded Visual Tokens of Large Vision-Language Models
  2. 2025VIP: Visual Information Protection through Adversarial Attacks on Vision-Language Models
  3. 2025Attention! Your Vision Language Model Could Be Maliciously Manipulated
  4. 2025VEAttack: Downstream-agnostic Vision Encoder Attack against Large Vision Language Models
  5. 2025Backdoor Attack on Vision Language Models with Stealthy Semantic Manipulation
  6. 2026GhostPrompt: Cross-Image Adversarial Prompt for Vision-Language Models
  7. 2025Invisible Injections: Exploiting Vision-Language Models Through Steganographic Prompt Embedding
  8. 2025Safeguarding Vision-Language Models: Mitigating Vulnerabilities to Gaussian Noise in Perturbation-based Attacks