mlsanityData to 7 Oct 2026

VidDoS: Universal Denial-of-Service Attack on Video-based Large Language Models

arXiv 2603.01454 ↗First posted 2 Mar 2026cs.CV cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Video-LLMs are increasingly deployed in safety-critical applications but are vulnerable to Energy-Latency Attacks (ELAs) that exhaust computational resources. Current image-centric methods fail because temporal aggregation mechanisms dilute individual frame perturbations. Additionally, real-time demands make instance-wise optimization impractical for continuous video streams. We introduce VidDoS, which is the first universal ELA framework tailored for Video-LLMs. Our method leverages universal optimization to create instance-agnostic triggers that require no inference-time gradient calculation. We achieve this through textitmasked teacher forcing to steer models toward expensive target sequences, combined with a textitrefusal penalty and textitearly-termination suppression to override conciseness priors. Testing across three mainstream Video-LLMs and three video datasets, which include video question answering and autonomous driving scenarios, shows extreme degradation. VidDoS induces a token expansion of more than 205× and inflates the inference latency by more than 15× relative to clean baselines. Simulations of real-time autonomous driving streams further reveal that this induced latency leads to critical safety violations. We urge the community to recognize and mitigate these high-hazard ELA in Video-LLMs.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 34 of its 44 references that are in the map. First posted on arXiv 2 Mar 2026.

Builds on

34 of 44 references.

References · 34

  1. 2025Qwen3 Technical Reportcited by 8,195
  2. 2017Towards Deep Learning Models Resistant to Adversarial Attackscited by 6,326
  3. 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,069
  4. 2023Improved Baselines with Visual Instruction Tuningcited by 4,362
  5. 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,151
  6. 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,669
  7. 2023Video-LLaMA: An Instruction-tuned Audio-Visual Language Model for Video Understandingcited by 1,461
  8. 2023Video-LLaVA: Learning United Visual Representation by Alignment Before Projectioncited by 1,385
  9. 2023Video-ChatGPT: Towards Detailed Video Understanding via Large Vision and Language Modelscited by 1,047
  10. 2023MovieChat: From Dense Token to Sparse Memory for Long Video Understandingcited by 536
  11. 2023DriveLM: Driving with Graph Visual Question Answeringcited by 527
  12. 2023TimeChat: A Time-sensitive Multimodal Large Language Model for Long Video Understandingcited by 399
22 more
  1. 2023VTimeLLM: Empower LLM to Grasp Video Momentscited by 253
  2. 2024Model Merging in LLMs, MLLMs, and Beyond: Methods, Theories, Applications and Opportunitiescited by 247
  3. 2018Textual Explanations for Self-Driving Vehiclescited by 226
  4. 2024MMBench-Video: A Long-Form Multi-Shot Benchmark for Holistic Video Understandingcited by 180
  5. 2020Sponge Examples: Energy-Latency Attacks on Neural Networkscited by 108
  6. 2024VLM-AD: End-to-End Autonomous Driving through Vision-Language Model Supervisioncited by 85
  7. 2023Audio-Visual LLM for Video Understandingcited by 76
  8. 2024VideoRefer Suite: Advancing Spatial-Temporal Object Understanding with Video LLMcited by 71
  9. 2024Inducing High Energy-Latency of Large Vision-Language Models with Verbose Imagescited by 69
  10. 2024Embodied Understanding of Driving Scenarioscited by 63
  11. 2024VLM-RL: A Unified Vision Language Models and Reinforcement Learning Framework for Safe Autonomous Drivingcited by 49
  12. 2022NICGSlowDown: Evaluating the Efficiency Robustness of Neural Image Caption Generation Modelscited by 47
  13. 2024Denial-of-Service Poisoning Attacks against Large Language Modelscited by 34
  14. 2024Crabs: Consuming Resource via Auto-generation for LLM-DoS Attack under Black-box Settingscited by 33
  15. 2024An Engorgio Prompt Makes Large Language Model Babble oncited by 30
  16. 2022Energy-Latency Attacks via Sponge Poisoningcited by 29
  17. 2019D2-City: A Large-Scale Dashcam Video Dataset of Diverse Traffic Scenarioscited by 28
  18. 2025Video SimpleQA: Towards Factuality Evaluation in Large Video Language Modelscited by 11
  19. 2023Energy-Latency Attacks to On-Device Neural Networks via Sponge Poisoningcited by 10
  20. 2024The Impact of Uniform Inputs on Activation Sparsity and Energy-Latency Attacks in Computer Visioncited by 7
  21. 2025LoopLLM: Transferable Energy-Latency Attacks in LLMs via Repetitive Generationcited by 7
  22. 2025Energy-Latency Attacks: A New Adversarial Threat to Deep Learningcited by 5

Built on by

Not cited yet.