Efficient Adversarial Attacks for Visual Object Tracking
Not on the map. Why?
Abstract (arXiv)
Visual object tracking is an important task that requires the tracker to find the objects quickly and accurately. The existing state-ofthe-art object trackers, i.e., Siamese based trackers, use DNNs to attain high accuracy. However, the robustness of visual tracking models is seldom explored. In this paper, we analyze the weakness of object trackers based on the Siamese network and then extend adversarial examples to visual object tracking. We present an end-to-end network FAN (Fast Attack Network) that uses a novel drift loss combined with the embedded feature loss to attack the Siamese network based trackers. Under a single GPU, FAN is efficient in the training speed and has a strong attack performance. The FAN can generate an adversarial example at 10ms, achieve effective targeted attack (at least 40% drop rate on OTB) and untargeted attack (at least 70% drop rate on OTB).
Key facts. Cited by 66 papers in the map (data through 7 Oct 2026). First posted on arXiv 1 Aug 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 5; 2022: 10; 2023: 8; 2024: 17; 2025: 18; 2026: 8.
66 papers.
Sort:
By area:
- 2021Advances in adversarial attacks and defenses in computer vision: A surveycited by 127
- 2021Towards More Flexible and Accurate Object Tracking with Natural Language: Algorithms and Benchmarkcited by 124
- 2024Jailbreak Vision Language Models via Bi-Modal Adversarial Promptcited by 103
- 2024VL-Trojan: Multimodal Instruction Backdoor Attacks against Autoregressive Visual Language Modelscited by 83
- 2022Parallel Rectangle Flip Attack: A Query-based Black-box Attack against Object Detectioncited by 79
- 2023BadCLIP: Trigger-Aware Prompt Learning for Backdoor Attacks on CLIPcited by 63
- 2023Enhancing Fine-Tuning Based Backdoor Defense with Sharpness-Aware Minimizationcited by 60
- 2023Boosting Adversarial Transferability by Achieving Flat Local Maximacited by 48
- 2024Semantic Mirror Jailbreak: Genetic Algorithm Based Jailbreak Prompts Against Open-source LLMscited by 48
- 2025Manipulating Multimodal Agents via Cross-Modal Prompt Injectioncited by 42
- 2023Neural Polarizer: A Lightweight and Effective Backdoor Defense via Purifying Poisoned Featurescited by 35
- 2024Boosting Transferability in Vision-Language Attacks via Diversification along the Intersection Region of Adversarial Trajectorycited by 35
38 more
- 2024Visual Adversarial Attack on Vision-Language Models for Autonomous Drivingcited by 35
- 2022Prior-Guided Adversarial Initialization for Fast Adversarial Trainingcited by 34
- 2024Poisoned Forgery Face: Towards Backdoor Attacks on Face Forgery Detectioncited by 34
- 2022Towards Efficient Adversarial Training on Vision Transformerscited by 29
- 2024Effectiveness Assessment of Recent Large Vision-Language Modelscited by 29
- 2024Compromising Embodied Agents with Contextual Backdoor Attackscited by 29
- 2023Rethinking the Backward Propagation for Adversarial Transferabilitycited by 27
- 2022WebUAV-3M: A Benchmark for Unveiling the Power of Million-Scale Deep UAV Trackingcited by 26
- 2021IoU Attack: Towards Temporally Coherent Black-Box Adversarial Attack for Visual Object Trackingcited by 25
- 2024Towards Robust Physical-world Backdoor Attacks on Lane Detectioncited by 25
- 2024Hide in Thicket: Generating Imperceptible and Rational Adversarial Perturbations on 3D Point Cloudscited by 24
- 2023Efficient Decision-based Black-box Patch Attacks on Video Recognitioncited by 21
- 2022Exploring Inconsistent Knowledge Distillation for Object Detection with Data Augmentationcited by 19
- 2024LanEvil: Benchmarking the Robustness of Lane Detection to Environmental Illusionscited by 18
- 2025T2V-OptJail: Discrete Prompt Optimization for Text-to-Video Jailbreak Attackscited by 18
- 2022Efficient universal shuffle attack for visual object trackingcited by 14
- 2022SiamMask: A Framework for Fast Online Object Tracking and Segmentationcited by 13
- 2025E2AT: Multimodal Jailbreak Defense via Dynamic Joint Optimization for Multimodal Large Language Modelscited by 12
- 2022DIMBA: Discretely Masked Black-Box Attack in Single Object Trackingcited by 11
- 2025Pushing the Limits of Safety: A Technical Report on the ATLAS Challenge 2025cited by 11
- 2026When World Models Dream Wrong: Physical-Conditioned Adversarial Attacks against World Modelscited by 11
- 2023Isolation and Induction: Training Robust Deep Neural Networks against Model Stealing Attackscited by 10
- 2021A Simple and Strong Baseline for Universal Targeted Attacks on Siamese Visual Trackingcited by 9
- 2025Temporal Unlearnable Examples: Preventing Personal Video Data from Unauthorized Exploitation by Object Trackingcited by 9
- 2025Bench2ADVLM: A Closed-Loop Benchmark for Vision-language Models in Autonomous Drivingcited by 8
- 2021Semantically Stealthy Adversarial Attacks against Segmentation Modelscited by 7
- 2023Face Encryption via Frequency-Restricted Identity-Agnostic Attackscited by 6
- 2024Efficient Backdoor Defense in Multimodal Contrastive Learning: A Token-Level Unlearning Method for Mitigating Threatscited by 6
- 20253D Gaussian Splatting Driven Multi-View Robust Physical Adversarial Camouflage Generationcited by 6
- 2026CtrlAttack: A Unified Attack on World-Model Control in Diffusion Modelscited by 6
- 2024Towards Robust Object Detection: Identifying and Removing Backdoors via Module Inconsistency Analysiscited by 4
- 2025No Query, No Accesscited by 4
- 2025Adversarial Generation and Collaborative Evolution of Safety-Critical Scenarios for Autonomous Vehiclescited by 4
- 2025GeoShield: Safeguarding Geolocation Privacy from Vision-Language Models via Adversarial Perturbationscited by 3
- 2025Physical Adversarial Camouflage through Gradient Calibration and Regularizationcited by 3
- 2025MetAdv: A Unified and Interactive Adversarial Testing Platform for Autonomous Drivingcited by 3
- 2022SkeleVision: Towards Adversarial Resiliency of Person Tracking with Multi-Task Learningcited by 2
- 2022Single Object Tracking Research: A Surveycited by 2
50 most cited of 66 All 66 (JSON)
- 2026CIVA: Critic-Induced Value-Subspace Attacks on Visual World-Model Agents21 Aug 2026
- 2026Benchmarking the Robustness of Autonomous Driving to Environmental Illusions: A Lane Perception Perspective7 Jul 2026
- 2026Multimodal Backdoor Attack on VLMs for Autonomous Driving via Graffiti and Cross-Lingual Triggers6 Apr 2026
- 2026A Patch-based Cross-view Regularized Framework for Backdoor Defense in Multimodal Large Language Models6 Apr 2026
- 2026R-PGA: Robust Physical Adversarial Camouflage Generation via Relightable 3D Gaussian Splatting27 Mar 2026
- 2026CtrlAttack: A Unified Attack on World-Model Control in Diffusion Models13 Mar 2026
- 2026Evolving Deception: When Agents Evolve, Deception Wins6 Mar 2026
- 2026When World Models Dream Wrong: Physical-Conditioned Adversarial Attacks against World Models21 Feb 2026
- 2025Bridging the Task Gap: Multi-Task Adversarial Transferability in CLIP and Its Derivatives28 Sep 2025
- 2025Text Adversarial Attacks with Dynamic Outputs26 Sep 2025
- 2025FERD: Fairness-Enhanced Data-Free Robustness Distillation25 Sep 2025
- 2025Towards a 3D Transfer-based Black-box Attack via Critical Feature Guidance21 Aug 2025
38 more
- 2025Adversarial Generation and Collaborative Evolution of Safety-Critical Scenarios for Autonomous Vehicles20 Aug 2025
- 2025Physical Adversarial Camouflage through Gradient Calibration and Regularization7 Aug 2025
- 2025GeoShield: Safeguarding Geolocation Privacy from Vision-Language Models via Adversarial Perturbations5 Aug 2025
- 2025MetAdv: A Unified and Interactive Adversarial Testing Platform for Autonomous Driving4 Aug 2025
- 2025Bench2ADVLM: A Closed-Loop Benchmark for Vision-language Models in Autonomous Driving4 Aug 2025
- 2025Temporal Unlearnable Examples: Preventing Personal Video Data from Unauthorized Exploitation by Object Tracking10 Jul 2025
- 20253D Gaussian Splatting Driven Multi-View Robust Physical Adversarial Camouflage Generation2 Jul 2025
- 2025Pushing the Limits of Safety: A Technical Report on the ATLAS Challenge 202514 Jun 2025
- 2025Towards Adaptive Meta-Gradient Adversarial Examples for Visual Tracking13 May 2025
- 2025No Query, No Access12 May 2025
- 2025T2V-OptJail: Discrete Prompt Optimization for Text-to-Video Jailbreak Attacks10 May 2025
- 2025Adversarial Attack for RGB-Event based Visual Object Tracking19 Apr 2025
- 2025Manipulating Multimodal Agents via Cross-Modal Prompt Injection19 Apr 2025
- 2025E2AT: Multimodal Jailbreak Defense via Dynamic Joint Optimization for Multimodal Large Language Models5 Mar 2025
- 2024Visual Adversarial Attack on Vision-Language Models for Autonomous Driving27 Nov 2024
- 2024Adversarial Attacks on LiDAR-Based Tracking Across Road Users: Robustness Evaluation and Target-Aware Black-Box Method28 Oct 2024
- 2024Patch is Enough: Naturalistic Adversarial Patch against Vision-Language Pre-training Models7 Oct 2024
- 2024Efficient Backdoor Defense in Multimodal Contrastive Learning: A Token-Level Unlearning Method for Mitigating Threats29 Sep 2024
- 2024Towards Robust Object Detection: Identifying and Removing Backdoors via Module Inconsistency Analysis24 Sep 2024
- 2024Compromising Embodied Agents with Contextual Backdoor Attacks6 Aug 2024
- 2024Jailbreak Vision Language Models via Bi-Modal Adversarial Prompt6 Jun 2024
- 2024LanEvil: Benchmarking the Robustness of Lane Detection to Environmental Illusions3 Jun 2024
- 2024Towards Robust Physical-world Backdoor Attacks on Lane Detection9 May 2024
- 2024LRR: Language-Driven Resamplable Continuous Representation against Adversarial Tracking Attacks9 Apr 2024
- 2024Boosting Transferability in Vision-Language Attacks via Diversification along the Intersection Region of Adversarial Trajectory19 Mar 2024
- 2024Hide in Thicket: Generating Imperceptible and Rational Adversarial Perturbations on 3D Point Clouds8 Mar 2024
- 2024Effectiveness Assessment of Recent Large Vision-Language Models7 Mar 2024
- 2024Enhancing Tracking Robustness with Auxiliary Adversarial Defense Networks28 Feb 2024
- 2024Semantic Mirror Jailbreak: Genetic Algorithm Based Jailbreak Prompts Against Open-source LLMs21 Feb 2024
- 2024VL-Trojan: Multimodal Instruction Backdoor Attacks against Autoregressive Visual Language Models21 Feb 2024
- 2024Poisoned Forgery Face: Towards Backdoor Attacks on Face Forgery Detection18 Feb 2024
- 2023BadCLIP: Trigger-Aware Prompt Learning for Backdoor Attacks on CLIP26 Nov 2023
- 2023Face Encryption via Frequency-Restricted Identity-Agnostic Attacks11 Aug 2023
- 2023Isolation and Induction: Training Robust Deep Neural Networks against Model Stealing Attacks2 Aug 2023
- 2023Neural Polarizer: A Lightweight and Effective Backdoor Defense via Purifying Poisoned Features29 Jun 2023
- 2023Rethinking the Backward Propagation for Adversarial Transferability22 Jun 2023
- 2023Boosting Adversarial Transferability by Achieving Flat Local Maxima8 Jun 2023
- 2023Enhancing Fine-Tuning Based Backdoor Defense with Sharpness-Aware Minimization24 Apr 2023
50 newest of 66 All 66 (JSON)
- 2024Jailbreak Vision Language Models via Bi-Modal Adversarial Promptcited by 103
- 2024VL-Trojan: Multimodal Instruction Backdoor Attacks against Autoregressive Visual Language Modelscited by 83
- 2023BadCLIP: Trigger-Aware Prompt Learning for Backdoor Attacks on CLIPcited by 63
- 2025Manipulating Multimodal Agents via Cross-Modal Prompt Injectioncited by 42
- 2024Boosting Transferability in Vision-Language Attacks via Diversification along the Intersection Region of Adversarial Trajectorycited by 35
- 2024Effectiveness Assessment of Recent Large Vision-Language Modelscited by 29
- 2025E2AT: Multimodal Jailbreak Defense via Dynamic Joint Optimization for Multimodal Large Language Modelscited by 12
- 2025Pushing the Limits of Safety: A Technical Report on the ATLAS Challenge 2025cited by 11
- 2025Bench2ADVLM: A Closed-Loop Benchmark for Vision-language Models in Autonomous Drivingcited by 8
- 2025Bridging the Task Gap: Multi-Task Adversarial Transferability in CLIP and Its Derivativescited by 2
- 2026Multimodal Backdoor Attack on VLMs for Autonomous Driving via Graffiti and Cross-Lingual Triggerscited by 1
- 2024Patch is Enough: Naturalistic Adversarial Patch against Vision-Language Pre-training Modelscited by 0
12 most cited of 13 All 13 (JSON)
- 2026Multimodal Backdoor Attack on VLMs for Autonomous Driving via Graffiti and Cross-Lingual Triggers6 Apr 2026
- 2026A Patch-based Cross-view Regularized Framework for Backdoor Defense in Multimodal Large Language Models6 Apr 2026
- 2025Bridging the Task Gap: Multi-Task Adversarial Transferability in CLIP and Its Derivatives28 Sep 2025
- 2025Bench2ADVLM: A Closed-Loop Benchmark for Vision-language Models in Autonomous Driving4 Aug 2025
- 2025Pushing the Limits of Safety: A Technical Report on the ATLAS Challenge 202514 Jun 2025
- 2025Manipulating Multimodal Agents via Cross-Modal Prompt Injection19 Apr 2025
- 2025E2AT: Multimodal Jailbreak Defense via Dynamic Joint Optimization for Multimodal Large Language Models5 Mar 2025
- 2024Patch is Enough: Naturalistic Adversarial Patch against Vision-Language Pre-training Models7 Oct 2024
- 2024Jailbreak Vision Language Models via Bi-Modal Adversarial Prompt6 Jun 2024
- 2024Boosting Transferability in Vision-Language Attacks via Diversification along the Intersection Region of Adversarial Trajectory19 Mar 2024
- 2024Effectiveness Assessment of Recent Large Vision-Language Models7 Mar 2024
- 2024VL-Trojan: Multimodal Instruction Backdoor Attacks against Autoregressive Visual Language Models21 Feb 2024
12 newest of 13 All 13 (JSON)
- 2025Adversarial Generation and Collaborative Evolution of Safety-Critical Scenarios for Autonomous Vehiclescited by 4
- 2025MetAdv: A Unified and Interactive Adversarial Testing Platform for Autonomous Drivingcited by 3
- 2026Benchmarking the Robustness of Autonomous Driving to Environmental Illusions: A Lane Perception Perspectivecited by 1
- 2026Benchmarking the Robustness of Autonomous Driving to Environmental Illusions: A Lane Perception Perspective7 Jul 2026
- 2025Adversarial Generation and Collaborative Evolution of Safety-Critical Scenarios for Autonomous Vehicles20 Aug 2025
- 2025MetAdv: A Unified and Interactive Adversarial Testing Platform for Autonomous Driving4 Aug 2025
- 2024Compromising Embodied Agents with Contextual Backdoor Attackscited by 29
- 2026Evolving Deception: When Agents Evolve, Deception Winscited by 1
- 2021Advances in adversarial attacks and defenses in computer vision: A surveycited by 127
- 2021Towards More Flexible and Accurate Object Tracking with Natural Language: Algorithms and Benchmarkcited by 124
- 2022Parallel Rectangle Flip Attack: A Query-based Black-box Attack against Object Detectioncited by 79
- 2023Enhancing Fine-Tuning Based Backdoor Defense with Sharpness-Aware Minimizationcited by 60
- 2023Boosting Adversarial Transferability by Achieving Flat Local Maximacited by 48
- 2023Neural Polarizer: A Lightweight and Effective Backdoor Defense via Purifying Poisoned Featurescited by 35
- 2022Prior-Guided Adversarial Initialization for Fast Adversarial Trainingcited by 34
- 2024Poisoned Forgery Face: Towards Backdoor Attacks on Face Forgery Detectioncited by 34
- 2022Towards Efficient Adversarial Training on Vision Transformerscited by 29
- 2023Rethinking the Backward Propagation for Adversarial Transferabilitycited by 27
- 2022WebUAV-3M: A Benchmark for Unveiling the Power of Million-Scale Deep UAV Trackingcited by 26
- 2021IoU Attack: Towards Temporally Coherent Black-Box Adversarial Attack for Visual Object Trackingcited by 25
12 most cited of 41 All 41 (JSON)
- 2026R-PGA: Robust Physical Adversarial Camouflage Generation via Relightable 3D Gaussian Splatting27 Mar 2026
- 2025Text Adversarial Attacks with Dynamic Outputs26 Sep 2025
- 2025FERD: Fairness-Enhanced Data-Free Robustness Distillation25 Sep 2025
- 2025Towards a 3D Transfer-based Black-box Attack via Critical Feature Guidance21 Aug 2025
- 2025Physical Adversarial Camouflage through Gradient Calibration and Regularization7 Aug 2025
- 2025GeoShield: Safeguarding Geolocation Privacy from Vision-Language Models via Adversarial Perturbations5 Aug 2025
- 2025Temporal Unlearnable Examples: Preventing Personal Video Data from Unauthorized Exploitation by Object Tracking10 Jul 2025
- 20253D Gaussian Splatting Driven Multi-View Robust Physical Adversarial Camouflage Generation2 Jul 2025
- 2025Towards Adaptive Meta-Gradient Adversarial Examples for Visual Tracking13 May 2025
- 2025No Query, No Access12 May 2025
- 2025Adversarial Attack for RGB-Event based Visual Object Tracking19 Apr 2025
- 2024Adversarial Attacks on LiDAR-Based Tracking Across Road Users: Robustness Evaluation and Target-Aware Black-Box Method28 Oct 2024
12 newest of 41 All 41 (JSON)