SHIFT: Stochastic Hidden-Trajectory Deflection for Removing Diffusion-based Watermark
On the map: LLM safety and security → Watermarking generated content and models
Abstract (arXiv)
Diffusion-based watermarking methods embed verifiable marks by manipulating the initial noise or the reverse diffusion trajectory. However, these methods share a critical assumption: verification can succeed only if the diffusion trajectory can be faithfully reconstructed. This reliance on trajectory recovery constitutes a fundamental and exploitable vulnerability. We propose underlineStochastic underlineHidden-Trajectory Deunderlineflecunderlinetion (SHIFT), a training-free attack that exploits this common weakness across diverse watermarking paradigms. SHIFT leverages stochastic diffusion resampling to deflect the generative trajectory in latent space, making the reconstructed image statistically decoupled from the original watermark-embedded trajectory while preserving strong visual quality and semantic consistency. Extensive experiments on nine representative watermarking methods spanning noise-space, frequency-domain, and optimization-based paradigms show that SHIFT achieves 95%--100% attack success rates with nearly no loss in semantic quality, without requiring any watermark-specific knowledge or model retraining.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Placed in Watermarking generated content and models, one of 12 directions in LLM safety and security. Builds on 39 of its 45 references that are in the map. First posted on arXiv 31 Mar 2026.
Builds on
39 of 45 references.
Closest ancestors · 11
Same direction, newest first
- 2026Breaking Semantic-Aware Watermarks via LLM-Guided Coherence-Preserving Semantic Injection25 Feb
- 2025Semantic Watermarking Reinvented: Enhancing Robustness and Generation Quality with Fourier Integrity9 Sep
- 2025GaussMarker: Robust Dual-Domain Watermark for Diffusion Models13 Jun
- 2025Forging and Removing Latent-Noise Diffusion Watermarks Using a Single Image27 Apr
- 2025VideoShield: Regulating Diffusion-based Video Generation Models via Watermarking24 Jan
- 2024Black-Box Forgery Attacks on Semantic Watermarks for Diffusion Models4 Dec
- 2024ROBIN: Robust and Invisible Watermarks for Diffusion Models with Adversarial Optimization6 Nov
- 2024An Undetectable Watermark for Generative Image Models9 Oct
- 2024Gaussian Shading: Provable Performance-Lossless Image Watermarking for Diffusion Models7 Apr
- 2023Robustness of AI-Image Detectors: Fundamental Limits and Practical Attacks29 Sep
- 2023Invisible Image Watermarks Are Provably Removable Using Generative AI2 Jun
Other references · 28
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 2020Denoising Diffusion Implicit Modelscited by 9,781
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
- 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,101
- 2020Taming Transformers for High-Resolution Image Synthesiscited by 3,253
- 2021CLIPScore: A Reference-free Evaluation Metric for Image Captioningcited by 2,424
- 2022DPM-Solver: A Fast ODE Solver for Diffusion Probabilistic Model Sampling in Around 10 Stepscited by 1,979
- 2022Null-text Inversion for Editing Real Images using Guided Diffusion Modelscited by 1,179
- 2024Visual Autoregressive Modeling: Scalable Image Generation via Next-Scale Predictioncited by 1,023
- 2022Pseudo Numerical Methods for Diffusion Models on Manifoldscited by 700
16 more
- 2023UniPC: A Unified Predictor-Corrector Framework for Fast Sampling of Diffusion Modelscited by 450
- 2022EDICT: Exact Diffusion Inversion via Coupled Transformationscited by 258
- 2024RingID: Rethinking Tree-Ring Watermarking for Enhanced Multi-Key Identificationcited by 91
- 2024FlowAR: Scale-wise Autoregressive Image Generation Meets Flow Matchingcited by 80
- 2023SA-Solver: Stochastic Adams Solver for Fast Sampling of Diffusion Modelscited by 72
- 2023The Blessing of Randomness: SDE Beats ODE in General Diffusion-based Image Editingcited by 62
- 2024Image Watermarks are Removable Using Controllable Regeneration from Clean Noisecited by 50
- 2024Schedule Your Edit: A Simple yet Effective Diffusion Noise Schedule for Image Editingcited by 39
- 2023SEEDS: Exponential SDE Solvers for Fast High-Quality Sampling from Diffusion Modelscited by 36
- 2024Hidden in the Noise: Two-Stage Robust Watermarking for Imagescited by 21
- 2025VideoMark: A Distortion-Free Robust Watermarking Framework for Video Diffusion Modelscited by 18
- 2025SEAL: Semantic Aware Image Watermarkingcited by 15
- 2025On Computational Limits of FlowAR Models: Expressivity and Efficiencycited by 10
- 2025ARFlow: Autoregressive Flow with Hybrid Linear Attentioncited by 7
- 2026SLICE: Semantic Latent Injection via Compartmentalized Embedding for Image Watermarkingcited by 7
- 2025Low-Compute Watermark Removal via Dual-Domain Natural Projectioncited by 1
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026Watermark Forensics for Generative Models: An Information-Theoretic Perspectivecited by 1
- 2026CoRA-NAS: Coarse Ranking and Anchor-Residual Refinement for Neural Architecture Searchcited by 1
- 2026RiPPLE: Cross-Space Performance Prediction from Early Training for Neural Architecture Searchcited by 0
- 2026Rethinking Visual Provenance: Detection and Watermarking Across Direct Visual Generation and LLM-Driven Code Renderingcited by 0
- 2026Rethinking Visual Provenance: Detection and Watermarking Across Direct Visual Generation and LLM-Driven Code Rendering6 Oct 2026
- 2026RiPPLE: Cross-Space Performance Prediction from Early Training for Neural Architecture Search11 Sep 2026
- 2026CoRA-NAS: Coarse Ranking and Anchor-Residual Refinement for Neural Architecture Search10 Sep 2026
- 2026Watermark Forensics for Generative Models: An Information-Theoretic Perspective14 Jul 2026
Similar, not cited
Close in wording, no citation either way
- 2026DRIFT: Removing Diffusion Watermarks by Deflecting the Generative Trajectory
- 2025Diffusion-Based Image Editing: An Unforeseen Adversary to Robust Invisible Watermarks
- 2026Editing Away the Evidence: Diffusion-Based Image Manipulation and the Failure Modes of Robust Watermarking
- 2025OptMark: Robust Multi-bit Diffusion Watermarking via Inference Time Optimization
- 2026Vanishing Watermarks: Diffusion-Based Image Editing Undermines Robust Invisible Watermarking
- 2026When Denoising Becomes Unsigning: Theoretical and Empirical Analysis of Watermark Fragility Under Diffusion-Based Image Editing
- 2025PT-Mark: Invisible Watermarking for Text-to-image Diffusion Models via Semantic-aware Pivotal Tuning
- 2025On the Information-Theoretic Fragility of Robust Watermarking under Diffusion Editing