mlsanityData to 14 Oct 2026

SHIFT: Stochastic Hidden-Trajectory Deflection for Removing Diffusion-based Watermark

arXiv 2603.29742 ↗First posted 31 Mar 2026cs.CV cs.CRcited by 4

On the map: LLM safety and security → Watermarking generated content and models

Abstract (arXiv)

Diffusion-based watermarking methods embed verifiable marks by manipulating the initial noise or the reverse diffusion trajectory. However, these methods share a critical assumption: verification can succeed only if the diffusion trajectory can be faithfully reconstructed. This reliance on trajectory recovery constitutes a fundamental and exploitable vulnerability. We propose underlineStochastic underlineHidden-Trajectory Deunderlineflecunderlinetion (SHIFT), a training-free attack that exploits this common weakness across diverse watermarking paradigms. SHIFT leverages stochastic diffusion resampling to deflect the generative trajectory in latent space, making the reconstructed image statistically decoupled from the original watermark-embedded trajectory while preserving strong visual quality and semantic consistency. Extensive experiments on nine representative watermarking methods spanning noise-space, frequency-domain, and optimization-based paradigms show that SHIFT achieves 95%--100% attack success rates with nearly no loss in semantic quality, without requiring any watermark-specific knowledge or model retraining.

Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Placed in Watermarking generated content and models, one of 12 directions in LLM safety and security. Builds on 39 of its 45 references that are in the map. First posted on arXiv 31 Mar 2026.

Builds on

39 of 45 references.

Closest ancestors · 11

Same direction, newest first

  1. 2026Breaking Semantic-Aware Watermarks via LLM-Guided Coherence-Preserving Semantic Injection25 Feb
  2. 2025Semantic Watermarking Reinvented: Enhancing Robustness and Generation Quality with Fourier Integrity9 Sep
  3. 2025GaussMarker: Robust Dual-Domain Watermark for Diffusion Models13 Jun
  4. 2025Forging and Removing Latent-Noise Diffusion Watermarks Using a Single Image27 Apr
  5. 2025VideoShield: Regulating Diffusion-based Video Generation Models via Watermarking24 Jan
  6. 2024Black-Box Forgery Attacks on Semantic Watermarks for Diffusion Models4 Dec
  7. 2024ROBIN: Robust and Invisible Watermarks for Diffusion Models with Adversarial Optimization6 Nov
  8. 2024An Undetectable Watermark for Generative Image Models9 Oct
  9. 2024Gaussian Shading: Provable Performance-Lossless Image Watermarking for Diffusion Models7 Apr
  10. 2023Robustness of AI-Image Detectors: Fundamental Limits and Practical Attacks29 Sep
  11. 2023Invisible Image Watermarks Are Provably Removable Using Generative AI2 Jun

Other references · 28

  1. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  3. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
  4. 2020Denoising Diffusion Implicit Modelscited by 9,781
  5. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
  6. 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,101
  7. 2020Taming Transformers for High-Resolution Image Synthesiscited by 3,253
  8. 2021CLIPScore: A Reference-free Evaluation Metric for Image Captioningcited by 2,424
  9. 2022DPM-Solver: A Fast ODE Solver for Diffusion Probabilistic Model Sampling in Around 10 Stepscited by 1,979
  10. 2022Null-text Inversion for Editing Real Images using Guided Diffusion Modelscited by 1,179
  11. 2024Visual Autoregressive Modeling: Scalable Image Generation via Next-Scale Predictioncited by 1,023
  12. 2022Pseudo Numerical Methods for Diffusion Models on Manifoldscited by 700
16 more
  1. 2023UniPC: A Unified Predictor-Corrector Framework for Fast Sampling of Diffusion Modelscited by 450
  2. 2022EDICT: Exact Diffusion Inversion via Coupled Transformationscited by 258
  3. 2024RingID: Rethinking Tree-Ring Watermarking for Enhanced Multi-Key Identificationcited by 91
  4. 2024FlowAR: Scale-wise Autoregressive Image Generation Meets Flow Matchingcited by 80
  5. 2023SA-Solver: Stochastic Adams Solver for Fast Sampling of Diffusion Modelscited by 72
  6. 2023The Blessing of Randomness: SDE Beats ODE in General Diffusion-based Image Editingcited by 62
  7. 2024Image Watermarks are Removable Using Controllable Regeneration from Clean Noisecited by 50
  8. 2024Schedule Your Edit: A Simple yet Effective Diffusion Noise Schedule for Image Editingcited by 39
  9. 2023SEEDS: Exponential SDE Solvers for Fast High-Quality Sampling from Diffusion Modelscited by 36
  10. 2024Hidden in the Noise: Two-Stage Robust Watermarking for Imagescited by 21
  11. 2025VideoMark: A Distortion-Free Robust Watermarking Framework for Video Diffusion Modelscited by 18
  12. 2025SEAL: Semantic Aware Image Watermarkingcited by 15
  13. 2025On Computational Limits of FlowAR Models: Expressivity and Efficiencycited by 10
  14. 2025ARFlow: Autoregressive Flow with Hybrid Linear Attentioncited by 7
  15. 2026SLICE: Semantic Latent Injection via Compartmentalized Embedding for Image Watermarkingcited by 7
  16. 2025Low-Compute Watermark Removal via Dual-Domain Natural Projectioncited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 4.

4 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026DRIFT: Removing Diffusion Watermarks by Deflecting the Generative Trajectory
  2. 2025Diffusion-Based Image Editing: An Unforeseen Adversary to Robust Invisible Watermarks
  3. 2026Editing Away the Evidence: Diffusion-Based Image Manipulation and the Failure Modes of Robust Watermarking
  4. 2025OptMark: Robust Multi-bit Diffusion Watermarking via Inference Time Optimization
  5. 2026Vanishing Watermarks: Diffusion-Based Image Editing Undermines Robust Invisible Watermarking
  6. 2026When Denoising Becomes Unsigning: Theoretical and Empirical Analysis of Watermark Fragility Under Diffusion-Based Image Editing
  7. 2025PT-Mark: Invisible Watermarking for Text-to-image Diffusion Models via Semantic-aware Pivotal Tuning
  8. 2025On the Information-Theoretic Fragility of Robust Watermarking under Diffusion Editing