JND-Guided Neural Watermarking with Spatial Transformer Decoding for Screen-Capture Robustness
Not on the map. Why?
Abstract (arXiv)
Screen-shooting robust watermarking aims to imperceptibly embed extractable information into host images such that the watermark survives the complex distortion pipeline of screen display and camera recapture. However, achieving high extraction accuracy while maintaining satisfactory visual quality remains an open challenge, primarily because the screen-shooting channel introduces severe and entangled degradations including Moir'e patterns, color-gamut shifts, perspective warping, and sensor noise. In this paper, we present an end-to-end deep learning framework that jointly optimizes watermark embedding and extraction for screen-shooting robustness. Our framework incorporates three key innovations: (i) a comprehensive noise simulation layer that faithfully models realistic screen-shooting distortions -- notably including a physically-motivated Moir'e pattern generator -- enabling the network to learn robust representations against the full spectrum of capture-channel noise through adversarial training; (ii) a Just Noticeable Distortion (JND) perceptual loss function that adaptively modulates watermark embedding strength by supervising the perceptual discrepancy between the JND coefficient map and the watermark residual, thereby concentrating watermark energy in perceptually insensitive regions to maximize visual quality; and (iii) two complementary automatic localization modules -- a semantic-segmentation-based foreground extractor for captured image rectification and a symmetric noise template mechanism for anti-cropping region recovery -- that enable fully automated watermark decoding under realistic deployment conditions. Extensive experiments demonstrate that our method achieves an average PSNR of 30.94~dB and SSIM of 0.94 on watermarked images while embedding 127-bit payloads.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 26 of its 60 references that are in the map. First posted on arXiv 24 Mar 2026.
Builds on
26 of 60 references.
References · 26
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 2015You Only Look Once: Unified, Real-Time Object Detectioncited by 4,852
- 2018Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentationcited by 3,223
- 2015Spatial Transformer Networkscited by 1,429
- 2018HiDDeN: Hiding Data With Deep Networkscited by 397
- 2019StegaStamp: Invisible Hyperlinks in Physical Photographscited by 265
- 2023DocPedia: Unleashing the Power of Large Multimodal Model in the Frequency Domain for Versatile Document Understandingcited by 106
- 2023UniDoc: A Universal Large Multimodal Model for Simultaneous Text Detection, Recognition, Spotting and Understandingcited by 74
- 2024TextSquare: Scaling up Text-Centric Visual Instruction Tuningcited by 62
- 2024Harmonizing Visual Text Comprehension and Generationcited by 54
14 more
- 2023Multi-modal In-Context Learning Makes an Ego-evolving Scene Text Recognizercited by 53
- 2026Seed1.8 Model Card: Towards Generalized Real-World Agencycited by 50
- 2025Enhancing Low-Cost Video Editing with Lightweight Adaptors and Temporal-Aware Inversioncited by 28
- 2024MCTBench: Multimodal Cognition towards Text-Rich Visual Scenes Benchmarkcited by 26
- 2025Advancing Sequential Numerical Prediction in Autoregressive Modelscited by 26
- 2025CME-CAD: Heterogeneous Collaborative Multi-Expert Reinforcement Learning for CAD Code Generationcited by 19
- 2025Resolving Evidence Sparsity: Agentic Context Engineering for Long-Document Understandingcited by 18
- 2023Real-Time Idling Vehicles Detection using Combined Audio-Visual Deep Learningcited by 17
- 2025Enhancing Intent Understanding for Ambiguous prompt: A Human-Machine Co-Adaption Strategycited by 16
- 2026TextPecker: Rewarding Structural Anomaly Quantification for Enhancing Visual Text Renderingcited by 15
- 2024Joint Audio-Visual Idling Vehicle Detection with Streamlined Input Dependenciescited by 14
- 2026Diffusion Probe: Generated Image Result Prediction Using CNN Probescited by 14
- 2019AIM 2019 Challenge on Image Demoireing: Dataset and Studycited by 13
- 2026TC-Pad'e: Trajectory-Consistent Pad'e Approximation for Diffusion Accelerationcited by 10
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Decoupling Defense Strategies for Robust Image Watermarking
- 2025Pixel Seal: Adversarial-only training for invisible image and video watermarking
- 2022A Screen-Shooting Resilient Document Image Watermarking Scheme using Deep Neural Network
- 2025Robust Watermarks Leak: Channel-Aware Feature Extraction Enables Adversarial Watermark Manipulation
- 2025Sim-to-Real: An Unsupervised Noise Layer for Screen-Camera Watermarking Robustness
- 2026Compositional Adversarial Training for Robust Visual Watermarking
- 2024END2: Robust Dual-Decoder Watermarking Framework Against Non-Differentiable Distortions
- 2025WaterFlow: Learning Fast & Robust Watermarks using Stable Diffusion