Beyond Detection: Multi-Scale Hidden-Code for Natural Image Deepfake Recovery and Factual Retrieval
On the map: LLM safety and security → Watermarking generated content and models
Abstract (arXiv)
Recent advances in image authenticity have primarily focused on deepfake detection and localization, leaving recovery of tampered contents for factual retrieval relatively underexplored. We propose a unified hidden-code recovery framework that enables both retrieval and restoration from post-hoc and in-generation watermarking paradigms. Our method encodes semantic and perceptual information into a compact hidden-code representation, refined through multi-scale vector quantization, and enhances contextual reasoning via conditional Transformer modules. To enable systematic evaluation for natural images, we construct ImageNet-S, a benchmark that provides paired image-label factual retrieval tasks. Extensive experiments on ImageNet-S demonstrate that our method exhibits promising retrieval and reconstruction performance while remaining fully compatible with diverse watermarking pipelines. This framework establishes a foundation for general-purpose image recovery beyond detection and localization.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Watermarking generated content and models, one of 12 directions in LLM safety and security. Builds on 21 of its 33 references that are in the map. First posted on arXiv 26 Feb 2026.
Builds on
21 of 33 references.
Closest ancestors · 4
Same direction, newest first
- 2025MaXsive: High-Capacity and Robust Training-Free Generative Image Watermarking in Diffusion Models28 Jul
- 2025VideoShield: Regulating Diffusion-based Video Generation Models via Watermarking24 Jan
- 2024Black-Box Forgery Attacks on Semantic Watermarks for Diffusion Models4 Dec
- 2024Gaussian Shading: Provable Performance-Lossless Image Watermarking for Diffusion Models7 Apr
Other references · 17
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2017Neural Discrete Representation Learningcited by 4,650
- 2020Taming Transformers for High-Resolution Image Synthesiscited by 3,229
- 2022RePaint: Inpainting using Denoising Diffusion Probabilistic Modelscited by 1,419
- 2024Visual Autoregressive Modeling: Scalable Image Generation via Next-Scale Predictioncited by 1,005
- 2023LISA: Reasoning Segmentation via Large Language Modelcited by 770
- 2018HiDDeN: Hiding Data With Deep Networkscited by 384
- 2024FakeShield: Explainable Image Forgery Detection and Localization via Multi-modal Large Language Modelscited by 111
- 2023EditGuard: Versatile Image Watermarking for Tamper Localization and Copyright Protectioncited by 109
- 2024SIDA: Social Media Image Deepfake Detection, Localization and Explanation with Large Multimodal Modelcited by 107
- 2024RingID: Rethinking Tree-Ring Watermarking for Enhanced Multi-Key Identificationcited by 87
5 more
- 2022Fine-Grained Face Swapping via Regional GAN Inversioncited by 67
- 2024Realistic and Efficient Face Swapping: A Unified Approach with Diffusion Modelscited by 35
- 2024OmniGuard: Hybrid Manipulation Localization via Augmented Versatile Deep Image Watermarkingcited by 35
- 2024Reversing the Irreversible: A Survey on Inverse Biometricscited by 4
- 2024DFREC: DeepFake Identity Recovery Based on Identity-aware Masked Autoencodercited by 2
Built on by
Not cited yet.