Pseudorandom Error-Correcting Codes
On the map: LLM safety and security → Watermarking generated content and models
Abstract (arXiv)
We construct pseudorandom error-correcting codes (or simply pseudorandom codes), which are error-correcting codes with the property that any polynomial number of codewords are pseudorandom to any computationally-bounded adversary. Efficient decoding of corrupted codewords is possible with the help of a decoding key. We build pseudorandom codes that are robust to substitution and deletion errors, where pseudorandomness rests on standard cryptographic assumptions. Specifically, pseudorandomness is based on either 2^O(√n)-hardness of LPN, or polynomial hardness of LPN and the planted XOR problem at low density. As our primary application of pseudorandom codes, we present an undetectable watermarking scheme for outputs of language models that is robust to cropping and a constant rate of random substitutions and deletions. The watermark is undetectable in the sense that any number of samples of watermarked text are computationally indistinguishable from text output by the original model. This is the first undetectable watermarking scheme that can tolerate a constant rate of errors. Our second application is to steganography, where a secret message is hidden in innocent-looking content. We present a constant-rate stateless steganography scheme with robustness to a constant rate of substitutions. Ours is the first stateless steganography scheme with provable steganographic security and any robustness to errors.
Key facts. Cited by 40 papers in the map (data through 7 Oct 2026). Placed in Watermarking generated content and models, one of 12 directions in LLM safety and security. Builds on 13 of its 49 references that are in the map. First posted on arXiv 14 Feb 2024.
Builds on
13 of 49 references.
Closest ancestors · 8
Same direction, newest first
- 2023Mark My Words: Analyzing and Evaluating Language Model Watermarks1 Dec
- 2023Watermarks in the Sand: Impossibility of Strong Watermarking for Generative Models7 Nov
- 2023Publicly-Detectable Watermarking for Language Models27 Oct
- 2023Robust Distortion-free Watermarks for Language Models28 Jul
- 2023Provable Robust Watermarking for AI-Generated Text30 Jun
- 2023On the Reliability of Watermarks for Large Language Models7 Jun
- 2023Undetectable Watermarks for Language Models25 May
- 2023A Watermark for Large Language Models24 Jan
Other references · 5
- 2023DetectGPT: Zero-Shot Machine-Generated Text Detection using Probability Curvaturecited by 705
- 2019Defending Against Neural Fake Newscited by 553
- 2023The Science of Detecting LLM-Generated Textscited by 126
- 2022Perfectly Secure Steganography Using Minimum Entropy Couplingcited by 42
- 2024Excuse me, sir? Your language model is leaking (information)cited by 11
Built on by
Citing papers per year: 2024: 10; 2025: 13; 2026: 17.
40 papers.
Sort:
By area:
- 2024An Undetectable Watermark for Generative Image Modelscited by 74
- 2024SoK: Watermarking for AI-Generated Contentcited by 43
- 2024Watermarking Language Models for Many Adaptive Userscited by 16
- 2025VideoMark: A Distortion-Free Robust Watermarking Framework for Video Diffusion Modelscited by 16
- 2025GaussMarker: Robust Dual-Domain Watermark for Diffusion Modelscited by 16
- 2024A Watermark for Black-Box Language Modelscited by 14
- 2025PMark: Towards Robust and Distortion-free Semantic-level Watermarking with Channel Constraintscited by 14
- 2024Edit Distance Robust Watermarks via Indexing Pseudorandom Codescited by 12
- 2024Provably Robust Watermarks for Open-Source Language Modelscited by 12
- 2024Watermarking Language Models with Error Correcting Codescited by 10
- 2025Radioactive Watermarks in Diffusion and Autoregressive Image Generative Modelscited by 6
- 2025Verifying LLM Inference to Detect Model Weight Exfiltrationcited by 6
28 more
- 2026Tool Use Enables Undetectable Steganography in Multi-Agent LLM Systemscited by 5
- 2025Mitigating Watermark Forgery in Generative Models via Randomized Key Selectioncited by 4
- 2025Secure and Robust Watermarking for AI-generated Images: A Comprehensive Surveycited by 4
- 2024Multi-Designated Detector Watermarking for Language Modelscited by 3
- 2025Innamark: A Whitespace Replacement Information-Hiding Methodcited by 3
- 2025Towards A Correct Usage of Cryptography in Semantic Watermarks for Diffusion Modelscited by 3
- 2026Disclosure By Design: Identity Transparency as a Behavioural Property of Conversational AI Modelscited by 3
- 2024Injecting Undetectable Backdoors in Obfuscated Neural Networks and Language Modelscited by 2
- 2026ArcMark: Distortion-Free Multi-Byte LLM Watermark via Optimal Transportcited by 2
- 2026OSI: One-step Inversion Excels in Extracting Diffusion Watermarkscited by 2
- 2026SIGMark: Scalable In-Generation Watermark with Blind Extraction for Video Diffusioncited by 2
- 2026Watermarking Should Be Treated as a Monitoring Primitivecited by 2
- 2025SWA-LDM: Toward Stealthy Watermarks for Latent Diffusion Modelscited by 1
- 2025The Coding Limits of Robust Watermarking for Generative Modelscited by 1
- 2025Ideal Attribution and Faithful Watermarks for Language Modelscited by 1
- 2026Block-wise Codeword Embedding for Reliable Multi-bit Text Watermarkingcited by 1
- 2026SAMark: A Self-Anchored Text Watermarking with Paragraph-Level Paraphrase Robustnesscited by 1
- 2026Rethinking Forgery Attacks on Semantic Watermarks in Black-Box Settings: A Geometric Distortion Perspectivecited by 1
- 2024Watermark Smoothing Attacks against Language Modelscited by 0
- 2025Watermarks for Language Models via Probabilistic Automatacited by 0
- 2026PGID: Progressive Guided Inversion and Denoising for Robust Watermark Detectioncited by 0
- 2026CORE-BREW: LLR-Based Soft Decoding for Robust Multi-Bit LLM Watermarkingcited by 0
- 2026"AI Watermarking": Bridging Policy Discourse and Technical Capabilitiescited by 0
- 2026Watermark Forensics for Generative Models: An Information-Theoretic Perspectivecited by 0
- 2026Robust Watermarks Meet Backdoored Models: Evading Diffusion Semantic Watermarks via Stealthy Backdoorcited by 0
- 2026Attribute-based Undetectable Watermarking for Generative AI Modelscited by 0
- 2026Codetta: High-Capacity, Keyless, and Undetectable Multi-Agent Collusioncited by 0
- 2026Anchor-ECC: Local Integrity Checking for Watermarked LLM Outputs via Error-Correcting Codescited by 0
- 2026Anchor-ECC: Local Integrity Checking for Watermarked LLM Outputs via Error-Correcting Codes30 Sep 2026
- 2026Codetta: High-Capacity, Keyless, and Undetectable Multi-Agent Collusion24 Sep 2026
- 2026Attribute-based Undetectable Watermarking for Generative AI Models4 Aug 2026
- 2026Robust Watermarks Meet Backdoored Models: Evading Diffusion Semantic Watermarks via Stealthy Backdoor1 Aug 2026
- 2026Watermark Forensics for Generative Models: An Information-Theoretic Perspective14 Jul 2026
- 2026Rethinking Forgery Attacks on Semantic Watermarks in Black-Box Settings: A Geometric Distortion Perspective29 Jun 2026
- 2026Tool Use Enables Undetectable Steganography in Multi-Agent LLM Systems25 Jun 2026
- 2026CORE-BREW: LLR-Based Soft Decoding for Robust Multi-Bit LLM Watermarking23 Jun 2026
- 2026"AI Watermarking": Bridging Policy Discourse and Technical Capabilities25 May 2026
- 2026SAMark: A Self-Anchored Text Watermarking with Paragraph-Level Paraphrase Robustness25 May 2026
- 2026Watermarking Should Be Treated as a Monitoring Primitive13 May 2026
- 2026PGID: Progressive Guided Inversion and Denoising for Robust Watermark Detection10 May 2026
28 more
- 2026Block-wise Codeword Embedding for Reliable Multi-bit Text Watermarking1 May 2026
- 2026SIGMark: Scalable In-Generation Watermark with Blind Extraction for Video Diffusion3 Mar 2026
- 2026OSI: One-step Inversion Excels in Extracting Diffusion Watermarks10 Feb 2026
- 2026ArcMark: Distortion-Free Multi-Byte LLM Watermark via Optimal Transport6 Feb 2026
- 2026Disclosure By Design: Identity Transparency as a Behavioural Property of Conversational AI Models27 Jan 2026
- 2025Watermarks for Language Models via Probabilistic Automata11 Dec 2025
- 2025Ideal Attribution and Faithful Watermarks for Language Models7 Dec 2025
- 2025Verifying LLM Inference to Detect Model Weight Exfiltration4 Nov 2025
- 2025Secure and Robust Watermarking for AI-generated Images: A Comprehensive Survey30 Sep 2025
- 2025PMark: Towards Robust and Distortion-free Semantic-level Watermarking with Channel Constraints25 Sep 2025
- 2025The Coding Limits of Robust Watermarking for Generative Models11 Sep 2025
- 2025Mitigating Watermark Forgery in Generative Models via Randomized Key Selection10 Jul 2025
- 2025Radioactive Watermarks in Diffusion and Autoregressive Image Generative Models30 Jun 2025
- 2025GaussMarker: Robust Dual-Domain Watermark for Diffusion Models13 Jun 2025
- 2025VideoMark: A Distortion-Free Robust Watermarking Framework for Video Diffusion Models23 Apr 2025
- 2025Towards A Correct Usage of Cryptography in Semantic Watermarks for Diffusion Models14 Mar 2025
- 2025Innamark: A Whitespace Replacement Information-Hiding Method18 Feb 2025
- 2025SWA-LDM: Toward Stealthy Watermarks for Latent Diffusion Models14 Feb 2025
- 2024SoK: Watermarking for AI-Generated Content27 Nov 2024
- 2024Provably Robust Watermarks for Open-Source Language Models24 Oct 2024
- 2024An Undetectable Watermark for Generative Image Models9 Oct 2024
- 2024A Watermark for Black-Box Language Models2 Oct 2024
- 2024Multi-Designated Detector Watermarking for Language Models26 Sep 2024
- 2024Watermark Smoothing Attacks against Language Models19 Jul 2024
- 2024Watermarking Language Models with Error Correcting Codes12 Jun 2024
- 2024Injecting Undetectable Backdoors in Obfuscated Neural Networks and Language Models9 Jun 2024
- 2024Edit Distance Robust Watermarks via Indexing Pseudorandom Codes4 Jun 2024
- 2024Watermarking Language Models for Many Adaptive Users17 May 2024
- 2024SoK: Watermarking for AI-Generated Contentcited by 43
- 2024Watermarking Language Models for Many Adaptive Userscited by 16
- 2024A Watermark for Black-Box Language Modelscited by 14
- 2025PMark: Towards Robust and Distortion-free Semantic-level Watermarking with Channel Constraintscited by 14
- 2024Provably Robust Watermarks for Open-Source Language Modelscited by 12
- 2024Watermarking Language Models with Error Correcting Codescited by 10
- 2025Radioactive Watermarks in Diffusion and Autoregressive Image Generative Modelscited by 6
- 2025Mitigating Watermark Forgery in Generative Models via Randomized Key Selectioncited by 4
- 2025Secure and Robust Watermarking for AI-generated Images: A Comprehensive Surveycited by 4
- 2024Multi-Designated Detector Watermarking for Language Modelscited by 3
- 2025Innamark: A Whitespace Replacement Information-Hiding Methodcited by 3
- 2024Injecting Undetectable Backdoors in Obfuscated Neural Networks and Language Modelscited by 2
12 most cited of 24 All 24 (JSON)
- 2026Anchor-ECC: Local Integrity Checking for Watermarked LLM Outputs via Error-Correcting Codes30 Sep 2026
- 2026Attribute-based Undetectable Watermarking for Generative AI Models4 Aug 2026
- 2026Watermark Forensics for Generative Models: An Information-Theoretic Perspective14 Jul 2026
- 2026CORE-BREW: LLR-Based Soft Decoding for Robust Multi-Bit LLM Watermarking23 Jun 2026
- 2026"AI Watermarking": Bridging Policy Discourse and Technical Capabilities25 May 2026
- 2026SAMark: A Self-Anchored Text Watermarking with Paragraph-Level Paraphrase Robustness25 May 2026
- 2026Block-wise Codeword Embedding for Reliable Multi-bit Text Watermarking1 May 2026
- 2026ArcMark: Distortion-Free Multi-Byte LLM Watermark via Optimal Transport6 Feb 2026
- 2025Watermarks for Language Models via Probabilistic Automata11 Dec 2025
- 2025Ideal Attribution and Faithful Watermarks for Language Models7 Dec 2025
- 2025Secure and Robust Watermarking for AI-generated Images: A Comprehensive Survey30 Sep 2025
- 2025PMark: Towards Robust and Distortion-free Semantic-level Watermarking with Channel Constraints25 Sep 2025
12 newest of 24 All 24 (JSON)
- 2024An Undetectable Watermark for Generative Image Modelscited by 74
- 2025VideoMark: A Distortion-Free Robust Watermarking Framework for Video Diffusion Modelscited by 16
- 2025GaussMarker: Robust Dual-Domain Watermark for Diffusion Modelscited by 16
- 2025Towards A Correct Usage of Cryptography in Semantic Watermarks for Diffusion Modelscited by 3
- 2026SIGMark: Scalable In-Generation Watermark with Blind Extraction for Video Diffusioncited by 2
- 2025SWA-LDM: Toward Stealthy Watermarks for Latent Diffusion Modelscited by 1
- 2026Rethinking Forgery Attacks on Semantic Watermarks in Black-Box Settings: A Geometric Distortion Perspectivecited by 1
- 2026Robust Watermarks Meet Backdoored Models: Evading Diffusion Semantic Watermarks via Stealthy Backdoorcited by 0
- 2026Robust Watermarks Meet Backdoored Models: Evading Diffusion Semantic Watermarks via Stealthy Backdoor1 Aug 2026
- 2026Rethinking Forgery Attacks on Semantic Watermarks in Black-Box Settings: A Geometric Distortion Perspective29 Jun 2026
- 2026SIGMark: Scalable In-Generation Watermark with Blind Extraction for Video Diffusion3 Mar 2026
- 2025GaussMarker: Robust Dual-Domain Watermark for Diffusion Models13 Jun 2025
- 2025VideoMark: A Distortion-Free Robust Watermarking Framework for Video Diffusion Models23 Apr 2025
- 2025Towards A Correct Usage of Cryptography in Semantic Watermarks for Diffusion Models14 Mar 2025
- 2025SWA-LDM: Toward Stealthy Watermarks for Latent Diffusion Models14 Feb 2025
- 2024An Undetectable Watermark for Generative Image Models9 Oct 2024
- 2024Edit Distance Robust Watermarks via Indexing Pseudorandom Codescited by 12
- 2025Verifying LLM Inference to Detect Model Weight Exfiltrationcited by 6
- 2026Disclosure By Design: Identity Transparency as a Behavioural Property of Conversational AI Modelscited by 3
- 2026OSI: One-step Inversion Excels in Extracting Diffusion Watermarkscited by 2
- 2026Watermarking Should Be Treated as a Monitoring Primitivecited by 2
- 2026PGID: Progressive Guided Inversion and Denoising for Robust Watermark Detectioncited by 0
- 2026Watermarking Should Be Treated as a Monitoring Primitive13 May 2026
- 2026PGID: Progressive Guided Inversion and Denoising for Robust Watermark Detection10 May 2026
- 2026OSI: One-step Inversion Excels in Extracting Diffusion Watermarks10 Feb 2026
- 2026Disclosure By Design: Identity Transparency as a Behavioural Property of Conversational AI Models27 Jan 2026
- 2025Verifying LLM Inference to Detect Model Weight Exfiltration4 Nov 2025
- 2024Edit Distance Robust Watermarks via Indexing Pseudorandom Codes4 Jun 2024