mlsanityData to 7 Oct 2026

Pseudorandom Error-Correcting Codes

arXiv 2402.09370 ↗First posted 14 Feb 2024cs.CR cs.AI cs.LGcited by 40

On the map: LLM safety and security → Watermarking generated content and models

Abstract (arXiv)

We construct pseudorandom error-correcting codes (or simply pseudorandom codes), which are error-correcting codes with the property that any polynomial number of codewords are pseudorandom to any computationally-bounded adversary. Efficient decoding of corrupted codewords is possible with the help of a decoding key. We build pseudorandom codes that are robust to substitution and deletion errors, where pseudorandomness rests on standard cryptographic assumptions. Specifically, pseudorandomness is based on either 2^O(√n)-hardness of LPN, or polynomial hardness of LPN and the planted XOR problem at low density. As our primary application of pseudorandom codes, we present an undetectable watermarking scheme for outputs of language models that is robust to cropping and a constant rate of random substitutions and deletions. The watermark is undetectable in the sense that any number of samples of watermarked text are computationally indistinguishable from text output by the original model. This is the first undetectable watermarking scheme that can tolerate a constant rate of errors. Our second application is to steganography, where a secret message is hidden in innocent-looking content. We present a constant-rate stateless steganography scheme with robustness to a constant rate of substitutions. Ours is the first stateless steganography scheme with provable steganographic security and any robustness to errors.

Key facts. Cited by 40 papers in the map (data through 7 Oct 2026). Placed in Watermarking generated content and models, one of 12 directions in LLM safety and security. Builds on 13 of its 49 references that are in the map. First posted on arXiv 14 Feb 2024.

Builds on

13 of 49 references.

Closest ancestors · 8

Same direction, newest first

  1. 2023Mark My Words: Analyzing and Evaluating Language Model Watermarks1 Dec
  2. 2023Watermarks in the Sand: Impossibility of Strong Watermarking for Generative Models7 Nov
  3. 2023Publicly-Detectable Watermarking for Language Models27 Oct
  4. 2023Robust Distortion-free Watermarks for Language Models28 Jul
  5. 2023Provable Robust Watermarking for AI-Generated Text30 Jun
  6. 2023On the Reliability of Watermarks for Large Language Models7 Jun
  7. 2023Undetectable Watermarks for Language Models25 May
  8. 2023A Watermark for Large Language Models24 Jan

Other references · 5

  1. 2023DetectGPT: Zero-Shot Machine-Generated Text Detection using Probability Curvaturecited by 705
  2. 2019Defending Against Neural Fake Newscited by 553
  3. 2023The Science of Detecting LLM-Generated Textscited by 126
  4. 2022Perfectly Secure Steganography Using Minimum Entropy Couplingcited by 42
  5. 2024Excuse me, sir? Your language model is leaking (information)cited by 11

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 10; 2025: 13; 2026: 17.

40 papers.

Sort:

By area:

  1. 2024An Undetectable Watermark for Generative Image Modelscited by 74
  2. 2024SoK: Watermarking for AI-Generated Contentcited by 43
  3. 2024Watermarking Language Models for Many Adaptive Userscited by 16
  4. 2025VideoMark: A Distortion-Free Robust Watermarking Framework for Video Diffusion Modelscited by 16
  5. 2025GaussMarker: Robust Dual-Domain Watermark for Diffusion Modelscited by 16
  6. 2024A Watermark for Black-Box Language Modelscited by 14
  7. 2025PMark: Towards Robust and Distortion-free Semantic-level Watermarking with Channel Constraintscited by 14
  8. 2024Edit Distance Robust Watermarks via Indexing Pseudorandom Codescited by 12
  9. 2024Provably Robust Watermarks for Open-Source Language Modelscited by 12
  10. 2024Watermarking Language Models with Error Correcting Codescited by 10
  11. 2025Radioactive Watermarks in Diffusion and Autoregressive Image Generative Modelscited by 6
  12. 2025Verifying LLM Inference to Detect Model Weight Exfiltrationcited by 6
28 more
  1. 2026Tool Use Enables Undetectable Steganography in Multi-Agent LLM Systemscited by 5
  2. 2025Mitigating Watermark Forgery in Generative Models via Randomized Key Selectioncited by 4
  3. 2025Secure and Robust Watermarking for AI-generated Images: A Comprehensive Surveycited by 4
  4. 2024Multi-Designated Detector Watermarking for Language Modelscited by 3
  5. 2025Innamark: A Whitespace Replacement Information-Hiding Methodcited by 3
  6. 2025Towards A Correct Usage of Cryptography in Semantic Watermarks for Diffusion Modelscited by 3
  7. 2026Disclosure By Design: Identity Transparency as a Behavioural Property of Conversational AI Modelscited by 3
  8. 2024Injecting Undetectable Backdoors in Obfuscated Neural Networks and Language Modelscited by 2
  9. 2026ArcMark: Distortion-Free Multi-Byte LLM Watermark via Optimal Transportcited by 2
  10. 2026OSI: One-step Inversion Excels in Extracting Diffusion Watermarkscited by 2
  11. 2026SIGMark: Scalable In-Generation Watermark with Blind Extraction for Video Diffusioncited by 2
  12. 2026Watermarking Should Be Treated as a Monitoring Primitivecited by 2
  13. 2025SWA-LDM: Toward Stealthy Watermarks for Latent Diffusion Modelscited by 1
  14. 2025The Coding Limits of Robust Watermarking for Generative Modelscited by 1
  15. 2025Ideal Attribution and Faithful Watermarks for Language Modelscited by 1
  16. 2026Block-wise Codeword Embedding for Reliable Multi-bit Text Watermarkingcited by 1
  17. 2026SAMark: A Self-Anchored Text Watermarking with Paragraph-Level Paraphrase Robustnesscited by 1
  18. 2026Rethinking Forgery Attacks on Semantic Watermarks in Black-Box Settings: A Geometric Distortion Perspectivecited by 1
  19. 2024Watermark Smoothing Attacks against Language Modelscited by 0
  20. 2025Watermarks for Language Models via Probabilistic Automatacited by 0
  21. 2026PGID: Progressive Guided Inversion and Denoising for Robust Watermark Detectioncited by 0
  22. 2026CORE-BREW: LLR-Based Soft Decoding for Robust Multi-Bit LLM Watermarkingcited by 0
  23. 2026"AI Watermarking": Bridging Policy Discourse and Technical Capabilitiescited by 0
  24. 2026Watermark Forensics for Generative Models: An Information-Theoretic Perspectivecited by 0
  25. 2026Robust Watermarks Meet Backdoored Models: Evading Diffusion Semantic Watermarks via Stealthy Backdoorcited by 0
  26. 2026Attribute-based Undetectable Watermarking for Generative AI Modelscited by 0
  27. 2026Codetta: High-Capacity, Keyless, and Undetectable Multi-Agent Collusioncited by 0
  28. 2026Anchor-ECC: Local Integrity Checking for Watermarked LLM Outputs via Error-Correcting Codescited by 0