mlsanityData to 7 Oct 2026

FreqMark: Frequency-Based Watermark for Sentence-Level Detection of LLM-Generated Text

arXiv 2410.10876 ↗First posted 9 Oct 2024cs.CL cs.CR cs.LGcited by 5

On the map: LLM safety and security → Watermarking generated content and models

Abstract (arXiv)

The increasing use of Large Language Models (LLMs) for generating highly coherent and contextually relevant text introduces new risks, including misuse for unethical purposes such as disinformation or academic dishonesty. To address these challenges, we propose FreqMark, a novel watermarking technique that embeds detectable frequency-based watermarks in LLM-generated text during the token sampling process. The method leverages periodic signals to guide token selection, creating a watermark that can be detected with Short-Time Fourier Transform (STFT) analysis. This approach enables accurate identification of LLM-generated content, even in mixed-text scenarios with both human-authored and LLM-generated segments. Our experiments demonstrate the robustness and precision of FreqMark, showing strong detection capabilities against various attack scenarios such as paraphrasing and token substitution. Results show that FreqMark achieves an AUC improvement of up to 0.98, significantly outperforming existing detection methods.

Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Placed in Watermarking generated content and models, one of 12 directions in LLM safety and security. Builds on 15 of its 20 references that are in the map. First posted on arXiv 9 Oct 2024.

Builds on

15 of 20 references.

Closest ancestors · 4

Same direction, newest first

  1. 2023Are You Copying My Model? Protecting the Copyright of Large Language Models for EaaS via Backdoor Watermark17 May
  2. 2023Robust Multi-bit Natural Language Watermarking through Invariant Features3 May
  3. 2023Protecting Language Generation Models via Invisible Watermarking6 Feb
  4. 2023A Watermark for Large Language Models24 Jan

Other references · 11

  1. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  2. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
  3. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
  4. 2019The Curious Case of Neural Text Degenerationcited by 2,881
  5. 2019HuggingFace's Transformers: State-of-the-art Natural Language Processingcited by 2,201
  6. 2022GPT-NeoX-20B: An Open-Source Autoregressive Language Modelcited by 711
  7. 2023DetectGPT: Zero-Shot Machine-Generated Text Detection using Probability Curvaturecited by 705
  8. 2019Release Strategies and the Social Impacts of Language Modelscited by 505
  9. 2023DetectLLM: Leveraging Log Rank Information for Zero-Shot Detection of Machine-Generated Textcited by 207
  10. 2023The Science of Detecting LLM-Generated Textscited by 126
  11. 2022Deepfake Text Detection: Limitations and Opportunitiescited by 37

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 3; 2026: 2.

5 papers.