mlsanityData to 14 Oct 2026

GenoTrace: Inheritable Watermarks for Genome Foundation Model Distillation

arXiv 2609.35881 ↗First posted 27 Sep 2026cs.CR cs.LG q-bio.GNcited by 0

On the map: LLM safety and security → Watermarking generated content and models

Abstract (arXiv)

Can a genome model retain a detectable record of the synthetic sequences used to train it? We study watermark inheritance through distillation with GenoTrace, a codon-aware extension of green-list watermarking. Two token-level factors modulate the teacher's generation bias using codon position and organism-specific codon usage. The resulting sequences train a smaller student, whose outputs are audited without an active watermark processor. In a three-seed GenomeOcean-500M-to-100M experiment, the joint configuration achieves a mean audit score of 17.88 and 94.5% detection at a fixed threshold. It retains 49.0% detection after key-aware token substitution, compared with 0% for the available single-seed plain-watermark comparator, and 47.0% after combined mechanism-targeted nucleotide edits. Additional experiments establish inherited signal across five organism-conditioned datasets and teacher-student size ratios up to 40. Component ablations and computational sequence-quality assays reveal distinct operating points for detection strength and coding coverage. GenoTrace provides a practical token-level construction and an empirical account of how genomic structure shapes inherited watermark signals. The findings concern shared-tokenizer distillation and the tested editing procedures, with calibration and biological utility treated as separate evaluation requirements.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Watermarking generated content and models, one of 12 directions in LLM safety and security. Builds on 24 of its 58 references that are in the map. First posted on arXiv 27 Sep 2026.

Builds on

24 of 58 references.

Closest ancestors · 15

Same direction, newest first

  1. 2025Enhancing LLM Watermark Resilience Against Both Scrubbing and Spoofing Attacks8 Jul
  2. 2025Unified attacks to large language model watermarks: spoofing and scrubbing in unauthorized knowledge distillation24 Apr
  3. 2025Can LLM Watermarks Robustly Prevent Unauthorized Knowledge Distillation?17 Feb
  4. 2024FoldMark: Protecting Protein Generative Models with Watermarking27 Oct
  5. 2024Optimizing Adaptive Attacks against Watermarks for Language Models3 Oct
  6. 2024Watermark Stealing in Large Language Models29 Feb
  7. 2024No Free Lunch in LLM Watermarking: Trade-offs in Watermarking Design Choices25 Feb
  8. 2024Watermarking Makes Language Models Radioactive22 Feb
  9. 2023Unbiased Watermark for Large Language Models22 Sep
  10. 2023Robust Distortion-free Watermarks for Language Models28 Jul
  11. 2023Provable Robust Watermarking for AI-Generated Text30 Jun
  12. 2023On the Reliability of Watermarks for Large Language Models7 Jun
3 more
  1. 2023Undetectable Watermarks for Language Models25 May
  2. 2023Paraphrasing evades detectors of AI-generated text, but retrieval is an effective defense23 Mar
  3. 2023A Watermark for Large Language Models24 Jan

Other references · 9

  1. 2017Attention Is All You Needcited by 60,361
  2. 2015Distilling the Knowledge in a Neural Networkcited by 10,324
  3. 2019DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lightercited by 4,307
  4. 2020Extracting Training Data from Large Language Modelscited by 2,189
  5. 2020Knowledge Distillation: A Surveycited by 1,603
  6. 2023DetectGPT: Zero-Shot Machine-Generated Text Detection using Probability Curvaturecited by 726
  7. 2017Opening the Black Box of Deep Neural Networks via Informationcited by 503
  8. 2023HyenaDNA: Long-Range Genomic Sequence Modeling at Single Nucleotide Resolutioncited by 194
  9. 2023DNABERT-2: Efficient Foundation Model and Benchmark For Multi-Species Genomecited by 143

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025HAD: Hybrid Architecture Distillation Outperforms Teacher in Genomic Sequence Modeling
  2. 2026Steal the Knowledge, Inherit the Mark: TwinMark for Distillation Watermarking via Second Moments and Class Multiplexing
  3. 2026MARCO: The Radioactive Watermark for Protein Generative Models
  4. 2026Beyond Conditional Computation: Retrieval-Augmented Genomic Foundation Models with Gengram
  5. 2026Improving the Trade-off Between Watermark Strength and Speculative Sampling Efficiency for Language Models
  6. 2026dnaHNet: A Scalable and Hierarchical Foundation Model for Genomic Sequence Learning
  7. 2026DNA: Dual-stage Native Attribution for Generated Image Source Tracing
  8. 2026Semantic Differentiation for Tackling Challenges in Watermarking Low-Entropy Constrained Generation Outputs