mlsanityData to 14 Oct 2026

Contrastive Deep Learning for Variant Detection in Wastewater Genomic Sequencing

arXiv 2512.03158 ↗First posted 2 Dec 2025cs.LG q-bio.GNcited by 0

Not on the map. Why?

Abstract (arXiv)

Wastewater-based genomic surveillance has emerged as a powerful tool for population-level viral monitoring, offering comprehensive insights into circulating viral variants across entire communities. However, this approach faces significant computational challenges stemming from high sequencing noise, low viral coverage, fragmented reads, and the complete absence of labeled variant annotations. Traditional reference-based variant calling pipelines struggle with novel mutations and require extensive computational resources. We present a comprehensive framework for unsupervised viral variant detection using Vector-Quantized Variational Autoencoders (VQ-VAE) that learns discrete codebooks of genomic patterns from k-mer tokenized sequences without requiring reference genomes or variant labels. Our approach extends the base VQ-VAE architecture with masked reconstruction pretraining for robustness to missing data and contrastive learning for highly discriminative embeddings. Evaluated on SARS-CoV-2 wastewater sequencing data comprising approximately 100,000 reads, our VQ-VAE achieves 99.52% mean token-level accuracy and 56.33% exact sequence match rate while maintaining 19.73% codebook utilization (101 of 512 codes active), demonstrating efficient discrete representation learning. Contrastive fine-tuning with different projection dimensions yields substantial clustering improvements: 64-dimensional embeddings achieve +35% Silhouette score improvement (0.31 to 0.42), while 128-dimensional embeddings achieve +42% improvement (0.31 to 0.44), clearly demonstrating the impact of embedding dimensionality on variant discrimination capability. Our reference-free framework provides a scalable, interpretable approach to genomic surveillance with direct applications to public health monitoring.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 13 of its 41 references that are in the map. First posted on arXiv 2 Dec 2025.

Builds on

13 of 41 references.

References · 13

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  2. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 12,049
  3. 2018Representation Learning with Contrastive Predictive Codingcited by 7,777
  4. 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,513
  5. 2017Neural Discrete Representation Learningcited by 4,712
  6. 2013Estimating or Propagating Gradients Through Stochastic Neurons for Conditional Computationcited by 2,079
  7. 2019Generating Diverse High-Fidelity Images with VQ-VAE-2cited by 1,387
  8. 2015Generating Sentences from a Continuous Spacecited by 612
  9. 2020Jukebox: A Generative Model for Musiccited by 542
  10. 2017Parallel WaveNet: Fast High-Fidelity Speech Synthesiscited by 215
  11. 2023DNABERT-2: Efficient Foundation Model and Benchmark For Multi-Species Genomecited by 143
  12. 2023Not All Image Regions Matter: Masked Vector Quantization for Autoregressive Image Generationcited by 28
1 more
  1. 2017Learning Hierarchical Features from Generative Modelscited by 27

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2024VQDNA: Unleashing the Power of Vector Quantization for Multi-Species Genomic Sequence Modeling
  2. 2022Robust Vector Quantized-Variational Autoencoder
  3. 2022Cancer Subtyping by Improved Transcriptomic Features Using Vector Quantized Variational Autoencoder
  4. 2025MGVQ: Could VQ-VAE Beat VAE? A Generalizable Tokenizer with Multi-group Quantization
  5. 2025Contamination Detection for VLMs using Multi-Modal Semantic Perturbation
  6. 2023HQ-VAE: Hierarchical Discrete Representation Learning with Variational Bayes
  7. 2022Repairing Systematic Outliers by Learning Clean Subspaces in VAEs
  8. 2024Gaussian Mixture Vector Quantization with Aggregated Categorical Posterior