TaxDistill: Improving Metagenomic Taxonomic Annotation via Distilled Genomic Foundation Models
Not on the map. Why?
Abstract (arXiv)
Metagenomic taxonomic annotation is essential for interpreting complex microbial communities, yet reliable annotation remains challenging under reference database incompleteness and ambiguous taxonomic boundaries. Existing similarity-based tools are efficient, but they often produce noisy pseudo-labels in complex environments; learning-based post-hoc correction methods can further inherit this noise when trained on hard pseudo-labels generated by upstream classifiers. We propose TaxDistill, a plug-and-play knowledge distillation framework for reliable metagenomic taxonomic recalibration. TaxDistill uses the genomic foundation model GenomeOcean as a semantic teacher and performs one-way online distillation, where the teacher is updated by hierarchical taxonomic supervision while its detached soft probability distributions guide a lightweight student network. This design mitigates the student's overfitting to noisy hard pseudo-labels and supports confidence based rejection of potentially unreliable predictions. Comprehensive experiments on seven diverse CAMI2 datasets with MMseqs2, Metabuli, and Kraken2 show that TaxDistill improves annotation reliability over existing baselines in most scenarios. For example, on the Gastrointestinal dataset, TaxDistill improves the F1 score of MMseqs2 from 0.763 to 0.941, surpassing the Taxometer baseline. Our results suggest that large genomic foundation models can provide semantic supervision for noisy scientific annotations, enabling lightweight post-hoc recalibration of existing metagenomic annotation results.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 10 of its 39 references that are in the map. First posted on arXiv 22 May 2026.
Builds on
10 of 39 references.
References · 10
- 2017Attention Is All You Needcited by 59,932
- 2015Distilling the Knowledge in a Neural Networkcited by 10,076
- 2016Understanding deep learning requires rethinking generalizationcited by 1,657
- 2020Knowledge Distillation: A Surveycited by 1,578
- 2019When Does Label Smoothing Help?cited by 985
- 2020Early-Learning Regularization Prevents Memorization of Noisy Labelscited by 414
- 2017Learning from Noisy Labels with Distillationcited by 160
- 2022Hierarchical classification at multiple operating pointscited by 14
- 2024Distilling the Knowledge in Data Pruningcited by 11
- 2025On-the-Fly Adaptation to Quantization: Configuration-Aware LoRA for Efficient Fine-Tuning of Quantized LLMscited by 1
Built on by
Not cited yet.