mlsanityData to 7 Oct 2026

Neural Distance Embeddings for Biological Sequences

arXiv 2109.09740 ↗First posted 20 Sep 2021q-bio.QM cs.LGcited by 17

Not on the map. Why?

Abstract (arXiv)

The development of data-dependent heuristics and representations for biological sequences that reflect their evolutionary distance is critical for large-scale biological research. However, popular machine learning approaches, based on continuous Euclidean spaces, have struggled with the discrete combinatorial formulation of the edit distance that models evolution and the hierarchical relationship that characterises real-world datasets. We present Neural Distance Embeddings (NeuroSEED), a general framework to embed sequences in geometric vector spaces, and illustrate the effectiveness of the hyperbolic space that captures the hierarchical structure and provides an average 22% reduction in embedding RMSE against the best competing geometry. The capacity of the framework and the significance of these improvements are then demonstrated devising supervised and unsupervised NeuroSEED approaches to multiple core tasks in bioinformatics. Benchmarked with common baselines, the proposed approaches display significant accuracy and/or runtime improvements on real-world datasets. As an example for hierarchical clustering, the proposed pretrained and from-scratch methods match the quality of competing baselines with 30x and 15x runtime reduction, respectively.

Key facts. Cited by 17 papers in the map (data through 7 Oct 2026). Builds on 22 of its 80 references that are in the map. First posted on arXiv 20 Sep 2021.

Builds on

22 of 80 references.

References · 22

  1. 2017Attention Is All You Needcited by 59,932
  2. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  3. 2015Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shiftcited by 6,979
  4. 2016Layer Normalizationcited by 5,579
  5. 2014Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translationcited by 4,016
  6. 2015FaceNet: A Unified Embedding for Face Recognition and Clusteringcited by 2,833
  7. 2021Geometric Deep Learning: Grids, Groups, Graphs, Geodesics, and Gaugescited by 1,131
  8. 2016Geometric deep learning: going beyond Euclidean datacited by 1,042
  9. 2017Poincar'e Embeddings for Learning Hierarchical Representationscited by 674
  10. 2014Deep metric learning using Triplet networkcited by 421
  11. 2019Hyperbolic Graph Convolutional Neural Networkscited by 400
  12. 2018Hyperbolic Neural Networkscited by 393
10 more
  1. 2020Low-Dimensional Hyperbolic Knowledge Graph Embeddingscited by 195
  2. 2021Hyperbolic Deep Neural Networks: A Surveycited by 138
  3. 2016A Survey on Learning to Hashcited by 119
  4. 2019Continuous Hierarchical Representations with Poincar'e Variational Auto-Encoderscited by 111
  5. 2019Mixed-curvature Variational Autoencoderscited by 85
  6. 2020From Trees to Continuous Embeddings and Back: Hyperbolic Hierarchical Clusteringcited by 65
  7. 2015A cost function for similarity-based hierarchical clusteringcited by 63
  8. 2017Neural Embeddings of Graphs in Hyperbolic Spacecited by 58
  9. 2013A Survey on Metric Learning for Feature Vectors and Structured Datacited by 57
  10. 2014Edit Distance Cannot Be Computed in Strongly Subquadratic Time (unless SETH is false)cited by 18

Built on by

Cited by year

Citing papers per year: 2022: 3; 2023: 7; 2024: 0; 2025: 7.

17 papers.

Sort: