Neural Distance Embeddings for Biological Sequences
Not on the map. Why?
Abstract (arXiv)
The development of data-dependent heuristics and representations for biological sequences that reflect their evolutionary distance is critical for large-scale biological research. However, popular machine learning approaches, based on continuous Euclidean spaces, have struggled with the discrete combinatorial formulation of the edit distance that models evolution and the hierarchical relationship that characterises real-world datasets. We present Neural Distance Embeddings (NeuroSEED), a general framework to embed sequences in geometric vector spaces, and illustrate the effectiveness of the hyperbolic space that captures the hierarchical structure and provides an average 22% reduction in embedding RMSE against the best competing geometry. The capacity of the framework and the significance of these improvements are then demonstrated devising supervised and unsupervised NeuroSEED approaches to multiple core tasks in bioinformatics. Benchmarked with common baselines, the proposed approaches display significant accuracy and/or runtime improvements on real-world datasets. As an example for hierarchical clustering, the proposed pretrained and from-scratch methods match the quality of competing baselines with 30x and 15x runtime reduction, respectively.
Key facts. Cited by 17 papers in the map (data through 7 Oct 2026). Builds on 22 of its 80 references that are in the map. First posted on arXiv 20 Sep 2021.
Builds on
22 of 80 references.
References · 22
- 2017Attention Is All You Needcited by 59,932
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2015Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shiftcited by 6,979
- 2016Layer Normalizationcited by 5,579
- 2014Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translationcited by 4,016
- 2015FaceNet: A Unified Embedding for Face Recognition and Clusteringcited by 2,833
- 2021Geometric Deep Learning: Grids, Groups, Graphs, Geodesics, and Gaugescited by 1,131
- 2016Geometric deep learning: going beyond Euclidean datacited by 1,042
- 2017Poincar'e Embeddings for Learning Hierarchical Representationscited by 674
- 2014Deep metric learning using Triplet networkcited by 421
- 2019Hyperbolic Graph Convolutional Neural Networkscited by 400
- 2018Hyperbolic Neural Networkscited by 393
10 more
- 2020Low-Dimensional Hyperbolic Knowledge Graph Embeddingscited by 195
- 2021Hyperbolic Deep Neural Networks: A Surveycited by 138
- 2016A Survey on Learning to Hashcited by 119
- 2019Continuous Hierarchical Representations with Poincar'e Variational Auto-Encoderscited by 111
- 2019Mixed-curvature Variational Autoencoderscited by 85
- 2020From Trees to Continuous Embeddings and Back: Hyperbolic Hierarchical Clusteringcited by 65
- 2015A cost function for similarity-based hierarchical clusteringcited by 63
- 2017Neural Embeddings of Graphs in Hyperbolic Spacecited by 58
- 2013A Survey on Metric Learning for Feature Vectors and Structured Datacited by 57
- 2014Edit Distance Cannot Be Computed in Strongly Subquadratic Time (unless SETH is false)cited by 18
Built on by
Citing papers per year: 2022: 3; 2023: 7; 2024: 0; 2025: 7.
17 papers.
Sort:
- 2023Learning Weakly Supervised Audio-Visual Violence Detection in Hyperbolic Spacecited by 12
- 2022Bringing motion taxonomies to continuous domains via GPLVM on hyperbolic manifoldscited by 9
- 2022Neural Embedding: Learning the Embedding of the Manifold of Physics Datacited by 7
- 2023Fast hyperboloid decision tree algorithmscited by 7
- 2025ProteinZero: Self-Improving Protein Generation via Online Reinforcement Learningcited by 5
- 2025Hyperbolic Genome Embeddingscited by 3
- 2022Deep Squared Euclidean Approximation to the Levenshtein Distance for DNA Storagecited by 2
- 2025A group-theoretic framework for machine learning in hyperbolic spacescited by 2
- 2025Variational Combinatorial Sequential Monte Carlo for Bayesian Phylogenetics in Hyperbolic Spacecited by 2
- 2025Manify: A Python Library for Learning Non-Euclidean Representationscited by 2
- 2023BarcodeBERT: Transformers for Biodiversity Analysiscited by 1
- 2023Levenshtein Distance Embedding with Poisson Regression for DNA Storagecited by 1
5 more
- 2023DoDo-Code: an Efficient Levenshtein Distance Embedding-based Code for 4-ary IDS Channelcited by 1
- 2023Neural Embeddings for Protein Graphscited by 0
- 2023Blind Biological Sequence Denoising with Self-Supervised Set Learningcited by 0
- 2025Breaking the Euclidean Barrier: Hyperboloid-Based Biological Sequence Analysiscited by 0
- 2025When do cheap embeddings beat protein language models? A theoretically-grounded hashing sketch for biological sequence classificationcited by 0
- 2025When do cheap embeddings beat protein language models? A theoretically-grounded hashing sketch for biological sequence classification10 Dec 2025
- 2025Breaking the Euclidean Barrier: Hyperboloid-Based Biological Sequence Analysis1 Oct 2025
- 2025Hyperbolic Genome Embeddings29 Jul 2025
- 2025ProteinZero: Self-Improving Protein Generation via Online Reinforcement Learning9 Jun 2025
- 2025Manify: A Python Library for Learning Non-Euclidean Representations12 Mar 2025
- 2025Variational Combinatorial Sequential Monte Carlo for Bayesian Phylogenetics in Hyperbolic Space29 Jan 2025
- 2025A group-theoretic framework for machine learning in hyperbolic spaces12 Jan 2025
- 2023DoDo-Code: an Efficient Levenshtein Distance Embedding-based Code for 4-ary IDS Channel20 Dec 2023
- 2023Levenshtein Distance Embedding with Poisson Regression for DNA Storage13 Dec 2023
- 2023BarcodeBERT: Transformers for Biodiversity Analysis4 Nov 2023
- 2023Fast hyperboloid decision tree algorithms20 Oct 2023
- 2023Blind Biological Sequence Denoising with Self-Supervised Set Learning4 Sep 2023
5 more
- 2023Neural Embeddings for Protein Graphs7 Jun 2023
- 2023Learning Weakly Supervised Audio-Visual Violence Detection in Hyperbolic Space30 May 2023
- 2022Bringing motion taxonomies to continuous domains via GPLVM on hyperbolic manifolds4 Oct 2022
- 2022Neural Embedding: Learning the Embedding of the Manifold of Physics Data10 Aug 2022
- 2022Deep Squared Euclidean Approximation to the Levenshtein Distance for DNA Storage11 Jul 2022
- 2023Learning Weakly Supervised Audio-Visual Violence Detection in Hyperbolic Spacecited by 12
- 2022Bringing motion taxonomies to continuous domains via GPLVM on hyperbolic manifoldscited by 9
- 2022Neural Embedding: Learning the Embedding of the Manifold of Physics Datacited by 7
- 2023Fast hyperboloid decision tree algorithmscited by 7
- 2025ProteinZero: Self-Improving Protein Generation via Online Reinforcement Learningcited by 5
- 2025Hyperbolic Genome Embeddingscited by 3
- 2022Deep Squared Euclidean Approximation to the Levenshtein Distance for DNA Storagecited by 2
- 2025A group-theoretic framework for machine learning in hyperbolic spacescited by 2
- 2025Variational Combinatorial Sequential Monte Carlo for Bayesian Phylogenetics in Hyperbolic Spacecited by 2
- 2025Manify: A Python Library for Learning Non-Euclidean Representationscited by 2
- 2023BarcodeBERT: Transformers for Biodiversity Analysiscited by 1
- 2023Levenshtein Distance Embedding with Poisson Regression for DNA Storagecited by 1
12 most cited of 17 All 17 (JSON)
- 2025When do cheap embeddings beat protein language models? A theoretically-grounded hashing sketch for biological sequence classification10 Dec 2025
- 2025Breaking the Euclidean Barrier: Hyperboloid-Based Biological Sequence Analysis1 Oct 2025
- 2025Hyperbolic Genome Embeddings29 Jul 2025
- 2025ProteinZero: Self-Improving Protein Generation via Online Reinforcement Learning9 Jun 2025
- 2025Manify: A Python Library for Learning Non-Euclidean Representations12 Mar 2025
- 2025Variational Combinatorial Sequential Monte Carlo for Bayesian Phylogenetics in Hyperbolic Space29 Jan 2025
- 2025A group-theoretic framework for machine learning in hyperbolic spaces12 Jan 2025
- 2023DoDo-Code: an Efficient Levenshtein Distance Embedding-based Code for 4-ary IDS Channel20 Dec 2023
- 2023Levenshtein Distance Embedding with Poisson Regression for DNA Storage13 Dec 2023
- 2023BarcodeBERT: Transformers for Biodiversity Analysis4 Nov 2023
- 2023Fast hyperboloid decision tree algorithms20 Oct 2023
- 2023Blind Biological Sequence Denoising with Self-Supervised Set Learning4 Sep 2023
12 newest of 17 All 17 (JSON)