mlsanityData to 14 Oct 2026

DeepProphet2 -- A Deep Learning Gene Recommendation Engine

arXiv 2208.01918 ↗First posted 3 Aug 2022q-bio.QM cs.IR cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

New powerful tools for tackling life science problems have been created by recent advances in machine learning. The purpose of the paper is to discuss the potential advantages of gene recommendation performed by artificial intelligence (AI). Indeed, gene recommendation engines try to solve this problem: if the user is interested in a set of genes, which other genes are likely to be related to the starting set and should be investigated? This task was solved with a custom deep learning recommendation engine, DeepProphet2 (DP2), which is freely available to researchers worldwide via https://www.generecommender.com?utm_source=DeepProphet2_paper&utm_medium=pdf. Hereafter, insights behind the algorithm and its practical applications are illustrated. The gene recommendation problem can be addressed by mapping the genes to a metric space where a distance can be defined to represent the real semantic distance between them. To achieve this objective a transformer-based model has been trained on a well-curated freely available paper corpus, PubMed. The paper describes multiple optimization procedures that were employed to obtain the best bias-variance trade-off, focusing on embedding size and network depth. In this context, the model's ability to discover sets of genes implicated in diseases and pathways was assessed through cross-validation. A simple assumption guided the procedure: the network had no direct knowledge of pathways and diseases but learned genes' similarities and the interactions among them. Moreover, to further investigate the space where the neural network represents genes, the dimensionality of the embedding was reduced, and the results were projected onto a human-comprehensible space. In conclusion, a set of use cases illustrates the algorithm's potential applications in a real word setting.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 26 of its 56 references that are in the map. First posted on arXiv 3 Aug 2022.

Builds on

26 of 56 references.

References · 26

  1. 2017Attention Is All You Needcited by 60,361
  2. 2018UMAP: Uniform Manifold Approximation and Projection for Dimension Reductioncited by 2,898
  3. 2019BioBERT: a pre-trained biomedical language representation model for biomedical text miningcited by 1,947
  4. 2019SciBERT: A Pretrained Language Model for Scientific Textcited by 1,414
  5. 2020Domain-Specific Language Model Pretraining for Biomedical Natural Language Processingcited by 1,009
  6. 2015Unsupervised Deep Embedding for Clustering Analysiscited by 767
  7. 2018A Tutorial on Bayesian Optimizationcited by 744
  8. 2021Curriculum Learning: A Surveycited by 259
  9. 2020Self-Alignment Pretraining for Biomedical Entity Representationscited by 237
  10. 2020Drug discovery with explainable artificial intelligencecited by 118
  11. 2018The Geometry of Culture: Analyzing Meaning through Word Embeddingscited by 87
  12. 2019Grid Search, Random Search, Genetic Algorithm: A Big Comparison for NAScited by 83
14 more
  1. 2016Unsupervised Pretraining for Sequence to Sequence Learningcited by 47
  2. 2021Knowledge-Rich Self-Supervision for Biomedical Entity Linkingcited by 31
  3. 2018Understanding Autoencoders with Information Theoretic Conceptscited by 29
  4. 2021Artificial Intelligence in Drug Discovery: Applications and Techniquescited by 28
  5. 2020Principled approach to the selection of the embedding dimension of networkscited by 19
  6. 2019SECNLP: A Survey of Embeddings in Clinical Natural Language Processingcited by 16
  7. 2016Efficient Representation of Low-Dimensional Manifolds using Deep Networkscited by 13
  8. 2021Empirical comparison between autoencoders and traditional dimensionality reduction methodscited by 13
  9. 2021Categorical Representation Learning: Morphism is All You Needcited by 6
  10. 2021Deep learning models are not robust against noise in clinical textcited by 6
  11. 2021Theoretical foundations and limits of word embeddings: what types of meaning can they capture?cited by 5
  12. 2018Understand Functionality and Dimensionality of Vector Embeddings: the Distributional Hypothesis, the Pairwise Inner Product Loss and Its Bias-Variance Trade-offcited by 3
  13. 2017A DIKW Paradigm to Cognitive Engineeringcited by 1
  14. 2021Generating Summaries for Scientific Paper Reviewcited by 1

Built on by

Not cited yet.