Ten Quick Tips for Deep Learning in Biology
Not on the map. Why?
Abstract (arXiv)
Machine learning is a modern approach to problem-solving and task automation. In particular, machine learning is concerned with the development and applications of algorithms that can recognize patterns in data and use them for predictive modeling. Artificial neural networks are a particular class of machine learning algorithms and models that evolved into what is now described as deep learning. Given the computational advances made in the last decade, deep learning can now be applied to massive data sets and in innumerable contexts. Therefore, deep learning has become its own subfield of machine learning. In the context of biological research, it has been increasingly used to derive novel insights from high-dimensional biological data. To make the biological applications of deep learning more accessible to scientists who have some experience with machine learning, we solicited input from a community of researchers with varied biological and deep learning interests. These individuals collaboratively contributed to this manuscript's writing using the GitHub version control platform and the Manubot manuscript generation toolset. The goal was to articulate a practical, accessible, and concise set of guidelines and suggestions to follow when using deep learning. In the course of our discussions, several themes became clear: the importance of understanding and applying machine learning fundamentals as a baseline for utilizing deep learning, the necessity for extensive model comparisons with careful evaluation, and the need for critical thought in interpreting results generated by deep learning, among others.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 49 of its 127 references that are in the map. First posted on arXiv 29 May 2021.
Builds on
49 of 127 references.
References · 49
- 2017Attention Is All You Needcited by 60,361
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
- 2014ImageNet Large Scale Visual Recognition Challengecited by 8,498
- 2015Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shiftcited by 7,005
- 2019Unsupervised Cross-lingual Representation Learning at Scalecited by 3,935
- 2016Deep Learning with Differential Privacycited by 2,728
- 2016Membership Inference Attacks against Machine Learning Modelscited by 2,281
- 2018An Empirical Evaluation of Generic Convolutional and Recurrent Networks for Sequence Modelingcited by 1,476
- 2019Energy and Policy Considerations for Deep Learning in NLPcited by 1,254
- 2014How transferable are features in deep neural networks?cited by 1,225
- 2018Model Cards for Model Reportingcited by 1,080
37 more
- 2020Domain-Specific Language Model Pretraining for Biomedical Natural Language Processingcited by 1,009
- 2018Reconciling modern machine learning practice and the bias-variance trade-offcited by 927
- 2017Revisiting Unreasonable Effectiveness of Data in Deep Learning Eracited by 919
- 2015Convolutional Networks on Graphs for Learning Molecular Fingerprintscited by 754
- 2017Deep Reinforcement Learning that Matterscited by 754
- 2016TensorFlow: Large-Scale Machine Learning on Heterogeneous Distributed Systemscited by 664
- 2018Albumentations: fast and flexible image augmentationscited by 560
- 2017Efficient Processing of Deep Neural Networks: A Tutorial and Surveycited by 434
- 2018Confounding variables can degrade generalization performance of radiological deep learning modelscited by 379
- 2020ChemBERTa: Large-Scale Self-Supervised Pretraining for Molecular Property Predictioncited by 337
- 2014CNN Features off-the-shelf: an Astounding Baseline for Recognitioncited by 316
- 2018Scalable and accurate deep learning for electronic health recordscited by 280
- 2017The Marginal Value of Adaptive Gradient Methods in Machine Learningcited by 250
- 2016Data Programming: Creating Large Training Sets, Quicklycited by 246
- 2018Deep k-Nearest Neighbors: Towards Confident, Interpretable and Robust Deep Learningcited by 207
- 2018Optimization of Molecules via Deep Reinforcement Learningcited by 200
- 2020fastai: A Layered API for Deep Learningcited by 183
- 2018Auto-Keras: An Efficient Neural Architecture Search Systemcited by 171
- 2020ProtTrans: Towards Cracking the Language of Life's Code Through Self-Supervised Deep Learning and High Performance Computingcited by 162
- 2018Model Evaluation, Model Selection, and Algorithm Selection in Machine Learningcited by 157
- 2017VAMPnets: Deep learning of molecular kineticscited by 136
- 2020ProGen: Language Modeling for Protein Generationcited by 128
- 2018A generic framework for privacy preserving deep learningcited by 103
- 2020On Interpretability of Artificial Neural Networks: A Surveycited by 88
- 2020Machine Learning in Python: Main developments and technology trends in data science, machine learning, and artificial intelligencecited by 82
- 2015How much data is needed to train a medical image deep learning system to achieve necessary high accuracy?cited by 45
- 2016Automating biomedical data science through tree-based pipeline optimizationcited by 21
- 2017Easy over Hard: A Case Study on Deep Learningcited by 20
- 2017WeText: Scene Text Detection under Weak Supervisioncited by 13
- 2018Towards the AlexNet Moment for Homomorphic Encryption: HCNN, theFirst Homomorphic CNN on Encrypted Data with GPUscited by 11
- 2017Deep Learning Microscopycited by 10
- 2018Privacy-Preserving Distributed Deep Learning for Clinical Datacited by 8
- 2019Systematic Misestimation of Machine Learning Performance in Neuroimaging Studies of Depressioncited by 7
- 2018Ten Simple Rules for Reproducible Research in Jupyter Notebookscited by 6
- 2019The Secrets of Machine Learning: Ten Things You Wish You Had Known Earlier to be More Effective at Data Analysiscited by 6
- 2018SIG-DB: leveraging homomorphic encryption to Securely Interrogate privately held Genomic DataBasescited by 2
- 2020Machine learning and AI-based approaches for bioactive ligand discovery and GPCR-ligand recognitioncited by 2
Built on by
Citing papers per year: 2023: 1.
1 paper.