Machine Learning and Deep Learning -- A review for Ecologists
Not on the map. Why?
Abstract (arXiv)
1. The popularity of Machine learning (ML), Deep learning (DL), and Artificial intelligence (AI) has risen sharply in recent years. Despite this spike in popularity, the inner workings of ML and DL algorithms are often perceived as opaque, and their relationship to classical data analysis tools remains debated. 2. Although it is often assumed that ML and DL excel primarily at making predictions, ML and DL can also be used for analytical tasks traditionally addressed with statistical models. Moreover, most recent discussions and reviews on ML focus mainly on DL, missing out on synthesizing the wealth of ML algorithms with different advantages and general principles. 3. Here, we provide a comprehensive overview of the field of ML and DL, starting by summarizing its historical developments, existing algorithm families, differences to traditional statistical tools, and universal ML principles. We then discuss why and when ML and DL models excel at prediction tasks and where they could offer alternatives to traditional statistical methods for inference, highlighting current and emerging applications for ecological problems. Finally, we summarize emerging trends such as scientific and causal ML, explainable AI, and responsible AI that may significantly impact ecological data analysis in the future. 4. We conclude that ML and DL are powerful new tools for predictive modeling and data analysis. The superior performance of ML and DL algorithms compared to statistical models can be explained by their higher flexibility and automatic data-dependent complexity optimization. However, their use for causal inference is still disputed as the focus of ML and DL methods on predictions creates challenges for the interpretation of these models. Nevertheless, we expect ML and DL to become an indispensable tool in E&E, comparable to other traditional statistical tools.
Key facts. Cited by 11 papers in the map (data through 7 Oct 2026). Builds on 61 of its 257 references that are in the map. First posted on arXiv 11 Apr 2022.
Builds on
61 of 257 references.
References · 61
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
- 2017Mask R-CNNcited by 7,259
- 2016XGBoost: A Scalable Tree Boosting Systemcited by 5,120
- 2016"Why Should I Trust You?": Explaining the Predictions of Any Classifiercited by 5,040
- 2018Neural Ordinary Differential Equationscited by 3,733
- 2019Fast Graph Representation Learning with PyTorch Geometriccited by 2,414
- 2018The Lottery Ticket Hypothesis: Finding Sparse, Trainable Neural Networkscited by 2,250
- 2019HuggingFace's Transformers: State-of-the-art Natural Language Processingcited by 2,201
- 2016Equality of Opportunity in Supervised Learningcited by 2,000
- 2019Explainable Artificial Intelligence (XAI): Concepts, Taxonomies, Opportunities and Challenges toward Responsible AIcited by 1,543
38 more
- 2020WILDS: A Benchmark of in-the-Wild Distribution Shiftscited by 1,366
- 2019A Comprehensive Survey on Transfer Learningcited by 1,154
- 2019Dota 2 with Large Scale Deep Reinforcement Learningcited by 1,084
- 2016Semantics derived automatically from language corpora contain human-like biasescited by 894
- 2017Masked Autoregressive Flow for Density Estimationcited by 680
- 2019Deep Double Descent: Where Bigger Models and More Data Hurtcited by 667
- 2019TabNet: Attentive Interpretable Tabular Learningcited by 640
- 2019Green AIcited by 620
- 2015Estimation and Inference of Heterogeneous Treatment Effects using Random Forestscited by 597
- 2019On Exact Computation with an Infinitely Wide Neural Netcited by 572
- 2019Generalizing from a Few Examples: A Survey on Few-Shot Learningcited by 462
- 2019Implicit Regularization in Deep Matrix Factorizationcited by 402
- 2020Universal Differential Equations for Scientific Machine Learningcited by 345
- 2021Skillful Precipitation Nowcasting using Deep Generative Models of Radarcited by 308
- 2021Ensemble deep learning: A reviewcited by 283
- 2018Learning Not to Learn: Training Deep Neural Networks with Biased Datacited by 255
- 2019Causality for Machine Learningcited by 242
- 2020Do Wide and Deep Networks Learn the Same Things? Uncovering How Neural Network Representations Vary with Width and Depthcited by 241
- 2016Visualizing the Effects of Predictor Variables in Black Box Supervised Learning Modelscited by 212
- 2020Pitfalls of In-Domain Uncertainty Estimation and Ensembling in Deep Learningcited by 208
- 2018Markerless tracking of user-defined features with deep learningcited by 203
- 2018Deep learning generalizes because the parameter-function map is biased towards simple functionscited by 180
- 2015ranger: A Fast Implementation of Random Forests for High Dimensional Data in C++ and Rcited by 171
- 2021The Low-Rank Simplicity Bias in Deep Networkscited by 150
- 2019Neural Tangents: Fast and Easy Infinite Neural Networks in Pythoncited by 149
- 2020Towards Resolving the Implicit Bias of Gradient Descent for Matrix Factorization: Greedy Low-Rank Learningcited by 148
- 2021Seeing biodiversity: perspectives in machine learning for wildlife conservationcited by 129
- 2019A General Framework for Uncertainty Estimation in Deep Learningcited by 119
- 2018Turning a Blind Eye: Explicit Removal of Biases and Variation from Deep Neural Network Embeddingscited by 114
- 2020Rethinking Bias-Variance Trade-off for Generalization of Neural Networkscited by 107
- 2021Intrinsic Dimension, Persistent Homology and Generalization in Neural Networkscited by 70
- 2020The Unreasonable Effectiveness of Deep Learning in Artificial Intelligencecited by 57
- 2019The Generalization-Stability Tradeoff In Neural Network Pruningcited by 54
- 2018Fashionable Modelling with Fluxcited by 53
- 2022Deep Symbolic Regression for Recurrent Sequencescited by 53
- 2019Context R-CNN: Long Term Temporal Context for Per-Camera Object Detectioncited by 45
- 2018Automatic acoustic detection of birds through deep learning: the first Bird Audio Detection challengecited by 44
- 2019A deep active learning system for species identification and counting in camera trap imagescited by 44
50 most cited of 61 All 61 (JSON)
Built on by
Citing papers per year: 2023: 4; 2024: 1; 2025: 3; 2026: 3.
11 papers.
- 2023The role of causality in explainable artificial intelligencecited by 17
- 2026Future of Edge AI in biodiversity monitoringcited by 3
- 2023cito: An R package for training neural networks using torchcited by 2
- 2023Can predictive models be used for causal inference?cited by 2
- 2024Learning to learn ecosystems from limited data -- a meta-learning approachcited by 2
- 2025Foundation for unbiased cross-validation of spatio-temporal models for species distribution modelingcited by 2
- 2025Unified Spatiotemporal Physics-Informed Learning (USPIL): A Framework for Modeling Complex Predator-Prey Dynamicscited by 1
- 2023Nine tips for ecologists using machine learningcited by 0
- 2025Inferring processes within dynamic forest models using hybrid modelingcited by 0
- 2026Machine Learning for Complex Systems Dynamics: Detecting Bifurcations in Dynamical Systems with Deep Neural Networkscited by 0
- 2026STeMP: Spatio-Temporal Modelling Protocolcited by 0
- 2026STeMP: Spatio-Temporal Modelling Protocol22 Jul 2026
- 2026Machine Learning for Complex Systems Dynamics: Detecting Bifurcations in Dynamical Systems with Deep Neural Networks14 Feb 2026
- 2026Future of Edge AI in biodiversity monitoring13 Feb 2026
- 2025Unified Spatiotemporal Physics-Informed Learning (USPIL): A Framework for Modeling Complex Predator-Prey Dynamics16 Sep 2025
- 2025Inferring processes within dynamic forest models using hybrid modeling2 Aug 2025
- 2025Foundation for unbiased cross-validation of spatio-temporal models for species distribution modeling27 Jan 2025
- 2024Learning to learn ecosystems from limited data -- a meta-learning approach2 Oct 2024
- 2023The role of causality in explainable artificial intelligence18 Sep 2023
- 2023Can predictive models be used for causal inference?18 Jun 2023
- 2023Nine tips for ecologists using machine learning17 May 2023
- 2023cito: An R package for training neural networks using torch16 Mar 2023