mlsanityData to 7 Oct 2026

Machine Learning and Deep Learning -- A review for Ecologists

arXiv 2204.05023 ↗First posted 11 Apr 2022q-bio.QM stat.MLcited by 11

Not on the map. Why?

Abstract (arXiv)

1. The popularity of Machine learning (ML), Deep learning (DL), and Artificial intelligence (AI) has risen sharply in recent years. Despite this spike in popularity, the inner workings of ML and DL algorithms are often perceived as opaque, and their relationship to classical data analysis tools remains debated. 2. Although it is often assumed that ML and DL excel primarily at making predictions, ML and DL can also be used for analytical tasks traditionally addressed with statistical models. Moreover, most recent discussions and reviews on ML focus mainly on DL, missing out on synthesizing the wealth of ML algorithms with different advantages and general principles. 3. Here, we provide a comprehensive overview of the field of ML and DL, starting by summarizing its historical developments, existing algorithm families, differences to traditional statistical tools, and universal ML principles. We then discuss why and when ML and DL models excel at prediction tasks and where they could offer alternatives to traditional statistical methods for inference, highlighting current and emerging applications for ecological problems. Finally, we summarize emerging trends such as scientific and causal ML, explainable AI, and responsible AI that may significantly impact ecological data analysis in the future. 4. We conclude that ML and DL are powerful new tools for predictive modeling and data analysis. The superior performance of ML and DL algorithms compared to statistical models can be explained by their higher flexibility and automatic data-dependent complexity optimization. However, their use for causal inference is still disputed as the focus of ML and DL methods on predictions creates challenges for the interpretation of these models. Nevertheless, we expect ML and DL to become an indispensable tool in E&E, comparable to other traditional statistical tools.

Key facts. Cited by 11 papers in the map (data through 7 Oct 2026). Builds on 61 of its 257 references that are in the map. First posted on arXiv 11 Apr 2022.

Builds on

61 of 257 references.

References · 61

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2020Language Models are Few-Shot Learnerscited by 32,199
  3. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
  4. 2017Mask R-CNNcited by 7,259
  5. 2016XGBoost: A Scalable Tree Boosting Systemcited by 5,120
  6. 2016"Why Should I Trust You?": Explaining the Predictions of Any Classifiercited by 5,040
  7. 2018Neural Ordinary Differential Equationscited by 3,733
  8. 2019Fast Graph Representation Learning with PyTorch Geometriccited by 2,414
  9. 2018The Lottery Ticket Hypothesis: Finding Sparse, Trainable Neural Networkscited by 2,250
  10. 2019HuggingFace's Transformers: State-of-the-art Natural Language Processingcited by 2,201
  11. 2016Equality of Opportunity in Supervised Learningcited by 2,000
  12. 2019Explainable Artificial Intelligence (XAI): Concepts, Taxonomies, Opportunities and Challenges toward Responsible AIcited by 1,543
38 more
  1. 2020WILDS: A Benchmark of in-the-Wild Distribution Shiftscited by 1,366
  2. 2019A Comprehensive Survey on Transfer Learningcited by 1,154
  3. 2019Dota 2 with Large Scale Deep Reinforcement Learningcited by 1,084
  4. 2016Semantics derived automatically from language corpora contain human-like biasescited by 894
  5. 2017Masked Autoregressive Flow for Density Estimationcited by 680
  6. 2019Deep Double Descent: Where Bigger Models and More Data Hurtcited by 667
  7. 2019TabNet: Attentive Interpretable Tabular Learningcited by 640
  8. 2019Green AIcited by 620
  9. 2015Estimation and Inference of Heterogeneous Treatment Effects using Random Forestscited by 597
  10. 2019On Exact Computation with an Infinitely Wide Neural Netcited by 572
  11. 2019Generalizing from a Few Examples: A Survey on Few-Shot Learningcited by 462
  12. 2019Implicit Regularization in Deep Matrix Factorizationcited by 402
  13. 2020Universal Differential Equations for Scientific Machine Learningcited by 345
  14. 2021Skillful Precipitation Nowcasting using Deep Generative Models of Radarcited by 308
  15. 2021Ensemble deep learning: A reviewcited by 283
  16. 2018Learning Not to Learn: Training Deep Neural Networks with Biased Datacited by 255
  17. 2019Causality for Machine Learningcited by 242
  18. 2020Do Wide and Deep Networks Learn the Same Things? Uncovering How Neural Network Representations Vary with Width and Depthcited by 241
  19. 2016Visualizing the Effects of Predictor Variables in Black Box Supervised Learning Modelscited by 212
  20. 2020Pitfalls of In-Domain Uncertainty Estimation and Ensembling in Deep Learningcited by 208
  21. 2018Markerless tracking of user-defined features with deep learningcited by 203
  22. 2018Deep learning generalizes because the parameter-function map is biased towards simple functionscited by 180
  23. 2015ranger: A Fast Implementation of Random Forests for High Dimensional Data in C++ and Rcited by 171
  24. 2021The Low-Rank Simplicity Bias in Deep Networkscited by 150
  25. 2019Neural Tangents: Fast and Easy Infinite Neural Networks in Pythoncited by 149
  26. 2020Towards Resolving the Implicit Bias of Gradient Descent for Matrix Factorization: Greedy Low-Rank Learningcited by 148
  27. 2021Seeing biodiversity: perspectives in machine learning for wildlife conservationcited by 129
  28. 2019A General Framework for Uncertainty Estimation in Deep Learningcited by 119
  29. 2018Turning a Blind Eye: Explicit Removal of Biases and Variation from Deep Neural Network Embeddingscited by 114
  30. 2020Rethinking Bias-Variance Trade-off for Generalization of Neural Networkscited by 107
  31. 2021Intrinsic Dimension, Persistent Homology and Generalization in Neural Networkscited by 70
  32. 2020The Unreasonable Effectiveness of Deep Learning in Artificial Intelligencecited by 57
  33. 2019The Generalization-Stability Tradeoff In Neural Network Pruningcited by 54
  34. 2018Fashionable Modelling with Fluxcited by 53
  35. 2022Deep Symbolic Regression for Recurrent Sequencescited by 53
  36. 2019Context R-CNN: Long Term Temporal Context for Per-Camera Object Detectioncited by 45
  37. 2018Automatic acoustic detection of birds through deep learning: the first Bird Audio Detection challengecited by 44
  38. 2019A deep active learning system for species identification and counting in camera trap imagescited by 44

50 most cited of 61 All 61 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 4; 2024: 1; 2025: 3; 2026: 3.

11 papers.