mlsanityData to 14 Oct 2026

Machine Learning Methods for Small Data and Upstream Bioprocessing Applications: A Comprehensive Review

arXiv 2506.12322 ↗First posted 14 Jun 2025cs.LG cs.AIcited by 4

Not on the map. Why?

Abstract (arXiv)

Data is crucial for machine learning (ML) applications, yet acquiring large datasets can be costly and time-consuming, especially in complex, resource-intensive fields like biopharmaceuticals. A key process in this industry is upstream bioprocessing, where living cells are cultivated and optimised to produce therapeutic proteins and biologics. The intricate nature of these processes, combined with high resource demands, often limits data collection, resulting in smaller datasets. This comprehensive review explores ML methods designed to address the challenges posed by small data and classifies them into a taxonomy to guide practical applications. Furthermore, each method in the taxonomy was thoroughly analysed, with a detailed discussion of its core concepts and an evaluation of its effectiveness in tackling small data challenges, as demonstrated by application results in the upstream bioprocessing and other related domains. By analysing how these methods tackle small data challenges from different perspectives, this review provides actionable insights, identifies current research gaps, and offers guidance for leveraging ML in data-constrained environments.

Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 25 of its 224 references that are in the map. First posted on arXiv 14 Jun 2025.

Builds on

25 of 224 references.

References · 25

  1. 2020The Future of Digital Health with Federated Learningcited by 633
  2. 2017Data Augmentation of Wearable Sensor Data for Parkinson's Disease Monitoring using Convolutional Neural Networkscited by 131
  3. 2020An Empirical Survey of Data Augmentation for Time Series Classification with Neural Networkscited by 128
  4. 2020A Survey of Deep Meta-Learningcited by 100
  5. 2022Learning from Few Examples: A Summary of Approaches to Few-Shot Learningcited by 86
  6. 2018Data augmentation using synthetic data for time series classification with deep residual networkscited by 38
  7. 2019Reinforcement Learning for Batch Bioprocess Optimizationcited by 28
  8. 2022Bayesian Learning for Neural Networks: an algorithmic surveycited by 23
  9. 2019Feature Selection and Feature Extraction in Pattern Analysis: A Literature Reviewcited by 15
  10. 2020A Survey on Machine Learning from Few Samplescited by 14
  11. 2021Empirical comparison between autoencoders and traditional dimensionality reduction methodscited by 13
  12. 2020AutonoML: Towards an Integrated Framework for Autonomous Machine Learningcited by 9
13 more
  1. 2016Automatic Composition and Optimization of Multicomponent Predictive Systems With an Extended Auto-WEKAcited by 8
  2. 2019Interpretable Biomanufacturing Process Risk and Sensitivity Analyses for Quality-by-Design and Stability Controlcited by 7
  3. 2020A Review of Meta-level Learning in the Context of Multi-component, Multi-level Evolving Prediction Systemscited by 7
  4. 2020Knowledge transfer across cell lines using Hybrid Gaussian Process models with entity embedding vectorscited by 7
  5. 2022When Bioprocess Engineering Meets Machine Learning: A Survey from the Perspective of Automated Bioprocess Developmentcited by 4
  6. 2022Machine learning in bioprocess development: From promise to practicecited by 4
  7. 2022Neural ODEs as Feedback Policies for Nonlinear Optimal Controlcited by 4
  8. 2021Semi-supervised Learning for Data-driven Soft-sensing of Biological and Chemical Processescited by 3
  9. 2018SPSA-FSR: Simultaneous Perturbation Stochastic Approximation for Feature Selection and Rankingcited by 2
  10. 2022PCA-Boosted Autoencoders for Nonlinear Dimensionality Reduction in Low Data Regimescited by 2
  11. 2022The Technological Emergence of AutoML: A Survey of Performant Software and Applications in the Context of Industrycited by 2
  12. 2023Deep Learning for Fast Inference of Mechanistic Models' Parameterscited by 1
  13. 2024Data Augmentation Scheme for Raman Spectra with Highly Correlated Annotationscited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 2; 2026: 2.

4 papers.