# Efficient Machine Learning for Big Data: A Review

arXiv: https://arxiv.org/abs/1503.05296 · HTML: https://mlsanity.com/paper/1503.05296/

## Key facts

- Cited by 17 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 18 Mar 2015.

## Built on by (most cited first, 17 of 17)

- [Vertical Federated Learning for Effectiveness, Security, Applicability: A Survey](https://mlsanity.com/paper/2405.17495/) (2024)
- [When Geoscience Meets Foundation Models: Towards General Geoscience Artificial Intelligence System](https://mlsanity.com/paper/2309.06799/) (2023)
- [Federated Multi-View Learning for Private Medical Data Integration and Analysis](https://mlsanity.com/paper/2105.01603/) (2021)
- [Data-Centric Digital Agriculture: A Perspective](https://mlsanity.com/paper/2312.03437/) (2023)
- [Costly Features Classification using Monte Carlo Tree Search](https://mlsanity.com/paper/2102.07073/) (2021)
- [Green Recommender Systems: Optimizing Dataset Size for Energy-Efficient Algorithm Performance](https://mlsanity.com/paper/2410.09359/) (2024)
- [Few-Shot Knowledge Distillation of LLMs With Counterfactual Explanations](https://mlsanity.com/paper/2510.21631/) (2025)
- [Large Language Models Make Sample-Efficient Recommender Systems](https://mlsanity.com/paper/2406.02368/) (2024)
- [Sampling Streaming Data with Parallel Vector Quantization -- PVQ](https://mlsanity.com/paper/2210.01792/) (2022)
- [Using Cooperative Game Theory to Prune Neural Networks](https://mlsanity.com/paper/2311.10468/) (2023)
- [A kinetic-based regularization method for data science applications](https://mlsanity.com/paper/2503.04857/) (2025)
- [Asymmetric compressive learning guarantees with applications to quantized sketches](https://mlsanity.com/paper/2104.10061/) (2021)
- [3D Adapted Random Forest Vision (3DARFV) for Untangling Heterogeneous-Fabric Exceeding Deep Learning Semantic Segmentation Efficiency at the Utmost Accuracy](https://mlsanity.com/paper/2203.12469/) (2022)
- [Balancing Computational Efficiency and Forecast Error in Machine Learning-based Time-Series Forecasting: Insights from Live Experiments on Meteorological Nowcasting](https://mlsanity.com/paper/2309.15207/) (2023)
- [Cheap Learning: Maximising Performance of Language Models for Social Data Science Using Minimal Data](https://mlsanity.com/paper/2401.12295/) (2024)
- [Maturity Framework for Enhancing Machine Learning Quality](https://mlsanity.com/paper/2502.15758/) (2025)
- [RaMark: Radioactive Watermarking for Generated Tabular Data](https://mlsanity.com/paper/2607.09000/) (2026)

## Abstract (arXiv)

With the emerging technologies and all associated devices, it is predicted that massive amount of data will be created in the next few years, in fact, as much as 90% of current data were created in the last couple of years,a trend that will continue for the foreseeable future. Sustainable computing studies the process by which computer engineer/scientist designs computers and associated subsystems efficiently and effectively with minimal impact on the environment. However, current intelligent machine-learning systems are performance driven, the focus is on the predictive/classification accuracy, based on known properties learned from the training samples. For instance, most machine-learning-based nonparametric models are known to require high computational cost in order to find the global optima. With the learning task in a large dataset, the number of hidden nodes within the network will therefore increase significantly, which eventually leads to an exponential rise in computational complexity. This paper thus reviews the theoretical and experimental data-modeling literature, in large-scale data-intensive fields, relating to: (1) model efficiency, including computational requirements in learning, and data-intensive areas structure and design, and introduces (2) new algorithmic approaches with the least memory requirements and processing to minimize computational cost, while maintaining/improving its predictive/classification accuracy and stability.