Imbalanced Big Data Oversampling: Taxonomy, Algorithms, Software, Guidelines and Future Directions
Not on the map. Why?
Abstract (arXiv)
Learning from imbalanced data is among the most challenging areas in contemporary machine learning. This becomes even more difficult when considered the context of big data that calls for dedicated architectures capable of high-performance processing. Apache Spark is a highly efficient and popular architecture, but it poses specific challenges for algorithms to be implemented for it. While oversampling algorithms are an effective way for handling class imbalance, they have not been designed for distributed environments. In this paper, we propose a holistic look on oversampling algorithms for imbalanced big data. We discuss the taxonomy of oversampling algorithms and their mechanisms used to handle skewed class distributions. We introduce a Spark library with 14 state-of-the-art oversampling algorithms implemented and evaluate their efficacy via extensive experimental study. Using binary and multi-class massive data sets, we analyze the effectiveness of oversampling algorithms and their relationships with different types of classifiers. We evaluate the trade-off between accuracy and time complexity of oversampling algorithms, as well as their scalability when increasing the size of data. This allows us to gain insight into the usefulness of specific components of oversampling algorithms for big data, as well as formulate guidelines and recommendations for designing future resampling approaches for massive imbalanced data. Our library can be downloaded from https://github.com/fsleeman/spark-class-balancing.git.
Key facts. Cited by 21 papers in the map (data through 7 Oct 2026). Builds on 31 of its 194 references that are in the map. First posted on arXiv 24 Jul 2021.
Builds on
31 of 194 references.
References · 31
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
- 2015Rethinking the Inception Architecture for Computer Visioncited by 5,451
- 2017Multimodal Machine Learning: A Survey and Taxonomycited by 1,004
- 2015Cost Sensitive Learning of Deep Feature Representations from Imbalanced Datacited by 167
- 2013A Survey on Multi-view Learningcited by 152
- 2020More Diverse Means Better: Multimodal Deep Learning Meets Remote Sensing Imagery Classificationcited by 126
- 2019Deep Learning in Medical Image Registration: A Surveycited by 124
- 2016A Survey of Multi-View Representation Learningcited by 107
- 2019Multimodal Intelligence: Representation Learning, Information Fusion, and Applicationscited by 89
- 2019Deep Learning for Classification of Hyperspectral Data: A Comparative Reviewcited by 51
- 2020Multimodal Prototypical Networks for Few-shot Learningcited by 48
19 more
- 2018Multimodal Machine Learning for Automated ICD Codingcited by 40
- 2017A Survey on Multi-View Clusteringcited by 32
- 2019EmbraceNet: A robust deep learning architecture for multimodal classificationcited by 30
- 2017Temporal Multimodal Fusion for Video Emotion Classification in the Wildcited by 18
- 2019A review on deep learning techniques for 3D sensed data classificationcited by 18
- 2020Combined Cleaning and Resampling Algorithm for Multi-Class Imbalanced Data with Label Noisecited by 18
- 2017AENet: Learning Deep Audio Features for Video Analysiscited by 13
- 2019Multimodal music information processing and retrieval: survey and future challengescited by 13
- 2019Multimodal Emotion Classificationcited by 10
- 2021ECG Heartbeat Classification Using Multimodal Fusioncited by 10
- 2017Multimodal deep learning approach for joint EEG-EMG data compression and classificationcited by 7
- 2019A Joint Model for Multimodal Document Quality Assessmentcited by 7
- 2019Multimodal Age and Gender Classification Using Ear and Profile Face Imagescited by 6
- 2019Controlling for Confounders in Multimodal Emotion Classification via Adversarial Learningcited by 6
- 2020Multimodal Material Classification for Robots using Spectroscopy and High Resolution Texture Imagingcited by 4
- 2020Multimodal price predictioncited by 4
- 2021Hellinger Distance Weighted Ensemble for Imbalanced Data Stream Classificationcited by 4
- 2018Multimodal Classification with Deep Convolutional-Recurrent Neural Networks for Electroencephalographycited by 3
- 2020Automatic Chronic Degenerative Diseases Identification Using Enteric Nervous System Imagescited by 2
Built on by
Citing papers per year: 2022: 3; 2023: 6; 2024: 7; 2025: 2; 2026: 3.
21 papers.
Sort:
- 2024A review of deep learning-based information fusion techniques for multimodal medical image classificationcited by 25
- 2022Does a Technique for Building Multimodal Representation Matter? -- Comparative Analysiscited by 22
- 2023Multimodal Data Integration for Oncology in the Era of Deep Neural Networks: A Reviewcited by 20
- 2024Reading Between the Frames: Multi-Modal Depression Detection in Videos from Non-Verbal Cuescited by 11
- 2024A Survey on Multimodal Wearable Sensor-based Human Action Recognitioncited by 10
- 2024Enhancing Vision-Language Models with Scene Graphs for Traffic Accident Understandingcited by 10
- 2024Comprehensive Multimodal Deep Learning Survival Prediction Enabled by a Transformer Architecture: A Multicenter Study in Glioblastomacited by 9
- 2022Improved Kidney Stone Recognition Through Attention and Multi-View Feature Fusion Strategiescited by 6
- 2023Improved Automatic Diabetic Retinopathy Severity Classification Using Deep Multimodal Fusion of UWF-CFP and OCTA Imagescited by 6
- 2023MuG: A Multimodal Classification Benchmark on Game Data with Tabular, Textual, and Visual Fieldscited by 5
- 2023MultiSChuBERT: Effective Multimodal Fusion for Scholarly Document Quality Predictioncited by 4
- 2025Robust Multi-View Learning via Representation Fusion of Sample-Level Attention and Alignment of Simulated Perturbationcited by 3
9 more
- 2023Non-contact Multimodal Indoor Human Monitoring Systems: A Surveycited by 2
- 2024Embedding-based Multimodal Learning on Pan-Squamous Cell Carcinomas for Improved Survival Outcomescited by 2
- 2022The Hateful Memes Challenge Next Movecited by 1
- 2024Deep Learning-Based Noninvasive Screening of Type 2 Diabetes with Chest X-ray Images and Electronic Health Recordscited by 1
- 2026Artificial Intelligence for the Characterization of Particles and Fibers by Optical Microscopycited by 1
- 2023Explainable Multi-View Deep Networks Methodology for Experimental Physicscited by 0
- 2025Class Similarity-Based Multimodal Classification under Heterogeneous Category Setscited by 0
- 2026Residual-Guided Expert Specialization for Incomplete Multimodal Learningcited by 0
- 2026Multimodal Cultural Heritage Architectural Style Classification for Residential Buildings in the UAE Based on CLIP Embeddings and SVMcited by 0
- 2026Multimodal Cultural Heritage Architectural Style Classification for Residential Buildings in the UAE Based on CLIP Embeddings and SVM15 Sep 2026
- 2026Artificial Intelligence for the Characterization of Particles and Fibers by Optical Microscopy1 Aug 2026
- 2026Residual-Guided Expert Specialization for Incomplete Multimodal Learning29 Jun 2026
- 2025Class Similarity-Based Multimodal Classification under Heterogeneous Category Sets11 Jun 2025
- 2025Robust Multi-View Learning via Representation Fusion of Sample-Level Attention and Alignment of Simulated Perturbation6 Mar 2025
- 2024Deep Learning-Based Noninvasive Screening of Type 2 Diabetes with Chest X-ray Images and Electronic Health Records14 Dec 2024
- 2024Enhancing Vision-Language Models with Scene Graphs for Traffic Accident Understanding8 Jul 2024
- 2024Embedding-based Multimodal Learning on Pan-Squamous Cell Carcinomas for Improved Survival Outcomes11 Jun 2024
- 2024Comprehensive Multimodal Deep Learning Survival Prediction Enabled by a Transformer Architecture: A Multicenter Study in Glioblastoma21 May 2024
- 2024A review of deep learning-based information fusion techniques for multimodal medical image classification23 Apr 2024
- 2024A Survey on Multimodal Wearable Sensor-based Human Action Recognition14 Apr 2024
- 2024Reading Between the Frames: Multi-Modal Depression Detection in Videos from Non-Verbal Cues5 Jan 2024
9 more
- 2023Non-contact Multimodal Indoor Human Monitoring Systems: A Survey11 Dec 2023
- 2023Improved Automatic Diabetic Retinopathy Severity Classification Using Deep Multimodal Fusion of UWF-CFP and OCTA Images3 Oct 2023
- 2023Explainable Multi-View Deep Networks Methodology for Experimental Physics16 Aug 2023
- 2023MultiSChuBERT: Effective Multimodal Fusion for Scholarly Document Quality Prediction15 Aug 2023
- 2023Multimodal Data Integration for Oncology in the Era of Deep Neural Networks: A Review11 Mar 2023
- 2023MuG: A Multimodal Classification Benchmark on Game Data with Tabular, Textual, and Visual Fields6 Feb 2023
- 2022The Hateful Memes Challenge Next Move13 Dec 2022
- 2022Improved Kidney Stone Recognition Through Attention and Multi-View Feature Fusion Strategies5 Nov 2022
- 2022Does a Technique for Building Multimodal Representation Matter? -- Comparative Analysis9 Jun 2022
- 2024A review of deep learning-based information fusion techniques for multimodal medical image classificationcited by 25
- 2022Does a Technique for Building Multimodal Representation Matter? -- Comparative Analysiscited by 22
- 2023Multimodal Data Integration for Oncology in the Era of Deep Neural Networks: A Reviewcited by 20
- 2024Reading Between the Frames: Multi-Modal Depression Detection in Videos from Non-Verbal Cuescited by 11
- 2024A Survey on Multimodal Wearable Sensor-based Human Action Recognitioncited by 10
- 2024Enhancing Vision-Language Models with Scene Graphs for Traffic Accident Understandingcited by 10
- 2024Comprehensive Multimodal Deep Learning Survival Prediction Enabled by a Transformer Architecture: A Multicenter Study in Glioblastomacited by 9
- 2022Improved Kidney Stone Recognition Through Attention and Multi-View Feature Fusion Strategiescited by 6
- 2023Improved Automatic Diabetic Retinopathy Severity Classification Using Deep Multimodal Fusion of UWF-CFP and OCTA Imagescited by 6
- 2023MuG: A Multimodal Classification Benchmark on Game Data with Tabular, Textual, and Visual Fieldscited by 5
- 2023MultiSChuBERT: Effective Multimodal Fusion for Scholarly Document Quality Predictioncited by 4
- 2025Robust Multi-View Learning via Representation Fusion of Sample-Level Attention and Alignment of Simulated Perturbationcited by 3
12 most cited of 21 All 21 (JSON)
- 2026Multimodal Cultural Heritage Architectural Style Classification for Residential Buildings in the UAE Based on CLIP Embeddings and SVM15 Sep 2026
- 2026Artificial Intelligence for the Characterization of Particles and Fibers by Optical Microscopy1 Aug 2026
- 2026Residual-Guided Expert Specialization for Incomplete Multimodal Learning29 Jun 2026
- 2025Class Similarity-Based Multimodal Classification under Heterogeneous Category Sets11 Jun 2025
- 2025Robust Multi-View Learning via Representation Fusion of Sample-Level Attention and Alignment of Simulated Perturbation6 Mar 2025
- 2024Deep Learning-Based Noninvasive Screening of Type 2 Diabetes with Chest X-ray Images and Electronic Health Records14 Dec 2024
- 2024Enhancing Vision-Language Models with Scene Graphs for Traffic Accident Understanding8 Jul 2024
- 2024Embedding-based Multimodal Learning on Pan-Squamous Cell Carcinomas for Improved Survival Outcomes11 Jun 2024
- 2024Comprehensive Multimodal Deep Learning Survival Prediction Enabled by a Transformer Architecture: A Multicenter Study in Glioblastoma21 May 2024
- 2024A review of deep learning-based information fusion techniques for multimodal medical image classification23 Apr 2024
- 2024A Survey on Multimodal Wearable Sensor-based Human Action Recognition14 Apr 2024
- 2024Reading Between the Frames: Multi-Modal Depression Detection in Videos from Non-Verbal Cues5 Jan 2024
12 newest of 21 All 21 (JSON)