SOS: Score-based Oversampling for Tabular Data
On the map: Diffusion models → Diffusion foundations and sampling
Abstract (arXiv)
Score-based generative models (SGMs) are a recent breakthrough in generating fake images. SGMs are known to surpass other generative models, e.g., generative adversarial networks (GANs) and variational autoencoders (VAEs). Being inspired by their big success, in this work, we fully customize them for generating fake tabular data. In particular, we are interested in oversampling minor classes since imbalanced classes frequently lead to sub-optimal training outcomes. To our knowledge, we are the first presenting a score-based tabular data oversampling method. Firstly, we re-design our own score network since we have to process tabular data. Secondly, we propose two options for our generation method: the former is equivalent to a style transfer for tabular data and the latter uses the standard generative policy of SGMs. Lastly, we define a fine-tuning method, which further enhances the oversampling quality. In our experiments with 6 datasets and 10 baselines, our method outperforms other oversampling methods in all cases.
Key facts. Cited by 29 papers in the map (data through 14 Oct 2026). Placed in Diffusion foundations and sampling, one of 14 directions in Diffusion models. Builds on 21 of its 46 references that are in the map. First posted on arXiv 17 Jun 2022.
Builds on
21 of 46 references.
Closest ancestors · 4
Same direction, newest first
- 2021Tackling the Generative Learning Trilemma with Denoising Diffusion GANs15 Dec
- 2021Score-Based Generative Modeling with Critically-Damped Langevin Diffusion14 Dec
- 2020Score-Based Generative Modeling through Stochastic Differential Equations26 Nov
- 2020Denoising Diffusion Probabilistic Models19 Jun
Other references · 17
- 2017Improved Training of Wasserstein GANscited by 2,235
- 2016InfoGAN: Interpretable Representation Learning by Information Maximizing Generative Adversarial Netscited by 860
- 2019Modeling Tabular data using Conditional GANcited by 699
- 2018FFJORD: Free-form Continuous Dynamics for Scalable Reversible Generative Modelscited by 594
- 2016Conditional Image Synthesis With Auxiliary Classifier GANscited by 565
- 2021Autoregressive Denoising Diffusion Models for Multivariate Probabilistic Time Series Forecastingcited by 337
- 2017Real-valued (Medical) Time Series Generation with Recurrent Conditional GANscited by 333
- 2017VEEGAN: Reducing Mode Collapse in GANs using Implicit Variational Learningcited by 200
- 2018Data Synthesis based on Generative Adversarial Networkscited by 185
- 2020Adversarial score matching and improved sampling for image generationcited by 96
- 2018BAGAN: Data Augmentation with Balancing GANcited by 90
- 2019Generative Adversarial Minority Oversamplingcited by 73
5 more
- 2020Conditional Wasserstein GAN-based Oversampling of Tabular Data for Imbalanced Learningcited by 67
- 2018Banach Wasserstein GANcited by 56
- 2021OCT-GAN: Neural ODE-based Conditional Tabular GANscited by 27
- 2022Invertible Tabular GANs: Killing Two Birds with OneStone for Tabular Data Synthesiscited by 24
- 2019Quality Aware Generative Adversarial Networkscited by 10
Built on by
Citing papers per year: 2022: 2; 2023: 9; 2024: 8; 2025: 7; 2026: 3.
29 papers.
Sort:
By area:
- 2022TabDDPM: Modelling Tabular Data with Diffusion Modelscited by 377
- 2023Mixed-Type Tabular Data Synthesis with Score-based Diffusion in Latent Spacecited by 186
- 2024Large Language Models(LLMs) on Tabular Data: Prediction, Generation, and Understanding -- A Surveycited by 159
- 2022STaSy: Score-based Tabular data Synthesiscited by 86
- 2023CoDi: Co-evolving Contrastive Diffusion Models for Mixed-type Tabular Synthesiscited by 78
- 2024TabDiff: a Mixed-type Diffusion Model for Tabular Data Generationcited by 63
- 2023TabuLa: Harnessing Language Models for Tabular Data Synthesiscited by 42
- 2025A Comprehensive Survey of Synthetic Tabular Data Generationcited by 28
- 2023Regular Time-series Generation using SGMcited by 23
- 2024Tabular Data Augmentation for Machine Learning: Progress and Prospects of Embracing Generative AIcited by 15
- 2023CuTS: Customizable Tabular Synthetic Data Generationcited by 13
- 2023On the Usefulness of Synthetic Tabular Data Generationcited by 12
17 more
- 2023A Comprehensive Survey on Generative Diffusion Models for Structured Datacited by 8
- 2024Navigating Tabular Data Synthesis Research: Understanding User Needs and Tool Capabilitiescited by 8
- 2025Diffusion and Flow Matching Models for Tabular Data: A Surveycited by 8
- 2024AIGT: AI Generative Table Based on Promptcited by 7
- 2025Diffusion Transformers for Tabular Data Time Series Generationcited by 5
- 2025Generative AI for Self-Adaptive Systems: State of the Art and Research Roadmapcited by 5
- 2024Unmasking Trees for Tabular Datacited by 4
- 2025CausalDiffTab: Mixed-Type Causal-Aware Diffusion for Tabular Data Generationcited by 3
- 2025TSGM: Regular and Irregular Time-series Generation using Score-based Generative Modelscited by 3
- 2024DALL-M: Context-Aware Clinical Data Augmentation with LLMscited by 2
- 2025A Generalized Theory of Mixup for Structure-Preserving Synthetic Datacited by 2
- 2023MadSGM: Multivariate Anomaly Detection with Score-based Generative Modelscited by 1
- 2026TabDLM: Free-Form Tabular Data Generation via Joint Numerical-Language Diffusioncited by 1
- 2023Operator-learning-inspired Modeling of Neural Ordinary Differential Equationscited by 0
- 2024SEMRes-DDPM: Residual Network Based Diffusion Modelling Applied to Imbalanced Datacited by 0
- 2026From Noise to Order: Learning to Rank via Denoising Diffusioncited by 0
- 2026Hierarchical Synthetic Tabular Data Generation: A Hybrid Top-Down and Bottom-Up Frameworkcited by 0
- 2026Hierarchical Synthetic Tabular Data Generation: A Hybrid Top-Down and Bottom-Up Framework27 May 2026
- 2026TabDLM: Free-Form Tabular Data Generation via Joint Numerical-Language Diffusion26 Feb 2026
- 2026From Noise to Order: Learning to Rank via Denoising Diffusion12 Feb 2026
- 2025Generative AI for Self-Adaptive Systems: State of the Art and Research Roadmap4 Dec 2025
- 2025TSGM: Regular and Irregular Time-series Generation using Score-based Generative Models26 Nov 2025
- 2025CausalDiffTab: Mixed-Type Causal-Aware Diffusion for Tabular Data Generation17 Jun 2025
- 2025A Comprehensive Survey of Synthetic Tabular Data Generation23 Apr 2025
- 2025Diffusion Transformers for Tabular Data Time Series Generation10 Apr 2025
- 2025A Generalized Theory of Mixup for Structure-Preserving Synthetic Data3 Mar 2025
- 2025Diffusion and Flow Matching Models for Tabular Data: A Survey24 Feb 2025
- 2024AIGT: AI Generative Table Based on Prompt24 Dec 2024
- 2024TabDiff: a Mixed-type Diffusion Model for Tabular Data Generation27 Oct 2024
17 more
- 2024Tabular Data Augmentation for Machine Learning: Progress and Prospects of Embracing Generative AI31 Jul 2024
- 2024DALL-M: Context-Aware Clinical Data Augmentation with LLMs11 Jul 2024
- 2024Unmasking Trees for Tabular Data8 Jul 2024
- 2024Navigating Tabular Data Synthesis Research: Understanding User Needs and Tool Capabilities31 May 2024
- 2024SEMRes-DDPM: Residual Network Based Diffusion Modelling Applied to Imbalanced Data9 Mar 2024
- 2024Large Language Models(LLMs) on Tabular Data: Prediction, Generation, and Understanding -- A Survey27 Feb 2024
- 2023Operator-learning-inspired Modeling of Neural Ordinary Differential Equations16 Dec 2023
- 2023TabuLa: Harnessing Language Models for Tabular Data Synthesis19 Oct 2023
- 2023Mixed-Type Tabular Data Synthesis with Score-based Diffusion in Latent Space14 Oct 2023
- 2023MadSGM: Multivariate Anomaly Detection with Score-based Generative Models29 Aug 2023
- 2023CuTS: Customizable Tabular Synthetic Data Generation7 Jul 2023
- 2023On the Usefulness of Synthetic Tabular Data Generation27 Jun 2023
- 2023A Comprehensive Survey on Generative Diffusion Models for Structured Data7 Jun 2023
- 2023CoDi: Co-evolving Contrastive Diffusion Models for Mixed-type Tabular Synthesis25 Apr 2023
- 2023Regular Time-series Generation using SGM20 Jan 2023
- 2022STaSy: Score-based Tabular data Synthesis8 Oct 2022
- 2022TabDDPM: Modelling Tabular Data with Diffusion Models30 Sep 2022
- 2022TabDDPM: Modelling Tabular Data with Diffusion Modelscited by 377
- 2023Mixed-Type Tabular Data Synthesis with Score-based Diffusion in Latent Spacecited by 186
- 2022STaSy: Score-based Tabular data Synthesiscited by 86
- 2023CoDi: Co-evolving Contrastive Diffusion Models for Mixed-type Tabular Synthesiscited by 78
- 2024TabDiff: a Mixed-type Diffusion Model for Tabular Data Generationcited by 63
- 2025A Comprehensive Survey of Synthetic Tabular Data Generationcited by 28
- 2023Regular Time-series Generation using SGMcited by 23
- 2023A Comprehensive Survey on Generative Diffusion Models for Structured Datacited by 8
- 2025Diffusion and Flow Matching Models for Tabular Data: A Surveycited by 8
- 2025Diffusion Transformers for Tabular Data Time Series Generationcited by 5
- 2025TSGM: Regular and Irregular Time-series Generation using Score-based Generative Modelscited by 3
- 2026TabDLM: Free-Form Tabular Data Generation via Joint Numerical-Language Diffusioncited by 1
12 most cited of 14 All 14 (JSON)
- 2026TabDLM: Free-Form Tabular Data Generation via Joint Numerical-Language Diffusion26 Feb 2026
- 2026From Noise to Order: Learning to Rank via Denoising Diffusion12 Feb 2026
- 2025TSGM: Regular and Irregular Time-series Generation using Score-based Generative Models26 Nov 2025
- 2025A Comprehensive Survey of Synthetic Tabular Data Generation23 Apr 2025
- 2025Diffusion Transformers for Tabular Data Time Series Generation10 Apr 2025
- 2025Diffusion and Flow Matching Models for Tabular Data: A Survey24 Feb 2025
- 2024TabDiff: a Mixed-type Diffusion Model for Tabular Data Generation27 Oct 2024
- 2024SEMRes-DDPM: Residual Network Based Diffusion Modelling Applied to Imbalanced Data9 Mar 2024
- 2023Mixed-Type Tabular Data Synthesis with Score-based Diffusion in Latent Space14 Oct 2023
- 2023A Comprehensive Survey on Generative Diffusion Models for Structured Data7 Jun 2023
- 2023CoDi: Co-evolving Contrastive Diffusion Models for Mixed-type Tabular Synthesis25 Apr 2023
- 2023Regular Time-series Generation using SGM20 Jan 2023
12 newest of 14 All 14 (JSON)
- 2024Large Language Models(LLMs) on Tabular Data: Prediction, Generation, and Understanding -- A Surveycited by 159
- 2024Tabular Data Augmentation for Machine Learning: Progress and Prospects of Embracing Generative AIcited by 15
- 2023CuTS: Customizable Tabular Synthetic Data Generationcited by 13
- 2023On the Usefulness of Synthetic Tabular Data Generationcited by 12
- 2024Navigating Tabular Data Synthesis Research: Understanding User Needs and Tool Capabilitiescited by 8
- 2024AIGT: AI Generative Table Based on Promptcited by 7
- 2025Generative AI for Self-Adaptive Systems: State of the Art and Research Roadmapcited by 5
- 2024Unmasking Trees for Tabular Datacited by 4
- 2025CausalDiffTab: Mixed-Type Causal-Aware Diffusion for Tabular Data Generationcited by 3
- 2024DALL-M: Context-Aware Clinical Data Augmentation with LLMscited by 2
- 2025A Generalized Theory of Mixup for Structure-Preserving Synthetic Datacited by 2
- 2023MadSGM: Multivariate Anomaly Detection with Score-based Generative Modelscited by 1
12 most cited of 14 All 14 (JSON)
- 2026Hierarchical Synthetic Tabular Data Generation: A Hybrid Top-Down and Bottom-Up Framework27 May 2026
- 2025Generative AI for Self-Adaptive Systems: State of the Art and Research Roadmap4 Dec 2025
- 2025CausalDiffTab: Mixed-Type Causal-Aware Diffusion for Tabular Data Generation17 Jun 2025
- 2025A Generalized Theory of Mixup for Structure-Preserving Synthetic Data3 Mar 2025
- 2024AIGT: AI Generative Table Based on Prompt24 Dec 2024
- 2024Tabular Data Augmentation for Machine Learning: Progress and Prospects of Embracing Generative AI31 Jul 2024
- 2024DALL-M: Context-Aware Clinical Data Augmentation with LLMs11 Jul 2024
- 2024Unmasking Trees for Tabular Data8 Jul 2024
- 2024Navigating Tabular Data Synthesis Research: Understanding User Needs and Tool Capabilities31 May 2024
- 2024Large Language Models(LLMs) on Tabular Data: Prediction, Generation, and Understanding -- A Survey27 Feb 2024
- 2023Operator-learning-inspired Modeling of Neural Ordinary Differential Equations16 Dec 2023
- 2023MadSGM: Multivariate Anomaly Detection with Score-based Generative Models29 Aug 2023
12 newest of 14 All 14 (JSON)
Similar, not cited
Close in wording, no citation either way
- 2020Tabular GANs for uneven distribution
- 2020Improved Techniques for Training Score-Based Generative Models
- 2024A Good Score Does not Lead to A Good Generative Model
- 2024Moderating the Generalization of Score-based Generative Model
- 2023Score Mismatching for Generative Modeling
- 2021Score-based Generative Modeling in Latent Space
- 2026Non-asymptotic Convergence of Stochastic Gradient Descent in Score-based Generative Models
- 2024Multi-objective evolutionary GAN for tabular data synthesis