mlsanityData to 7 Oct 2026

Creating Artificial Students that Never Existed: Leveraging Large Language Models and CTGANs for Synthetic Data Generation

arXiv 2501.01793 ↗First posted 3 Jan 2025cs.LG cs.AIcited by 3

On the map: Synthetic data and self-improvement for LLMs → LLM synthetic data generation

Abstract (arXiv)

In this study, we explore the growing potential of AI and deep learning technologies, particularly Generative Adversarial Networks (GANs) and Large Language Models (LLMs), for generating synthetic tabular data. Access to quality students data is critical for advancing learning analytics, but privacy concerns and stricter data protection regulations worldwide limit their availability and usage. Synthetic data offers a promising alternative. We investigate whether synthetic data can be leveraged to create artificial students for serving learning analytics models. Using the popular GAN model CTGAN and three LLMs- GPT2, DistilGPT2, and DialoGPT, we generate synthetic tabular student data. Our results demonstrate the strong potential of these methods to produce high-quality synthetic datasets that resemble real students data. To validate our findings, we apply a comprehensive set of utility evaluation metrics to assess the statistical and predictive performance of the synthetic data and compare the different generator models used, specially the performance of LLMs. Our study aims to provide the learning analytics community with valuable insights into the use of synthetic data, laying the groundwork for expanding the field methodological toolbox with new innovative approaches for learning analytics data generation.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Placed in LLM synthetic data generation, one of 13 directions in Synthetic data and self-improvement for LLMs. Builds on 15 of its 59 references that are in the map. First posted on arXiv 3 Jan 2025.

Builds on

15 of 59 references.

References · 15

  1. 2019DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lightercited by 4,243
  2. 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,580
  3. 2023Sparks of Artificial General Intelligence: Early experiments with GPT-4cited by 2,579
  4. 2019DialoGPT: Large-Scale Generative Pre-training for Conversational Response Generationcited by 842
  5. 2019Modeling Tabular data using Conditional GANcited by 695
  6. 2022Language Models are Realistic Tabular Data Generatorscited by 290
  7. 2018Statistical Aspects of Wasserstein Distancescited by 202
  8. 2021How Faithful is your Synthetic Data? Sample-level Metrics for Evaluating and Auditing Generative Modelscited by 193
  9. 2021CTAB-GAN: Effective Table Data Synthesizingcited by 156
  10. 2024Why Tabular Foundation Models Should Be a Research Prioritycited by 103
  11. 2023Synthcity: facilitating innovative use cases of synthetic data in different data modalitiescited by 76
  12. 2024Scaling While Privacy Preserving: A Comprehensive Synthetic Tabular Data Generation and Evaluation in Learning Analyticscited by 18
3 more
  1. 2024Predicting challenge moments from students' discourse: A comparison of GPT-4 to two traditional natural language processing approachescited by 8
  2. 2024Large Language Models Meet User Interfaces: The Case of Provisioning Feedbackcited by 4
  3. 2018Learning Analytics in Massive Open Online Coursescited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 2; 2026: 1.

3 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2024MALLM-GAN: Multi-Agent Large Language Model as Generative Adversarial Network for Synthesizing Tabular Data
  2. 2025A Comprehensive Survey of Synthetic Tabular Data Generation
  3. 2020Tabular GANs for uneven distribution
  4. 2024On LLMs-Driven Synthetic Data Generation, Curation, and Evaluation: A Survey
  5. 2024Generative AI for Synthetic Data Generation: Methods, Challenges and the Future
  6. 2025Generative Models for Synthetic Data: Transforming Data Mining in the GenAI Era
  7. 2025FASTGEN: Fast and Cost-Effective Synthetic Tabular Data Generation with LLMs
  8. 2025Towards Active Synthetic Data Generation for Finetuning Language Models