mlsanityData to 7 Oct 2026

Generative Artificial Intelligence: A Systematic Review and Applications

arXiv 2405.11029 ↗First posted 17 May 2024cs.LG cs.AI cs.CLcited by 37

Not on the map. Why?

Abstract (arXiv)

In recent years, the study of artificial intelligence (AI) has undergone a paradigm shift. This has been propelled by the groundbreaking capabilities of generative models both in supervised and unsupervised learning scenarios. Generative AI has shown state-of-the-art performance in solving perplexing real-world conundrums in fields such as image translation, medical diagnostics, textual imagery fusion, natural language processing, and beyond. This paper documents the systematic review and analysis of recent advancements and techniques in Generative AI with a detailed discussion of their applications including application-specific models. Indeed, the major impact that generative AI has made to date, has been in language generation with the development of large language models, in the field of image translation and several other interdisciplinary applications of generative AI. Moreover, the primary contribution of this paper lies in its coherent synthesis of the latest advancements in these areas, seamlessly weaving together contemporary breakthroughs in the field. Particularly, how it shares an exploration of the future trajectory for generative AI. In conclusion, the paper ends with a discussion of Responsible AI principles, and the necessary ethical considerations for the sustainability and growth of these generative models.

Key facts. Cited by 37 papers in the map (data through 7 Oct 2026). Builds on 93 of its 168 references that are in the map. First posted on arXiv 17 May 2024.

Builds on

93 of 168 references.

References · 93

  1. 2017Attention Is All You Needcited by 59,932
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  3. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  4. 2020Language Models are Few-Shot Learnerscited by 32,199
  5. 2023GPT-4 Technical Reportcited by 18,132
  6. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  7. 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
  8. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  9. 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,874
  10. 2022Generative Adversarial Networkscited by 5,603
  11. 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,510
  12. 2013Efficient Estimation of Word Representations in Vector Spacecited by 4,346
38 more
  1. 2014Deep Learning Face Attributes in the Wildcited by 3,679
  2. 2023Let's Verify Step by Stepcited by 3,598
  3. 2014Sequence to Sequence Learning with Neural Networkscited by 2,974
  4. 2016Improved Techniques for Training GANscited by 2,938
  5. 2018Deep contextualized word representationscited by 2,285
  6. 2014Conditional Generative Adversarial Netscited by 2,152
  7. 2016Density estimation using Real NVPcited by 2,029
  8. 2019A Survey on Bias and Fairness in Machine Learningcited by 1,911
  9. 2018SlowFast Networks for Video Recognitioncited by 1,862
  10. 2021WebGPT: Browser-assisted question-answering with human feedbackcited by 1,722
  11. 2016WaveNet: A Generative Model for Raw Audiocited by 1,710
  12. 2021ViViT: A Video Vision Transformercited by 1,610
  13. 2021Is Space-Time Attention All You Need for Video Understanding?cited by 1,609
  14. 2019Explainable Artificial Intelligence (XAI): Concepts, Taxonomies, Opportunities and Challenges toward Responsible AIcited by 1,543
  15. 2018Glow: Generative Flow with Invertible 1x1 Convolutionscited by 1,539
  16. 2021Video Swin Transformercited by 1,090
  17. 2014NICE: Non-linear Independent Components Estimationcited by 1,052
  18. 2017ChestX-ray8: Hospital-scale Chest X-ray Database and Benchmarks on Weakly-Supervised Classification and Localization of Common Thorax Diseasescited by 969
  19. 2018XNLI: Evaluating Cross-lingual Sentence Representationscited by 913
  20. 2021Multiscale Vision Transformerscited by 896
  21. 2016InfoGAN: Interpretable Representation Learning by Information Maximizing Generative Adversarial Netscited by 858
  22. 2019CTRL: A Conditional Transformer Language Model for Controllable Generationcited by 754
  23. 2017VoxCeleb: a large-scale speaker identification datasetcited by 714
  24. 2018Which Training Methods for GANs do actually Converge?cited by 672
  25. 2020A Lip Sync Expert Is All You Need for Speech to Lip Generation In The Wildcited by 669
  26. 2016Improving Variational Inference with Inverse Autoregressive Flowcited by 636
  27. 2020X3D: Expanding Architectures for Efficient Video Recognitioncited by 635
  28. 2017Generative Adversarial Networks: An Overviewcited by 588
  29. 2018FFJORD: Free-form Continuous Dynamics for Scalable Reversible Generative Modelscited by 584
  30. 2016Conditional Image Synthesis With Auxiliary Classifier GANscited by 562
  31. 2019LayoutLM: Pre-training of Text and Layout for Document Image Understandingcited by 549
  32. 2019ERNIE: Enhanced Language Representation with Informative Entitiescited by 525
  33. 2021MViTv2: Improved Multiscale Vision Transformers for Classification and Detectioncited by 516
  34. 2020Pre-trained Models for Natural Language Processing: A Surveycited by 504
  35. 2023Scaling up GANs for Text-to-Image Synthesiscited by 492
  36. 2016SeqGAN: Sequence Generative Adversarial Nets with Policy Gradientcited by 375
  37. 2021QMSum: A New Benchmark for Query-based Multi-domain Meeting Summarizationcited by 363
  38. 2016Adversarial Feature Learningcited by 350

50 most cited of 93 All 93 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 2; 2025: 21; 2026: 14.

37 papers.

Sort:

By area:

  1. 2025Agentic AI: A Comprehensive Survey of Architectures, Applications, and Future Directionscited by 46
  2. 2024A review of faithfulness metrics for hallucination assessment in Large Language Modelscited by 9
  3. 2025Boosting Relational Deep Learning with Pretrained Tabular Modelscited by 9
  4. 2025Leveraging ASIC AI Chips for Homomorphic Encryptioncited by 3
  5. 2025Aura-CAPTCHA: A Reinforcement Learning and GAN-Enhanced Multi-Modal CAPTCHA Systemcited by 3
  6. 2025REGEN: Real-Time Photorealism Enhancement in Games via a Dual-Stage Generative Network Frameworkcited by 3
  7. 2025Quantum Generative Adversarial Autoencoders: Learning latent representations for quantum data generationcited by 3
  8. 2025GUI-Rise: Structured Reasoning and History Summarization for GUI Navigationcited by 3
  9. 2025EvalTalker: Learning to Evaluate Real-Portrait-Driven Multi-Subject Talking Humanscited by 3
  10. 2025An evaluation of LLMs for generating movie reviews: GPT-4o, Gemini-2.0 and DeepSeek-V3cited by 2
  11. 2025The Role of Generative AI in Facilitating Social Interactions: A Scoping Reviewcited by 1
  12. 2025GenAI-based Multi-Agent Reinforcement Learning towards Distributed Agent Intelligence: A Generative-RL Agent Perspectivecited by 1
25 more
  1. 2026Model selection in hybrid quantum neural networks with applications to quantum transformer architecturescited by 1
  2. 2026Quantum Generative Diffusion Model for Real-World Time Seriescited by 1
  3. 2026Rethinking Automated Program Repair: The Impact of Bug Complexity, Fault Localization, and LLM Cost-efficiencycited by 1
  4. 2024GaNDLF-Synth: A Framework to Democratize Generative AI for (Bio)Medical Imagingcited by 0
  5. 2025Comparing Methods for Bias Mitigation in Graph Neural Networkscited by 0
  6. 2025Neuronal correlations shape the scaling behavior of memory capacity and nonlinear computational capability of reservoir recurrent neural networkscited by 0
  7. 2025Jarzynski Reweighting and Sampling Dynamics for Training Energy-Based Models: Theoretical Analysis of Different Transition Kernelscited by 0
  8. 2025Towards High Supervised Learning Utility Training Data Generation: Data Pruning and Column Reorderingcited by 0
  9. 2025WaveLLDM: Design and Development of a Lightweight Latent Diffusion Model for Speech Enhancement and Restorationcited by 0
  10. 2025K-Syn: K-space Data Synthesis in Ultra Low-data Regimescited by 0
  11. 2025Can generative AI figure out figurative language? The influence of idioms on essay scoring by ChatGPT, Gemini, and Deepseekcited by 0
  12. 2025GreenPlanner: Practical Floorplan Layout Generation via an Energy-Aware and Function-Feasible Generative Frameworkcited by 0
  13. 2025Toward Agentic Environments: GenAI and the Convergence of AI, Sustainability, and Human-Centric Spacescited by 0
  14. 2025Topic Discovery and Classification for Responsible Generative AI Adaptation in Higher Educationcited by 0
  15. 2026Stochastic Neural Networks for Quantum Devicescited by 0
  16. 2026Simulating Meaning, Nevermore! Introducing ICR: A Semiotic-Hermeneutic Metric for Evaluating Meaning in LLM Text Summariescited by 0
  17. 2026HURRI-GAN: A Novel Approach for Hurricane Bias-Correction Beyond Gauge Stations using Generative Adversarial Networkscited by 0
  18. 2026Automated In-the-Wild Data Collection for Continual AI Generated Image Detectioncited by 0
  19. 2026Imitation learning for clinical decision support in pediatric ECMOcited by 0
  20. 2026From Prompts to Context: An Ontology-Driven Framework for Human-Generative AI Collaborationcited by 0
  21. 2026From Prompt to Service: An SLM-Based Agent Orchestration Gateway for AI-Driven Virtual Worldscited by 0
  22. 2026A Qualitative Review of GenAI-Based Methods for Data Generation and Augmentation in Industrial Computer Vision Applicationscited by 0
  23. 2026AME: A Multi-Type Contributor Attribution Framework in Generative AI Marketscited by 0
  24. 2026A Phased Development Framework Enabling Islanded Operation of Sustainable AI Data Centers With Onsite Grid-Following and Grid-Forming Energy Architecturescited by 0
  25. 2026Variational Augmented Invertible Koopman Autoencoder for probabilistic time series forecastingcited by 0