mlsanityData to 7 Oct 2026

Recent Advances in Generative AI and Large Language Models: Current Status, Challenges, and Perspectives

arXiv 2407.14962 ↗First posted 20 Jul 2024cs.CL cs.AI cs.LGcited by 30

Not on the map. Why?

Abstract (arXiv)

The emergence of Generative Artificial Intelligence (AI) and Large Language Models (LLMs) has marked a new era of Natural Language Processing (NLP), introducing unprecedented capabilities that are revolutionizing various domains. This paper explores the current state of these cutting-edge technologies, demonstrating their remarkable advancements and wide-ranging applications. Our paper contributes to providing a holistic perspective on the technical foundations, practical applications, and emerging challenges within the evolving landscape of Generative AI and LLMs. We believe that understanding the generative capabilities of AI systems and the specific context of LLMs is crucial for researchers, practitioners, and policymakers to collaboratively shape the responsible and ethical integration of these technologies into various domains. Furthermore, we identify and address main research gaps, providing valuable insights to guide future research endeavors within the AI research community.

Key facts. Cited by 30 papers in the map (data through 7 Oct 2026). Builds on 108 of its 182 references that are in the map. First posted on arXiv 20 Jul 2024.

Builds on

108 of 182 references.

References · 108

  1. 2017Attention Is All You Needcited by 59,932
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  3. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  4. 2020Language Models are Few-Shot Learnerscited by 32,199
  5. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  6. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  7. 2023GPT-4 Technical Reportcited by 18,132
  8. 2022Training language models to follow instructions with human feedbackcited by 15,712
  9. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  10. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
  11. 2015Distilling the Knowledge in a Neural Networkcited by 10,076
  12. 2021Training Verifiers to Solve Math Word Problemscited by 9,743
38 more
  1. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
  2. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
  3. 2021Evaluating Large Language Models Trained on Codecited by 8,053
  4. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,916
  5. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
  6. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,539
  7. 2020Scaling Laws for Neural Language Modelscited by 6,411
  8. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
  9. 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
  10. 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,874
  11. 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,304
  12. 2016"Why Should I Trust You?": Explaining the Predictions of Any Classifiercited by 5,040
  13. 2014Neural Machine Translation by Jointly Learning to Align and Translatecited by 4,530
  14. 2021Zero-Shot Text-to-Image Generationcited by 4,276
  15. 2019Parameter-Efficient Transfer Learning for NLPcited by 4,195
  16. 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,067
  17. 2013Auto-Encoding Variational Bayescited by 3,980
  18. 2016Gaussian Error Linear Units (GELUs)cited by 3,431
  19. 2017Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layercited by 3,413
  20. 2020Longformer: The Long-Document Transformercited by 3,362
  21. 2017Progressive Growing of GANs for Improved Quality, Stability, and Variationcited by 2,967
  22. 2022Training Compute-Optimal Large Language Modelscited by 2,927
  23. 2019XLNet: Generalized Autoregressive Pretraining for Language Understandingcited by 2,801
  24. 2016Deep Learning with Differential Privacycited by 2,682
  25. 2015Variational Inference with Normalizing Flowscited by 2,161
  26. 2015Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networkscited by 2,048
  27. 2019Transformer-XL: Attentive Language Models Beyond a Fixed-Length Contextcited by 1,830
  28. 2020Big Bird: Transformers for Longer Sequencescited by 1,673
  29. 2019Generating Long Sequences with Sparse Transformerscited by 1,523
  30. 2019Semantic Image Synthesis with Spatially-Adaptive Normalizationcited by 1,295
  31. 2022Scaling Autoregressive Models for Content-Rich Text-to-Image Generationcited by 1,287
  32. 2020CodeBERT: A Pre-Trained Model for Programming and Natural Languagescited by 1,286
  33. 2022LaMDA: Language Models for Dialog Applicationscited by 1,218
  34. 2021Scaling Language Models: Methods, Analysis & Insights from Training Gophercited by 1,199
  35. 2023PaLM 2 Technical Reportcited by 1,154
  36. 2021Variational Diffusion Modelscited by 1,145
  37. 2022Editing Models with Task Arithmeticcited by 1,076
  38. 2017Multimodal Machine Learning: A Survey and Taxonomycited by 1,004

50 most cited of 108 All 108 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 3; 2025: 23; 2026: 4.

30 papers.

Sort:

By area:

  1. 2024Enabling Novel Mission Operations and Interactions with ROSA: The Robot Operating System Agentcited by 16
  2. 2024IFAR: Multi-Perspective and Multi-Level Causal Discovery with LLMscited by 9
  3. 2025Scaling Up Biomedical Vision-Language Models: Fine-Tuning, Instruction Tuning, and Multi-Modal Learningcited by 6
  4. 2025Advancing Talking Head Generation: A Comprehensive Survey of Multi-Modal Methodologies, Datasets, Evaluation Metrics, and Loss Functionscited by 6
  5. 2025Who Owns the Output? Bridging Law and Technology in LLMs Attributioncited by 4
  6. 2025Combining TSL and LLM to Automate REST API Testing: A Comparative Studycited by 3
  7. 2025HarmNet: A Framework for Adaptive Multi-Turn Jailbreak Attacks on Large Language Modelscited by 3
  8. 2026Multi-Modal Data-Enhanced Foundation Models for Prediction and Control in Wireless Networks: A Surveycited by 3
  9. 2025Generative AI and Large Language Models in Language Preservation: Opportunities and Challengescited by 2
  10. 2025Artificial Intelligence for Atmospheric Sciences: A Research Roadmapcited by 2
  11. 2025Agentic Satellite-Augmented Low-Altitude Economy and Terrestrial Networks: A Survey on Generative Approachescited by 2
  12. 2025Generative Multi-Objective Bayesian Optimization with Scalable Batch Evaluations for Sample-Efficient De Novo Molecular Designcited by 2
18 more
  1. 2025Ethical Concerns of Generative AI and Mitigation Strategies: A Systematic Mapping Studycited by 1
  2. 2025ReaCritic: Reasoning Transformer-based DRL Critic-model Scaling For Wireless Networkscited by 1
  3. 2025LLM-Powered Quantum Code Transpilationcited by 1
  4. 2025Towards Inclusive NLP: Assessing Compressed Multilingual Transformers across Diverse Language Benchmarkscited by 1
  5. 2025Beyond Benchmarks: LLM Evaluation with an Anthropomorphic and Lifecycle-oriented Roadmapcited by 1
  6. 2025A Survey: Towards Privacy and Security in Mobile Large Language Modelscited by 1
  7. 2025NL2GenSym: Natural Language to Generative Symbolic Rules for SOAR Cognitive Architecture via Large Language Modelscited by 1
  8. 2025Federated Attention: A Distributed Paradigm for Collaborative LLM Inference over Edge Networkscited by 1
  9. 2024Is Our Chatbot Telling Lies? Assessing Correctness of an LLM-based Dutch Support Chatbotcited by 0
  10. 2025Retrospective: A CORDIC Based Configurable Activation Function for NN Applicationscited by 0
  11. 2025Physical foundations for trustworthy medical imaging: a review for artificial intelligence researcherscited by 0
  12. 2025Psychology-Driven Enhancement of Humour Translationcited by 0
  13. 2025CALR: Corrective Adaptive Low-Rank Decomposition for Efficient Large Language Model Layer Compressioncited by 0
  14. 2025Impact and Implications of Generative AI for Enterprise Architects in Agile Environments: A Systematic Literature Reviewcited by 0
  15. 2025Semimage: HSV-Based Semantic Image Encoding for Disentangled Text Representationcited by 0
  16. 2026Co-evolving Agent Architectures and Interpretable Reasoning for Automated Optimizationcited by 0
  17. 2026Agentic and Generative AI for Open-Source Intelligence and Cyber Investigations: Taxonomy, Evaluation, Challenges, and Future Directionscited by 0
  18. 2026HyperZip: Efficient Data Compression through Personalized Diffusion LLMs with Hypernetworkscited by 0