mlsanityData to 7 Oct 2026

General Purpose Artificial Intelligence Systems (GPAIS): Properties, Definition, Taxonomy, Societal Implications and Responsible Governance

arXiv 2307.14283 ↗First posted 26 Jul 2023cs.AI cs.LGcited by 1

Not on the map. Why?

Abstract (arXiv)

Most applications of Artificial Intelligence (AI) are designed for a confined and specific task. However, there are many scenarios that call for a more general AI, capable of solving a wide array of tasks without being specifically designed for them. The term General-Purpose Artificial Intelligence Systems (GPAIS) has been defined to refer to these AI systems. To date, the possibility of an Artificial General Intelligence, powerful enough to perform any intellectual task as if it were human, or even improve it, has remained an aspiration, fiction, and considered a risk for our society. Whilst we might still be far from achieving that, GPAIS is a reality and sitting at the forefront of AI research. This work discusses existing definitions for GPAIS and proposes a new definition that allows for a gradual differentiation among types of GPAIS according to their properties and limitations. We distinguish between closed-world and open-world GPAIS, characterising their degree of autonomy and ability based on several factors such as adaptation to new tasks, competence in domains not intentionally trained for, ability to learn from few data, or proactive acknowledgment of their own limitations. We propose a taxonomy of approaches to realise GPAIS, describing research trends such as the use of AI techniques to improve another AI (AI-powered AI) or (single) foundation models. As a prime example, we delve into GenAI, aligning them with the concepts presented in the taxonomy. We explore multi-modality, which involves fusing various types of data sources to expand the capabilities of GPAIS. Through the proposed definition and taxonomy, our aim is to facilitate research collaboration across different areas that are tackling general purpose tasks, as they share many common aspects. Finally, we discuss the state of GPAIS, prospects, societal implications, and the need for regulation and governance.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 63 of its 137 references that are in the map. First posted on arXiv 26 Jul 2023.

Builds on

63 of 137 references.

References · 63

  1. 2017Attention Is All You Needcited by 59,932
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  4. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
  5. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
  6. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
  7. 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,290
  8. 2013Distributed Representations of Words and Phrases and their Compositionalitycited by 3,462
  9. 2019A Comprehensive Survey on Graph Neural Networkscited by 2,906
  10. 2022Emergent Abilities of Large Language Modelscited by 2,483
  11. 2019Optuna: A Next-generation Hyperparameter Optimization Frameworkcited by 2,455
  12. 2016Matching Networks for One Shot Learningcited by 2,246
38 more
  1. 2022Survey of Hallucination in Natural Language Generationcited by 2,056
  2. 2018Graph Neural Networks: A Review of Methods and Applicationscited by 1,571
  3. 2019Explainable Artificial Intelligence (XAI): Concepts, Taxonomies, Opportunities and Challenges toward Responsible AIcited by 1,543
  4. 2019Mastering Atari, Go, Chess and Shogi by Planning with a Learned Modelcited by 1,327
  5. 2018Continual Lifelong Learning with Neural Networks: A Reviewcited by 1,313
  6. 2019Energy and Policy Considerations for Deep Learning in NLPcited by 1,242
  7. 2023HuggingGPT: Solving AI Tasks with ChatGPT and its Friends in Hugging Facecited by 1,173
  8. 2017Multimodal Machine Learning: A Survey and Taxonomycited by 1,004
  9. 2017A Survey on Multi-Task Learningcited by 838
  10. 2022A Generalist Agentcited by 802
  11. 2023The RefinedWeb Dataset for Falcon LLM: Outperforming Curated Corpora with Web Data, and Web Data Onlycited by 755
  12. 2022TabPFN: A Transformer That Solves Small Tabular Classification Problems in a Secondcited by 643
  13. 2023ChemCrow: Augmenting large-language models with chemistry toolscited by 609
  14. 2023Are Emergent Abilities of Large Language Models a Mirage?cited by 515
  15. 2019Generalizing from a Few Examples: A Survey on Few-Shot Learningcited by 462
  16. 2018Deep Learning on Graphs: A Surveycited by 393
  17. 2019AutoML: A Survey of the State-of-the-Artcited by 388
  18. 2017Variational Continual Learningcited by 335
  19. 2016Learning from Simulated and Unsupervised Images through Adversarial Trainingcited by 287
  20. 2023The False Promise of Imitating Proprietary LLMscited by 254
  21. 2015Domain Generalization for Object Recognition with Multi-task Autoencoderscited by 253
  22. 2023Auto-GPT for Online Decision Making: Benchmarks and Additional Opinionscited by 250
  23. 2023An Overview of Catastrophic AI Riskscited by 214
  24. 2016Learning to Optimizecited by 195
  25. 2019Meta-Learning Representations for Continual Learningcited by 189
  26. 2018Reinforced Continual Learningcited by 186
  27. 2019Paired Open-Ended Trailblazer (POET): Endlessly Generating Increasingly Complex and Diverse Learning Environments and Their Solutionscited by 182
  28. 2020Auto-Sklearn 2.0: Hands-free AutoML via Meta-Learningcited by 174
  29. 2019A Survey on Active Learning and Human-in-the-Loop Deep Learning for Medical Image Analysiscited by 150
  30. 2022GitHub Copilot AI pair programmer: Asset or Liability?cited by 150
  31. 2020AutoML-Zero: Evolving Machine Learning Algorithms From Scratchcited by 137
  32. 2023Meta-Transformer: A Unified Framework for Multimodal Learningcited by 136
  33. 2021Actionable Models: Unsupervised Offline Reinforcement Learning of Robotic Skillscited by 125
  34. 2017Quality and Diversity Optimization: A Unifying Modular Frameworkcited by 111
  35. 2023Regulating ChatGPT and other Large Generative AI Modelscited by 102
  36. 2019AI-GAs: AI-generating algorithms, an alternate paradigm for producing general artificial intelligencecited by 84
  37. 2023A Systematic Review of Green AIcited by 77
  38. 2022Automated Reinforcement Learning (AutoRL): A Survey and Open Problemscited by 69

50 most cited of 63 All 63 (JSON)

Built on by

Cited by year

Citing papers per year: 2023: 1.

1 paper.

  1. 2023Can LLM-Generated Misinformation Be Detected?cited by 173