mlsanityData to 7 Oct 2026

Thousands of AI Authors on the Future of AI

arXiv 2401.02843 ↗First posted 5 Jan 2024cs.CY cs.AI cs.LGcited by 48

Not on the map. Why?

Abstract (arXiv)

In the largest survey of its kind, 2,778 researchers who had published in top-tier artificial intelligence (AI) venues gave predictions on the pace of AI progress and the nature and impacts of advanced AI systems The aggregate forecasts give at least a 50% chance of AI systems achieving several milestones by 2028, including autonomously constructing a payment processing site from scratch, creating a song indistinguishable from a new song by a popular musician, and autonomously downloading and fine-tuning a large language model. If science continues undisrupted, the chance of unaided machines outperforming humans in every possible task was estimated at 10% by 2027, and 50% by 2047. The latter estimate is 13 years earlier than that reached in a similar survey we conducted only one year earlier [Grace et al., 2022]. However, the chance of all human occupations becoming fully automatable was forecast to reach 10% by 2037, and 50% as late as 2116 (compared to 2164 in the 2022 survey). Most respondents expressed substantial uncertainty about the long-term value of AI progress: While 68.3% thought good outcomes from superhuman AI are more likely than bad, of these net optimists 48% gave at least a 5% chance of extremely bad outcomes such as human extinction, and 59% of net pessimists gave 5% or more to extremely good outcomes. Between 38% and 51% of respondents gave at least a 10% chance to advanced AI leading to outcomes as bad as human extinction. More than half suggested that "substantial" or "extreme" concern is warranted about six different AI-related scenarios, including misinformation, authoritarian control, and inequality. There was disagreement about whether faster or slower AI progress would be better for the future of humanity. However, there was broad agreement that research aimed at minimizing potential risks from AI systems ought to be prioritized more.

Key facts. Cited by 48 papers in the map (data through 7 Oct 2026). Builds on 4 of its 46 references that are in the map. First posted on arXiv 5 Jan 2024.

Builds on

4 of 46 references.

References · 4

  1. 2023AI Deception: A Survey of Examples, Risks, and Potential Solutionscited by 185
  2. 2022Is Power-Seeking AI an Existential Risk?cited by 101
  3. 2017When Will AI Exceed Human Performance? Evidence from AI Expertscited by 41
  4. 2022Forecasting AI Progress: Evidence from a Survey of Machine Learning Researcherscited by 7

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 20; 2025: 17; 2026: 11.

48 papers.

Sort:

By area:

  1. 2024Alignment faking in large language modelscited by 316
  2. 2025Natural Emergent Misalignment from Reward Hacking in Production RLcited by 111
  3. 2025LLM Social Simulations Are a Promising Research Methodcited by 97
  4. 2024Complementarity in Human-AI Collaboration: Concept, Sources, and Evidencecited by 35
  5. 2025Emergence of polarization in networks of large language model agentscited by 25
  6. 2025Frontier AI's Impact on the Cybersecurity Landscapecited by 21
  7. 2024Eliciting the Priors of Large Language Models using Iterated In-Context Learningcited by 19
  8. 2025The Levers of Political Persuasion with Conversational AIcited by 19
  9. 2025An Economy of AI Agentscited by 17
  10. 2024Perceptions of Sentient AI and Other Digital Minds: Evidence from the AI, Morality, and Sentience (AIMS) Surveycited by 15
  11. 2024Catastrophic Cyber Capabilities Benchmark (3CB): Robustly Evaluating LLM Agent Cyber Offense Capabilitiescited by 12
  12. 2024Boundless Socratic Learning with Language Gamescited by 12
36 more
  1. 2024Evidence of a log scaling law for political persuasion with large language modelscited by 11
  2. 2024Evaluating AI Evaluation: Perils and Prospectscited by 11
  3. 2025HumanAgencyBench: Scalable Evaluation of Human Agency Support in AI Assistantscited by 10
  4. 2026Sanity Checks for Sparse Autoencoders: Do SAEs Beat Random Baselines?cited by 10
  5. 2024Dissociating Artificial Intelligence from Artificial Consciousnesscited by 7
  6. 2025Position: Scaling LLM Agents Requires Asymptotic Analysis with LLM Primitivescited by 7
  7. 2025AI Testing Should Account for Sophisticated Strategic Behaviourcited by 6
  8. 2025Misalignment or misuse? The AGI alignment tradeoffcited by 4
  9. 2024Misrepresented Technological Solutions in Imagined Futures: The Origins and Dangers of AI Hype in the Research Communitycited by 3
  10. 2024Strategic Insights from Simulation Gaming of AI Race Dynamicscited by 3
  11. 2025Mental Models of Autonomy and Sentience Shape Reactions to AIcited by 3
  12. 2024Diffusion Boosted Treescited by 2
  13. 2024Liability and Insurance for Catastrophic Losses: the Nuclear Power Precedent and Lessons for AIcited by 2
  14. 2025Why do Experts Disagree on Existential Risk and P(doom)? A Survey of AI Expertscited by 2
  15. 2025The Economics of p(doom): Scenarios of Existential Risk and Economic Growth in the Age of Transformative AIcited by 2
  16. 2025The Hall of AI Fears and Hopes: Comparing the Views of AI Influencers and those of Members of the U.S. Public Through an Interactive Platformcited by 2
  17. 2025Against racing to AGI: Cooperation, deterrence, and catastrophic riskscited by 2
  18. 2025Reproducibility: The New Frontier in AI Governancecited by 2
  19. 2024Harvard Undergraduate Survey on Generative AIcited by 1
  20. 2024Insuring Uninsurable Risks from AI: Government as Insurer of Last Resortcited by 1
  21. 2024AI Horizon Scanning, White Paper p3395, IEEE-SA. Part I: Areas of Attentioncited by 1
  22. 2026Are we Doomed to an AI Race? Why Self-Interest Could Drive Countries Towards a Moratorium on Superintelligencecited by 1
  23. 2024On Formally Undecidable Traits of Intelligent Machinescited by 0
  24. 2024Cooperative Evolutionary Pressure and Diminishing Returns Might Explain the Fermi Paradox: On What Super-AIs Are Likecited by 0
  25. 2024Interpreting Affine Recurrence Learning in GPT-style Transformerscited by 0
  26. 2024Perception Gaps in Risk, Benefit, and Value Between Experts and Public Challenge Socially Accepted AIcited by 0
  27. 2025Integration of TinyML and LargeML: A Survey of 6G and Beyondcited by 0
  28. 2026Abundant Intelligence and Deficient Demand: A Macro-Financial Stress Test of Rapid AI Adoptioncited by 0
  29. 2026The Possibility of Artificial Intelligence Becoming a Subject and the Alignment Problemcited by 0
  30. 2026Fundamental Physics, Existential Risks and Human Futurescited by 0
  31. 2026Definitional alignment before capability alignment: a Design-Science framework for adjudicating claims about AGIcited by 0
  32. 2026International Agreements to Limit Frontier AI: Objectives and Exitcited by 0
  33. 2026Hardware Mechanisms to Dynamically Throttle AI Performancecited by 0
  34. 2026Frontier AI Forecasting Has a Measurement Problem: An Audit of Progress Evidencecited by 0
  35. 2026Recursive Criticality of AI Self-Improvementcited by 0
  36. 2026GPS-Bench: A Governance Policy Benchmark for Automating Policy Analysiscited by 0