Thousands of AI Authors on the Future of AI
Not on the map. Why?
Abstract (arXiv)
In the largest survey of its kind, 2,778 researchers who had published in top-tier artificial intelligence (AI) venues gave predictions on the pace of AI progress and the nature and impacts of advanced AI systems The aggregate forecasts give at least a 50% chance of AI systems achieving several milestones by 2028, including autonomously constructing a payment processing site from scratch, creating a song indistinguishable from a new song by a popular musician, and autonomously downloading and fine-tuning a large language model. If science continues undisrupted, the chance of unaided machines outperforming humans in every possible task was estimated at 10% by 2027, and 50% by 2047. The latter estimate is 13 years earlier than that reached in a similar survey we conducted only one year earlier [Grace et al., 2022]. However, the chance of all human occupations becoming fully automatable was forecast to reach 10% by 2037, and 50% as late as 2116 (compared to 2164 in the 2022 survey). Most respondents expressed substantial uncertainty about the long-term value of AI progress: While 68.3% thought good outcomes from superhuman AI are more likely than bad, of these net optimists 48% gave at least a 5% chance of extremely bad outcomes such as human extinction, and 59% of net pessimists gave 5% or more to extremely good outcomes. Between 38% and 51% of respondents gave at least a 10% chance to advanced AI leading to outcomes as bad as human extinction. More than half suggested that "substantial" or "extreme" concern is warranted about six different AI-related scenarios, including misinformation, authoritarian control, and inequality. There was disagreement about whether faster or slower AI progress would be better for the future of humanity. However, there was broad agreement that research aimed at minimizing potential risks from AI systems ought to be prioritized more.
Key facts. Cited by 48 papers in the map (data through 7 Oct 2026). Builds on 4 of its 46 references that are in the map. First posted on arXiv 5 Jan 2024.
Builds on
4 of 46 references.
References · 4
- 2023AI Deception: A Survey of Examples, Risks, and Potential Solutionscited by 185
- 2022Is Power-Seeking AI an Existential Risk?cited by 101
- 2017When Will AI Exceed Human Performance? Evidence from AI Expertscited by 41
- 2022Forecasting AI Progress: Evidence from a Survey of Machine Learning Researcherscited by 7
Built on by
Citing papers per year: 2024: 20; 2025: 17; 2026: 11.
48 papers.
Sort:
By area:
- 2024Alignment faking in large language modelscited by 316
- 2025Natural Emergent Misalignment from Reward Hacking in Production RLcited by 111
- 2025LLM Social Simulations Are a Promising Research Methodcited by 97
- 2024Complementarity in Human-AI Collaboration: Concept, Sources, and Evidencecited by 35
- 2025Emergence of polarization in networks of large language model agentscited by 25
- 2025Frontier AI's Impact on the Cybersecurity Landscapecited by 21
- 2024Eliciting the Priors of Large Language Models using Iterated In-Context Learningcited by 19
- 2025The Levers of Political Persuasion with Conversational AIcited by 19
- 2025An Economy of AI Agentscited by 17
- 2024Perceptions of Sentient AI and Other Digital Minds: Evidence from the AI, Morality, and Sentience (AIMS) Surveycited by 15
- 2024Catastrophic Cyber Capabilities Benchmark (3CB): Robustly Evaluating LLM Agent Cyber Offense Capabilitiescited by 12
- 2024Boundless Socratic Learning with Language Gamescited by 12
36 more
- 2024Evidence of a log scaling law for political persuasion with large language modelscited by 11
- 2024Evaluating AI Evaluation: Perils and Prospectscited by 11
- 2025HumanAgencyBench: Scalable Evaluation of Human Agency Support in AI Assistantscited by 10
- 2026Sanity Checks for Sparse Autoencoders: Do SAEs Beat Random Baselines?cited by 10
- 2024Dissociating Artificial Intelligence from Artificial Consciousnesscited by 7
- 2025Position: Scaling LLM Agents Requires Asymptotic Analysis with LLM Primitivescited by 7
- 2025AI Testing Should Account for Sophisticated Strategic Behaviourcited by 6
- 2025Misalignment or misuse? The AGI alignment tradeoffcited by 4
- 2024Misrepresented Technological Solutions in Imagined Futures: The Origins and Dangers of AI Hype in the Research Communitycited by 3
- 2024Strategic Insights from Simulation Gaming of AI Race Dynamicscited by 3
- 2025Mental Models of Autonomy and Sentience Shape Reactions to AIcited by 3
- 2024Diffusion Boosted Treescited by 2
- 2024Liability and Insurance for Catastrophic Losses: the Nuclear Power Precedent and Lessons for AIcited by 2
- 2025Why do Experts Disagree on Existential Risk and P(doom)? A Survey of AI Expertscited by 2
- 2025The Economics of p(doom): Scenarios of Existential Risk and Economic Growth in the Age of Transformative AIcited by 2
- 2025The Hall of AI Fears and Hopes: Comparing the Views of AI Influencers and those of Members of the U.S. Public Through an Interactive Platformcited by 2
- 2025Against racing to AGI: Cooperation, deterrence, and catastrophic riskscited by 2
- 2025Reproducibility: The New Frontier in AI Governancecited by 2
- 2024Harvard Undergraduate Survey on Generative AIcited by 1
- 2024Insuring Uninsurable Risks from AI: Government as Insurer of Last Resortcited by 1
- 2024AI Horizon Scanning, White Paper p3395, IEEE-SA. Part I: Areas of Attentioncited by 1
- 2026Are we Doomed to an AI Race? Why Self-Interest Could Drive Countries Towards a Moratorium on Superintelligencecited by 1
- 2024On Formally Undecidable Traits of Intelligent Machinescited by 0
- 2024Cooperative Evolutionary Pressure and Diminishing Returns Might Explain the Fermi Paradox: On What Super-AIs Are Likecited by 0
- 2024Interpreting Affine Recurrence Learning in GPT-style Transformerscited by 0
- 2024Perception Gaps in Risk, Benefit, and Value Between Experts and Public Challenge Socially Accepted AIcited by 0
- 2025Integration of TinyML and LargeML: A Survey of 6G and Beyondcited by 0
- 2026Abundant Intelligence and Deficient Demand: A Macro-Financial Stress Test of Rapid AI Adoptioncited by 0
- 2026The Possibility of Artificial Intelligence Becoming a Subject and the Alignment Problemcited by 0
- 2026Fundamental Physics, Existential Risks and Human Futurescited by 0
- 2026Definitional alignment before capability alignment: a Design-Science framework for adjudicating claims about AGIcited by 0
- 2026International Agreements to Limit Frontier AI: Objectives and Exitcited by 0
- 2026Hardware Mechanisms to Dynamically Throttle AI Performancecited by 0
- 2026Frontier AI Forecasting Has a Measurement Problem: An Audit of Progress Evidencecited by 0
- 2026Recursive Criticality of AI Self-Improvementcited by 0
- 2026GPS-Bench: A Governance Policy Benchmark for Automating Policy Analysiscited by 0
- 2026GPS-Bench: A Governance Policy Benchmark for Automating Policy Analysis3 Sep 2026
- 2026Recursive Criticality of AI Self-Improvement31 Aug 2026
- 2026Frontier AI Forecasting Has a Measurement Problem: An Audit of Progress Evidence14 Aug 2026
- 2026Hardware Mechanisms to Dynamically Throttle AI Performance20 Jul 2026
- 2026International Agreements to Limit Frontier AI: Objectives and Exit19 Jun 2026
- 2026Definitional alignment before capability alignment: a Design-Science framework for adjudicating claims about AGI10 Jun 2026
- 2026Are we Doomed to an AI Race? Why Self-Interest Could Drive Countries Towards a Moratorium on Superintelligence2 May 2026
- 2026Fundamental Physics, Existential Risks and Human Futures29 Apr 2026
- 2026The Possibility of Artificial Intelligence Becoming a Subject and the Alignment Problem16 Apr 2026
- 2026Abundant Intelligence and Deficient Demand: A Macro-Financial Stress Test of Rapid AI Adoption10 Mar 2026
- 2026Sanity Checks for Sparse Autoencoders: Do SAEs Beat Random Baselines?15 Feb 2026
- 2025Mental Models of Autonomy and Sentience Shape Reactions to AI9 Dec 2025
36 more
- 2025Natural Emergent Misalignment from Reward Hacking in Production RL23 Nov 2025
- 2025Reproducibility: The New Frontier in AI Governance13 Oct 2025
- 2025HumanAgencyBench: Scalable Evaluation of Human Agency Support in AI Assistants10 Sep 2025
- 2025An Economy of AI Agents1 Sep 2025
- 2025AI Testing Should Account for Sophisticated Strategic Behaviour19 Aug 2025
- 2025Against racing to AGI: Cooperation, deterrence, and catastrophic risks29 Jul 2025
- 2025The Levers of Political Persuasion with Conversational AI18 Jul 2025
- 2025Misalignment or misuse? The AGI alignment tradeoff4 Jun 2025
- 2025Integration of TinyML and LargeML: A Survey of 6G and Beyond20 May 2025
- 2025The Hall of AI Fears and Hopes: Comparing the Views of AI Influencers and those of Members of the U.S. Public Through an Interactive Platform8 Apr 2025
- 2025Frontier AI's Impact on the Cybersecurity Landscape7 Apr 2025
- 2025LLM Social Simulations Are a Promising Research Method3 Apr 2025
- 2025The Economics of p(doom): Scenarios of Existential Risk and Economic Growth in the Age of Transformative AI10 Mar 2025
- 2025Position: Scaling LLM Agents Requires Asymptotic Analysis with LLM Primitives4 Feb 2025
- 2025Why do Experts Disagree on Existential Risk and P(doom)? A Survey of AI Experts25 Jan 2025
- 2025Emergence of polarization in networks of large language model agents9 Jan 2025
- 2024Alignment faking in large language models18 Dec 2024
- 2024Dissociating Artificial Intelligence from Artificial Consciousness5 Dec 2024
- 2024Perception Gaps in Risk, Benefit, and Value Between Experts and Public Challenge Socially Accepted AI2 Dec 2024
- 2024Boundless Socratic Learning with Language Games25 Nov 2024
- 2024Interpreting Affine Recurrence Learning in GPT-style Transformers22 Oct 2024
- 2024Catastrophic Cyber Capabilities Benchmark (3CB): Robustly Evaluating LLM Agent Cyber Offense Capabilities10 Oct 2024
- 2024Strategic Insights from Simulation Gaming of AI Race Dynamics4 Oct 2024
- 2024AI Horizon Scanning, White Paper p3395, IEEE-SA. Part I: Areas of Attention13 Sep 2024
- 2024Liability and Insurance for Catastrophic Losses: the Nuclear Power Precedent and Lessons for AI10 Sep 2024
- 2024Insuring Uninsurable Risks from AI: Government as Insurer of Last Resort10 Sep 2024
- 2024Misrepresented Technological Solutions in Imagined Futures: The Origins and Dangers of AI Hype in the Research Community8 Aug 2024
- 2024Evaluating AI Evaluation: Perils and Prospects12 Jul 2024
- 2024Perceptions of Sentient AI and Other Digital Minds: Evidence from the AI, Morality, and Sentience (AIMS) Survey11 Jul 2024
- 2024Evidence of a log scaling law for political persuasion with large language models20 Jun 2024
- 2024Eliciting the Priors of Large Language Models using Iterated In-Context Learning4 Jun 2024
- 2024Diffusion Boosted Trees3 Jun 2024
- 2024Harvard Undergraduate Survey on Generative AI2 Jun 2024
- 2024Cooperative Evolutionary Pressure and Diminishing Returns Might Explain the Fermi Paradox: On What Super-AIs Are Like1 Apr 2024
- 2024Complementarity in Human-AI Collaboration: Concept, Sources, and Evidence21 Mar 2024
- 2024On Formally Undecidable Traits of Intelligent Machines14 Feb 2024
- 2024Alignment faking in large language modelscited by 316
- 2025Natural Emergent Misalignment from Reward Hacking in Production RLcited by 111
- 2025Natural Emergent Misalignment from Reward Hacking in Production RL23 Nov 2025
- 2024Alignment faking in large language models18 Dec 2024
- 2024Diffusion Boosted Treescited by 2
- 2024Diffusion Boosted Trees3 Jun 2024
- 2025LLM Social Simulations Are a Promising Research Methodcited by 97
- 2024Complementarity in Human-AI Collaboration: Concept, Sources, and Evidencecited by 35
- 2025Frontier AI's Impact on the Cybersecurity Landscapecited by 21
- 2024Eliciting the Priors of Large Language Models using Iterated In-Context Learningcited by 19
- 2025The Levers of Political Persuasion with Conversational AIcited by 19
- 2025An Economy of AI Agentscited by 17
- 2024Perceptions of Sentient AI and Other Digital Minds: Evidence from the AI, Morality, and Sentience (AIMS) Surveycited by 15
- 2024Boundless Socratic Learning with Language Gamescited by 12
- 2024Evidence of a log scaling law for political persuasion with large language modelscited by 11
- 2024Evaluating AI Evaluation: Perils and Prospectscited by 11
- 2025HumanAgencyBench: Scalable Evaluation of Human Agency Support in AI Assistantscited by 10
- 2026Sanity Checks for Sparse Autoencoders: Do SAEs Beat Random Baselines?cited by 10
12 most cited of 42 All 42 (JSON)
- 2026GPS-Bench: A Governance Policy Benchmark for Automating Policy Analysis3 Sep 2026
- 2026Recursive Criticality of AI Self-Improvement31 Aug 2026
- 2026Frontier AI Forecasting Has a Measurement Problem: An Audit of Progress Evidence14 Aug 2026
- 2026Hardware Mechanisms to Dynamically Throttle AI Performance20 Jul 2026
- 2026International Agreements to Limit Frontier AI: Objectives and Exit19 Jun 2026
- 2026Definitional alignment before capability alignment: a Design-Science framework for adjudicating claims about AGI10 Jun 2026
- 2026Are we Doomed to an AI Race? Why Self-Interest Could Drive Countries Towards a Moratorium on Superintelligence2 May 2026
- 2026Fundamental Physics, Existential Risks and Human Futures29 Apr 2026
- 2026The Possibility of Artificial Intelligence Becoming a Subject and the Alignment Problem16 Apr 2026
- 2026Abundant Intelligence and Deficient Demand: A Macro-Financial Stress Test of Rapid AI Adoption10 Mar 2026
- 2026Sanity Checks for Sparse Autoencoders: Do SAEs Beat Random Baselines?15 Feb 2026
- 2025Mental Models of Autonomy and Sentience Shape Reactions to AI9 Dec 2025
12 newest of 42 All 42 (JSON)