Asking Better Questions -- The Art and Science of Forecasting: A mechanism for truer answers to high-stakes questions
Not on the map. Why?
Abstract (arXiv)
Without the ability to estimate and benchmark AI capability advancements, organizations are left to respond to each change reactively, impeding their ability to build viable mid and long-term strategies. This paper explores the recent growth of forecasting, a political science tool that uses explicit assumptions and quantitative estimation that leads to improved prediction accuracy. Done at the collective level, forecasting can identify and verify talent, enable leaders to build better models of AI advancements and improve inputs into design policy. Successful approaches to forecasting and case studies are examined, revealing a subclass of "superforecasters" who outperform 98% of the population and whose insights will be most reliable. Finally, techniques behind successful forecasting are outlined, including Phillip Tetlock's "Ten Commandments." To adapt to a quickly changing technology landscape, designers and policymakers should consider forecasting as a first line of defense.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 1 of its 14 references that are in the map. First posted on arXiv 31 Mar 2023.
Builds on
1 of 14 references.
References · 1
- 2022Emergent Abilities of Large Language Modelscited by 2,512
Built on by
Citing papers per year: 2023: 1; 2024: 1.
2 papers.