Predictability limit of partially observed systems
Not on the map. Why?
Abstract (arXiv)
Applications from finance to epidemiology and cyber-security require accurate forecasts of dynamic phenomena, which are often only partially observed. We demonstrate that a system's predictability degrades as a function of temporal sampling, regardless of the adopted forecasting model. We quantify the loss of predictability due to sampling, and show that it cannot be recovered by using external signals. We validate the generality of our theoretical findings in real-world partially observed systems representing infectious disease outbreaks, online discussions, and software development projects. On a variety of prediction tasks---forecasting new infections, the popularity of topics in online discussions, or interest in cryptocurrency projects---predictability irrecoverably decays as a function of sampling, unveiling fundamental predictability limits in partially observed systems.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). First posted on arXiv 17 Jan 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 1; 2022: 0; 2023: 0; 2024: 1; 2025: 0; 2026: 1.
3 papers.
- 2021Identifying Causal Influences on Publication Trends and Behavior: A Case Study of the Computational Linguistics Communitycited by 1
- 2024Measuring the Predictability of Recommender Systems using Structural Complexity Metricscited by 0
- 2026Why Linear Models Can Still Work in a Complex and Changing Worldcited by 0
- 2026Why Linear Models Can Still Work in a Complex and Changing World9 Oct 2026
- 2024Measuring the Predictability of Recommender Systems using Structural Complexity Metrics12 Apr 2024
- 2021Identifying Causal Influences on Publication Trends and Behavior: A Case Study of the Computational Linguistics Community15 Oct 2021