SAGA: A Sequence-Adaptive Generative Architecture for Multi-Horizon Probabilistic Forecasting with Adaptive Temporal Conformal Prediction
Not on the map. Why?
Abstract (arXiv)
Microsimulation models used by ministries of finance and central banks rely on parametric processes for lifetime earnings that capture only first and second moments of the conditional distribution and miss long-range nonlinear structure. We propose SAGA, a decoder-only transformer for irregular tabular panel sequences, paired with a split conformal calibration wrapper that delivers individual-level prediction intervals with finite-sample marginal coverage guarantees. Trained on the longitudinal Swedish LISA register over 1990 to 2022, comprising 2,143,817 individuals and 61,284,903 person-years, the model forecasts annual labor earnings at horizons of one to thirty years and aggregates them by Monte Carlo into present-discounted lifetime earnings distributions. Against the canonical Guvenen, Karahan, Ozkan, and Song parametric process and tabular and recurrent baselines, SAGA reduces continuous ranked probability score by 31.9 percent at the ten-year horizon and mean absolute error by 37.7 percent at the twenty-year horizon. Conformal intervals achieve nominal coverage to within 0.4 percentage points marginally and within 2.4 percentage points on the worst-case demographic subgroup. The reconstructed lifetime earnings Gini coefficient is 0.327 against the partially observed truth of 0.341 and the GKOS estimate of 0.378. Model weights, calibration tables, and a synthetic equivalent dataset are released for replication outside the protected SCB MONA environment.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 17 of its 48 references that are in the map. First posted on arXiv 18 May 2026.
Builds on
17 of 48 references.
References · 17
- 2017Attention Is All You Needcited by 59,932
- 2016Gaussian Error Linear Units (GELUs)cited by 3,431
- 2017Axiomatic Attribution for Deep Networkscited by 3,350
- 2016Membership Inference Attacks against Machine Learning Modelscited by 2,221
- 2020Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecastingcited by 2,141
- 2022A Time Series is Worth 64 Words: Long-term Forecasting with Transformerscited by 1,981
- 2021Autoformer: Decomposition Transformers with Auto-Correlation for Long-Term Series Forecastingcited by 1,654
- 2016Deep Networks with Stochastic Depthcited by 973
- 2020On Layer Normalization in the Transformer Architecturecited by 906
- 2021Revisiting Deep Learning Models for Tabular Datacited by 725
- 2016Distribution-Free Predictive Inference For Regressioncited by 657
- 2019Conformalized Quantile Regressioncited by 620
5 more
- 2022Transformers in Time Series: A Surveycited by 489
- 2020TabTransformer: Tabular Data Modeling Using Contextual Embeddingscited by 398
- 2021SAINT: Improved Neural Networks for Tabular Data via Row Attention and Contrastive Pre-Trainingcited by 310
- 2022On Embeddings for Numerical Features in Tabular Deep Learningcited by 185
- 2023Using Sequences of Life-events to Predict Human Livescited by 27
Built on by
Not cited yet.