LifeSentence: Language models can encode human life course trajectories from longitudinal panel data
Not on the map. Why?
Abstract (arXiv)
Forecasting human life outcomes is important to gain insights into how individuals attain long and healthy lives. Conventional statistical approaches yield limited accuracy, potentially due to discarding the sequential structure of the life course. Modern methods such as transformer architectures require large scale training data that most longitudinal panel studies lack. Here we introduce LifeSentence, a model for life-course reasoning that bridges large language models with longitudinal panel data. By representing each life event as a structured natural-language record and instruction-tuning a pretrained 24-billion-parameter language model across an 18-task evaluation taxonomy spanning prediction, robustness and reasoning, LifeSentence supplements panel data with distributional knowledge already encoded during pretraining. Trained on approximately 65,000 individuals from the German Socio-Economic Panel - roughly 45 times fewer than prior transformer-based approaches - LifeSentence outperforms classical and deep learning baselines across all task families, achieving a threefold improvement in joint event-and-timing prediction from best baselines and 91.2% Kendall's tau when reconstructing chronological order from timestamp-stripped event sets. Without explicit supervision, the model recovers documented patterns of social stratification, including the education premium, the gender wage gap and the motherhood penalty, from discrete event sequences alone. A natural-language interface further enables qualitatively new research queries, such as connecting an early-life history to a specified late-life endpoint, establishing LifeSentence as both a predictive tool and a probe for counterfactual exploration of human biographies.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 30 of its 94 references that are in the map. First posted on arXiv 14 May 2026.
Builds on
30 of 94 references.
References · 30
- 2017Attention Is All You Needcited by 60,361
- 2015Distilling the Knowledge in a Neural Networkcited by 10,324
- 2016XGBoost: A Scalable Tree Boosting Systemcited by 5,166
- 2017On Calibration of Modern Neural Networkscited by 4,960
- 2014Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translationcited by 4,057
- 2021Finetuned Language Models Are Zero-Shot Learnerscited by 3,780
- 2023QLoRA: Efficient Finetuning of Quantized LLMscited by 3,418
- 2013Visualizing and Understanding Convolutional Networkscited by 2,290
- 2019Language Models as Knowledge Bases?cited by 1,936
- 2016Man is to Computer Programmer as Woman is to Homemaker? Debiasing Word Embeddingscited by 1,312
- 2020Making Pre-trained Language Models Better Few-shot Learnerscited by 1,256
- 2016Semantics derived automatically from language corpora contain human-like biasescited by 901
18 more
- 2019Right for the Wrong Reasons: Diagnosing Syntactic Heuristics in Natural Language Inferencecited by 876
- 2023Semantic Uncertainty: Linguistic Invariances for Uncertainty Estimation in Natural Language Generationcited by 819
- 2020How Much Knowledge Can You Pack Into the Parameters of a Language Model?cited by 719
- 2020Intrinsic Dimensionality Explains the Effectiveness of Language Model Fine-Tuningcited by 671
- 2018Gender Bias in Coreference Resolution: Evaluation and Debiasing Methodscited by 659
- 2019Conformalized Quantile Regressioncited by 629
- 2017Don't Decay the Learning Rate, Increase the Batch Sizecited by 320
- 2023Language Models Represent Space and Timecited by 316
- 2022TabLLM: Few-shot Classification of Tabular Data with Large Language Modelscited by 277
- 2019Probing Neural Network Comprehension of Natural Language Argumentscited by 214
- 2019oLMpics -- On what Language Model Pre-training Capturescited by 161
- 2021ExT5: Towards Extreme Multi-Task Scaling for Transfer Learningcited by 161
- 2022LIFT: Language-Interfaced Fine-Tuning for Non-Language Machine Learning Taskscited by 148
- 2020Perturbed Masking: Parameter-free Probing for Analyzing and Interpreting BERTcited by 109
- 2024Zero Shot Health Trajectory Prediction Using Transformercited by 77
- 2019On the adequacy of untuned warmup for adaptive optimizationcited by 35
- 2023Using Sequences of Life-events to Predict Human Livescited by 27
- 2022CAREER: A Foundation Model for Labor Sequence Datacited by 11
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026LifeLong Digital Twin: A Unified Modeling Paradigm and Agent Harness for Event-Driven Lifelong Health State Trajectories
- 2026HEARTS: Benchmarking LLM Reasoning on Health Time Series
- 2026TimeSRL: Generalizable Time-Series Behavioral Modeling via Semantic RL-Tuned LLMs -- A Case Study in Mental Health
- 2026ESL-Bench: An Event-Driven Synthetic Longitudinal Benchmark for Health Agents
- 2026LifeAgentBench: Benchmarking LLMs for Long-Horizon, Cross-Dimensional Lifestyle Health Reasoning
- 2026ChronoMedicalWorld: A Medical World Model for Learning Patient Trajectories from Longitudinal Care Data
- 2026The Verbose Context Problem in Medical Records
- 2025LIFEBench: Evaluating Length Instruction Following in Large Language Models