Learning Transferable Predictability Representations
Not on the map. Why?
Abstract (arXiv)
We study the problem of assigning a scalar score to a short trajectory window that reflects its position on an ordered continuum of predictability regimes, spanning structured deterministic dynamics to unstructured stochastic noise. Existing methods address deterministic-versus-stochastic discrimination within a single system and do not produce scores with a consistent numerical interpretation across systems. We formalize this as ordinal estimation over a five-level predictability ladder and identify a structural source of cross-system ambiguity: ranking supervision alone leaves the score coordinate unfixed up to a monotone reparameterization, which we term the gauge freedom of ordinal scoring. We propose the Gauge-Fixed Ordinal Network (GON), a temporal convolutional model trained with an anchor-and-variance objective that pins level-wise score means to shared target coordinates. GON operates on 2-jet features that expose local trajectory geometry, preserved by smooth flows and disrupted by stochastic surrogate procedures. On five held-out dynamical systems, initializing from a pretrained GON checkpoint consistently outperforms training from scratch across all window budgets, with adaptation depth reflecting geometric proximity to the training family. Zero-shot scores retain ordinal structure at the stochastic boundary, where surrogate procedures most strongly disrupt nonlinear geometry, and pretrained initialization consistently beats scratch across all window budgets. Pairwise discrimination and globally coherent ordinal scoring are distinct properties requiring a stable score coordinate for cross-system transfer, with direct implications for predictability assessment, model selection, and early-warning diagnostics across natural and engineered dynamical systems.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 10 of its 45 references that are in the map. First posted on arXiv 28 May 2026.
Builds on
10 of 45 references.
References · 10
- 2017Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networkscited by 4,861
- 2018Neural Ordinary Differential Equationscited by 3,733
- 2020Fourier Neural Operator for Parametric Partial Differential Equationscited by 2,806
- 2019DeepONet: Learning nonlinear operators for identifying differential equations based on the universal approximation theorem of operatorscited by 1,965
- 2020Lagrangian Neural Networkscited by 388
- 2020Proxy Anchor Loss for Deep Metric Learningcited by 195
- 2019Rank consistent ordinal regression for neural networks with application to age estimationcited by 132
- 2022Rank-N-Contrast: Learning Continuous Representations for Regressioncited by 74
- 2022Generalizing to New Physical Systems via Context-Informed Dynamics Modelcited by 49
- 2025Panda: A pretrained forecast model for chaotic dynamicscited by 12
Built on by
Not cited yet.