Information bottleneck for learning the phase space of dynamics from high-dimensional experimental data
Not on the map. Why?
Abstract (arXiv)
Identifying the dynamical state variables of a system from high-dimensional observations is a central problem across physical sciences. The challenge is that the state variables are not directly observable and must be inferred from raw high-dimensional data without supervision. Here we introduce DySIB (Dynamical Symmetric Information Bottleneck) as a method to learn low-dimensional representations of time-series data by maximizing predictive mutual information between past and future observation windows while penalizing representation complexity. This objective operates entirely in latent space and avoids reconstruction of the observations. We apply DySIB to an experimental video dataset of a physical pendulum, where the underlying state space is known. The method, with hyperparameters of the learning architecture set self-consistently by the data, recovers a two-dimensional representation that matches the dimensionality, topology, and geometry of the pendulum phase space, with the learned coordinates aligning smoothly with the canonical angle and angular velocity. These results demonstrate, on a well-characterized experimental system, that predictive information in latent space can be used to recover interpretable dynamical coordinates directly from high-dimensional data.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 27 of its 81 references that are in the map. First posted on arXiv 27 Apr 2026.
Builds on
27 of 81 references.
References · 27
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2018Representation Learning with Contrastive Predictive Codingcited by 7,777
- 2018Neural Ordinary Differential Equationscited by 3,779
- 2023Self-Supervised Learning from Images with a Joint-Embedding Predictive Architecturecited by 1,039
- 2016Deep Variational Information Bottleneckcited by 930
- 2019On Variational Bounds of Mutual Informationcited by 559
- 2017Deep learning for universal linear embeddings of nonlinear dynamicscited by 494
- 2026LeWorldModel: Stable End-to-End Joint-Embedding Predictive Architecture from Pixelscited by 273
- 2025LeJEPA: Provable and Scalable Self-Supervised Learning Without the Heuristicscited by 254
- 2018Estimating the intrinsic dimension of datasets by a minimal neighborhood informationcited by 250
- 2020Multiscale Simulations of Complex Systems by Learning their Effective Dynamicscited by 86
15 more
- 2019Deep learning to discover and predict dynamics on an inertial manifoldcited by 43
- 2025Joint Embedding vs Reconstruction: Provable Benefits of Latent Space Prediction for Self Supervised Learningcited by 36
- 2013Multivariate Information Bottleneckcited by 17
- 2019Neural Canonical Transformation with Symplectic Flowscited by 16
- 2025Panda: A pretrained forecast model for chaotic dynamicscited by 13
- 2023Deep Variational Multivariate Information Bottleneck -- A Framework for Variational Lossescited by 6
- 2023Simultaneous Dimensionality Reduction: A Data Efficient Approach for Multimodal Representations Learningcited by 6
- 2025Stacked SVD or SVD stacked? A Random Matrix Theory perspective on data integrationcited by 6
- 2023Data efficiency, dimensionality reduction, and the generalized symmetric information bottleneckcited by 5
- 2025Spectral Thresholds in Correlated Spiked Models and Fundamental Limits of Partial Least Squarescited by 5
- 2018Automated, predictive, and interpretable inference of C. elegans escape dynamicscited by 4
- 2023Information theory for dimensionality reduction in dynamical systemscited by 4
- 2023Physics-tailored machine learning reveals unexpected physics in dusty plasmascited by 2
- 2025Accurate Estimation of Mutual Information in High Dimensional Datacited by 2
- 2026Mutual information and task-relevant latent dimensionalitycited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.