Towards Fast Coarse-graining and Equation Discovery with Foundation Inference Models
Not on the map. Why?
Abstract (arXiv)
High-dimensional recordings of dynamical processes are often characterized by a much smaller set of effective variables, evolving on low-dimensional manifolds. Identifying these latent dynamics requires solving two intertwined problems: discovering appropriate coarse-grained variables and simultaneously fitting the governing equations. Most machine learning approaches tackle these tasks jointly by training autoencoders together with models that enforce dynamical consistency. We propose to decouple the two problems by leveraging the recently introduced Foundation Inference Models (FIMs). FIMs are pretrained models that estimate the infinitesimal generators of dynamical systems (e.g., the drift and diffusion of a stochastic differential equation) in zero-shot mode. By amortizing the inference of the dynamics through a FIM with frozen weights, and training only the encoder-decoder map, we define a simple, simulation-consistent loss that stabilizes representation learning. A proof of concept on a stochastic double-well system with semicircle diffusion, embedded into synthetic video data, illustrates the potential of this approach for fast and reusable coarse-graining pipelines.
Key facts. Cited by 1 paper in the map (data through 13 Oct 2026). Builds on 13 of its 19 references that are in the map. First posted on arXiv 14 Oct 2025.
Builds on
13 of 19 references.
References · 13
- 2019The frontier of simulation-based inferencecited by 492
- 2020Scalable Gradients for Stochastic Differential Equationscited by 269
- 2021Efficient and Accurate Gradients for Neural SDEscited by 69
- 2023ODEFormer: Symbolic Regression of Dynamical Systems with Transformerscited by 60
- 2019Learning interpretable continuous-time models of latent stochastic dynamical systemscited by 30
- 2024Foundation Inference Models for Markov Jump Processescited by 13
- 2017Approximate Bayes learning of stochastic differential equationscited by 11
- 2023Neural Markov Jump Processescited by 11
- 2023Variational Gaussian Process Diffusion Processescited by 11
- 2022The future is different: Large pre-trained language models fail in prediction taskscited by 8
- 2023Neural Dynamic Focused Topic Modelcited by 8
- 2025In-Context Learning of Stochastic Differential Equations with Foundation Inference Modelscited by 7
1 more
Built on by
Citing papers per year: 2026: 1.
1 paper.