mlsanityData to 7 Oct 2026

Efficient Inference for Coupled Hidden Markov Models in Continuous Time and Discrete Space

arXiv 2510.12916 ↗First posted 14 Oct 2025stat.ML cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Systems of interacting continuous-time Markov chains are a powerful model class, but inference is typically intractable in high dimensional settings. Auxiliary information, such as noisy observations, is typically only available at discrete times, and incorporating it via a Doob's h-transform gives rise to an intractable posterior process that requires approximation. We introduce Latent Interacting Particle Systems, a model class parameterizing the generator of each Markov chain in the system. Our inference method involves estimating look-ahead functions (twist potentials) that anticipate future information, for which we introduce an efficient parameterization. We incorporate this approximation in a twisted Sequential Monte Carlo sampling scheme. We demonstrate the effectiveness of our approach on a challenging posterior inference task for a latent SIRS model on a graph, and on a neural model for wildfire spread dynamics trained on real data.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 42 of its 109 references that are in the map. First posted on arXiv 14 Oct 2025.

Builds on

42 of 109 references.

References · 42

  1. 2022Scalable Diffusion Models with Transformerscited by 5,931
  2. 2018Neural Ordinary Differential Equationscited by 3,733
  3. 2016Categorical Reparameterization with Gumbel-Softmaxcited by 2,708
  4. 2017FiLM: Visual Reasoning with a General Conditioning Layercited by 2,286
  5. 2017Deep Setscited by 1,394
  6. 2022DiGress: Discrete Denoising diffusion for graph generationcited by 503
  7. 2022A Continuous Time Framework for Discrete Denoising Modelscited by 437
  8. 2024Discrete Flow Matchingcited by 301
  9. 2024Generative Flows on Discrete State-Spaces: Enabling Multimodal Flows with Applications to Protein Co-Designcited by 294
  10. 2020Scalable Gradients for Stochastic Differential Equationscited by 264
  11. 2019Neural Stochastic Differential Equations: Deep Latent Gaussian Models in the Diffusion Limitcited by 168
  12. 2022Score-based Continuous-time Discrete Diffusion Modelscited by 167
30 more
  1. 2022Concrete Score Matching: Generalized Score Matching for Discrete Datacited by 144
  2. 2021Panoptic Segmentation of Satellite Image Time Series with Convolutional Temporal Attention Networkscited by 141
  3. 2024Derivative-Free Guidance in Continuous and Discrete Diffusion Models with Soft Value-Based Decodingcited by 127
  4. 2024Unlocking Guidance for Discrete State-Space Diffusion and Flow Modelscited by 124
  5. 2019Neural SDE: Stabilizing Neural ODE Networks with Stochastic Noisecited by 98
  6. 2017Variational Sequential Monte Carlocited by 93
  7. 2024Probabilistic Inference in Language Models via Twisted Sequential Monte Carlocited by 85
  8. 2025Inference-Time Alignment in Diffusion Models with Reward-Guided Generation: Tutorial and Reviewcited by 82
  9. 2024Fine-Tuning Discrete Diffusion Models via Reward Optimization with Applications to DNA and Protein Designcited by 72
  10. 2014Reweighted Wake-Sleepcited by 66
  11. 2019Elements of Sequential Monte Carlocited by 60
  12. 2023RetroBridge: Modeling Retrosynthesis with Markov Bridgescited by 35
  13. 2015Neural Adaptive Sequential Monte Carlocited by 34
  14. 2025LEAPS: A discrete neural sampler via locally equivariant networkscited by 30
  15. 2025Debiasing Guidance for Discrete Diffusion with Sequential Monte Carlocited by 29
  16. 2024Steering Masked Discrete Diffusion Models via Discrete Denoising Posterior Predictioncited by 28
  17. 2022SIXO: Smoothing Inference with Twisted Objectivescited by 22
  18. 2025MDNS: Masked Diffusion Neural Sampler via Stochastic Optimal Controlcited by 20
  19. 2025SDE Matching: Scalable and Simulation-Free Training of Latent Stochastic Differential Equationscited by 19
  20. 2021Deep Learning Methods for Daily Wildfire Danger Forecastingcited by 17
  21. 2024Foundation Inference Models for Markov Jump Processescited by 13
  22. 2023Neural Markov Jump Processescited by 11
  23. 2021Variational Inference for Continuous-Time Switching Dynamical Systemscited by 9
  24. 2024Amortized Control of Continuous State Space Feynman-Kac Model for Irregular Time Seriescited by 9
  25. 2024Sequential Monte Carlo for Inclusive KL Minimization in Amortized Variational Inferencecited by 7
  26. 2024Guidance for twisted particle filter: a continuous-time perspectivecited by 7
  27. 2019Moment-Based Variational Inference for Markov Jump Processescited by 6
  28. 2022Computational Doob's h-transforms for Online Filtering of Discretely Observed Diffusionscited by 4
  29. 2023NAS-X: Neural Adaptive Smoothing via Twistingcited by 4
  30. 2023Entropic Matching for Expectation Propagation of Markov Jump Processescited by 2

Built on by

Not cited yet.