Rare Event Analysis via Stochastic Optimal Control
Not on the map. Why?
Abstract (arXiv)
Rare events such as conformational changes in biomolecules, phase transitions, and chemical reactions are central to the behavior of many physical systems, yet they are extremely difficult to study computationally because unbiased simulations seldom produce them. Transition Path Theory (TPT) provides a rigorous statistical framework for analyzing such events: it characterizes the ensemble of reactive trajectories between two designated metastable states (reactant and product), and its central object--the committor function, which gives the probability that the system will next reach the product rather than the reactant--encodes all essential kinetic and thermodynamic information. We introduce a framework that casts committor estimation as a stochastic optimal control (SOC) problem. In this formulation the committor defines a feedback control--proportional to the gradient of its logarithm--that actively steers trajectories toward the reactive region, thereby enabling efficient sampling of reactive paths. To solve the resulting hitting-time control problem we develop two complementary objectives: a direct backpropagation loss and a principled off-policy Value Matching loss, for which we establish first-order optimality guarantees. We further address metastability, which can trap controlled trajectories in intermediate basins, by introducing an alternative sampling process that preserves the reactive current while lowering effective energy barriers. On benchmark systems, the framework yields markedly more accurate committor estimates, reaction rates, and equilibrium constants than existing methods.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 9 of its 61 references that are in the map. First posted on arXiv 14 Apr 2026.
Builds on
9 of 61 references.
References · 9
- 2018Soft Actor-Critic: Off-Policy Maximum Entropy Deep Reinforcement Learning with a Stochastic Actorcited by 4,885
- 2025MDNS: Masked Diffusion Neural Sampler via Stochastic Optimal Controlcited by 21
- 2024A Taxonomy of Loss Functions for Stochastic Optimal Controlcited by 13
- 2024Solving Time-Continuous Stochastic Optimal Control Problems: Algorithm Design and Convergence Analysis of Actor-Critic Flowcited by 8
- 2024Deep Learning Method for Computing Committor Functions with Adaptive Samplingcited by 5
- 2020A semigroup method for high dimensional committor functions based on neural networkcited by 4
- 2025Estimating Committor Functions via Deep Adaptive Sampling on Rare Transition Pathscited by 4
- 2024An Efficient On-Policy Deep Learning Framework for Stochastic Optimal Controlcited by 3
- 2025Reinforcement Learning with Random Time Horizonscited by 2
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026Reactive Flux Matching: Mechanism Discovery and Adaptive Sampling of Rare Eventscited by 0
- 2026Machine learning kinetics from molecular dynamics datacited by 0
- 2026ENCORE: Exact Non-equilibrium COntrol with Replica Exchange for Diffusion Generationcited by 0
- 2026Transition Path Sampling Using Koopman Operators and Exit-Time Optimal Controlcited by 0
- 2026Transition Path Sampling Using Koopman Operators and Exit-Time Optimal Control7 Oct 2026
- 2026ENCORE: Exact Non-equilibrium COntrol with Replica Exchange for Diffusion Generation1 Oct 2026
- 2026Machine learning kinetics from molecular dynamics data15 Sep 2026
- 2026Reactive Flux Matching: Mechanism Discovery and Adaptive Sampling of Rare Events4 Jun 2026