Universal Approximation Theorems for Dynamical Systems with Infinite-Time Horizon Guarantees

Universal approximation theorems establish the expressive capacity of neural network architectures. For dynamical systems, existing results are limited to finite time horizons or systems with a globally stable equilibrium, leaving multistability and limit cycles unaddressed. We prove that Neural ODEs achieve varepsilon-δ closeness -- trajectories within error varepsilon except for initial conditions of measure < δ -- over the infinite time horizon [0,∞) for three target classes: (1) Morse-Smale systems (a structurally stable class) with hyperbolic fixed points, (2) Morse-Smale systems with hyperbolic limit cycles via exact period matching, and (3) systems with normally hyperbolic continuous attractors via discretization. We further establish a temporal generalization bound: varepsilon-δ closeness implies Lp error ≤ varepsilonp + δ · Dp for all t ≥ 0, bridging topological guarantees to training metrics. These results provide the first universal approximation framework for multistable infinite-horizon dynamics.