# Automated Discovery of Operable Dynamics from Videos

arXiv: https://arxiv.org/abs/2410.11894 · HTML: https://mlsanity.com/paper/2410.11894/

## Key facts

- No citing papers in the map yet (data through 14 Oct 2026).
- First posted on arXiv 14 Oct 2024.

## Abstract (arXiv)

Dynamical systems form the foundation of scientific discovery, traditionally modeled with predefined state variables such as the angle and angular velocity, and differential equations such as the equation of motion for a single pendulum. We introduce a framework that automatically discovers a low-dimensional and operable representation of system dynamics, including a set of compact state variables that preserve the smoothness of the system dynamics and a differentiable vector field, directly from video without requiring prior domain-specific knowledge. The prominence and effectiveness of the proposed approach are demonstrated through both quantitative and qualitative analyses of a range of dynamical systems, including the identification of stable equilibria, the prediction of natural frequencies, and the detection of chaotic and limit cycle behaviors. The results highlight the potential of our data-driven approach to advance automated scientific discovery.