# Hierarchical Decomposition of Nonlinear Dynamics and Control for System Identification and Policy Distillation

arXiv: https://arxiv.org/abs/2005.01432 · HTML: https://mlsanity.com/paper/2005.01432/

## Key facts

- Cited by 3 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 4 May 2020.

## Built on by (most cited first, 3 of 3)

- [Model-Based Reinforcement Learning via Stochastic Hybrid Models](https://mlsanity.com/paper/2111.06211/) (2021)
- [Hybrid Recurrent Models Support Emergent Descriptions for Hierarchical Planning and Control](https://mlsanity.com/paper/2408.10970/) (2024)
- [Learning in Hybrid Active Inference Models](https://mlsanity.com/paper/2409.01066/) (2024)

## Abstract (arXiv)

The control of nonlinear dynamical systems remains a major challenge for autonomous agents. Current trends in reinforcement learning (RL) focus on complex representations of dynamics and policies, which have yielded impressive results in solving a variety of hard control tasks. However, this new sophistication and extremely over-parameterized models have come with the cost of an overall reduction in our ability to interpret the resulting policies. In this paper, we take inspiration from the control community and apply the principles of hybrid switching systems in order to break down complex dynamics into simpler components. We exploit the rich representational power of probabilistic graphical models and derive an expectation-maximization (EM) algorithm for learning a sequence model to capture the temporal structure of the data and automatically decompose nonlinear dynamics into stochastic switching linear dynamical systems. Moreover, we show how this framework of switching models enables extracting hierarchies of Markovian and auto-regressive locally linear controllers from nonlinear experts in an imitation learning scenario.