# Backstepping-Guided Reinforcement Learning for Wide-Range Saint-Venant Canal Regulation

arXiv: https://arxiv.org/abs/2608.20089 · HTML: https://mlsanity.com/paper/2608.20089/

## Key facts

- No citing papers in the map yet (data through 14 Oct 2026).
- Placed in RL theory and sample complexity, one of 15 directions in Deep reinforcement learning methods.
- Builds on 13 of its 19 references that are in the map.
- First posted on arXiv 20 Aug 2026.

## Placed in

- Deep reinforcement learning methods / [RL theory and sample complexity](https://mlsanity.com/deeprl/rl-theory-and-sample-complexity/)

## Builds on (most cited first, 13 of 13)

- [Soft Actor-Critic: Off-Policy Maximum Entropy Deep Reinforcement Learning with a Stochastic Actor](https://mlsanity.com/paper/1801.01290/) (2018)
- [DeepONet: Learning nonlinear operators for identifying differential equations based on the universal approximation theorem of operators](https://mlsanity.com/paper/1910.03193/) (2019)
- [Neural Operators for Bypassing Gain and Control Computations in PDE Backstepping](https://mlsanity.com/paper/2302.14265/) (2023)
- [Distributed Control of Partial Differential Equations Using Convolutional Reinforcement Learning](https://mlsanity.com/paper/2301.10737/) (2023)
- [Neural Operators of Backstepping Controller and Observer Gain Functions for Reaction-Diffusion PDEs](https://mlsanity.com/paper/2303.10506/) (2023)
- [Neural Operators for PDE Backstepping Control of First-Order Hyperbolic PIDE with Recycle and Delay](https://mlsanity.com/paper/2307.11436/) (2023)
- [Reinforcement Learning with Function-Valued Action Spaces for Partial Differential Equation Control](https://mlsanity.com/paper/1806.06931/) (2018)
- [PDE Control Gym: A Benchmark for Data-Driven Boundary Control of Partial Differential Equations](https://mlsanity.com/paper/2405.11401/) (2024)
- [Actor-Critic Physics-informed Neural Lyapunov Control](https://mlsanity.com/paper/2403.08448/) (2024)
- [Controlgym: Large-Scale Control Environments for Benchmarking Reinforcement Learning Algorithms](https://mlsanity.com/paper/2311.18736/) (2023)
- [Online identification and control of PDEs via Reinforcement Learning methods](https://mlsanity.com/paper/2308.04068/) (2023)
- [Neural Operator Feedback for a First-Order PIDE with Spatially-Varying State Delay](https://mlsanity.com/paper/2412.08219/) (2024)
- [PI controllers for the general Saint-Venant equations](https://mlsanity.com/paper/2108.02703/) (2021)

## Abstract (arXiv)

Backstepping control provides local stability guarantees for nonlinear Saint-Venant systems, but its regulation performance may degrade when the system operates far from the nominal equilibrium. This letter proposes a backstepping-guided soft actor-critic (SAC) controller framework that incorporates model-based control knowledge into reinforcement learning (RL). The nominal backstepping control law is first learned by deep operator network (DeepONet) and embedded into the actor and critic networks as prior informed feature representations. The learned prior is further combined with the SAC policy to generate the final control input, while a transfer-learning strategy preserves the useful backstepping knowledge during adaptation to the nonlinear dynamics. Simulation results on the Sambre River model demonstrate that the proposed method improves learning efficiency and maintains effective regulation over larger initial deviations than backstepping control.