Boosting Trust Region Policy Optimization by Normalizing Flows Policy
Not on the map. Why?
Abstract (arXiv)
We propose to improve trust region policy search with normalizing flows policy. We illustrate that when the trust region is constructed by KL divergence constraints, normalizing flows policy generates samples far from the 'center' of the previous policy iterate, which potentially enables better exploration and helps avoid bad local optima. Through extensive comparisons, we show that the normalizing flows policy significantly improves upon baseline architectures especially on high-dimensional tasks with complex dynamics.
Key facts. Cited by 11 papers in the map (data through 7 Oct 2026). First posted on arXiv 27 Sep 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 4; 2022: 4; 2023: 0; 2024: 1; 2025: 1; 2026: 1.
11 papers.
- 2024S2AC: Energy-Based Reinforcement Learning with Stein Soft Actor Criticcited by 18
- 2025GenPO: Generative Diffusion Models Meet On-Policy Reinforcement Learningcited by 16
- 2022Learning Sampling Distributions for Model Predictive Controlcited by 10
- 2022CEIP: Combining Explicit and Implicit Priors for Reinforcement Learning with Demonstrationscited by 4
- 2021Improving Actor-Critic Reinforcement Learning via Hamiltonian Monte Carlo Methodcited by 2
- 2021Bellman: A Toolbox for Model-Based Reinforcement Learning in TensorFlowcited by 2
- 2021Soft Actor-Critic With Integer Actionscited by 2
- 2021EnTRPO: Trust Region Policy Optimization Method with Entropy Regularizationcited by 2
- 2022Policy Gradient With Serial Markov Chain Reasoningcited by 2
- 2026GenPO++: Generative Policy Optimization with Jacobian-free Likelihood Ratioscited by 1
- 2022Entropy Augmented Reinforcement Learningcited by 0
- 2026GenPO++: Generative Policy Optimization with Jacobian-free Likelihood Ratios5 Jun 2026
- 2025GenPO: Generative Diffusion Models Meet On-Policy Reinforcement Learning24 May 2025
- 2024S2AC: Energy-Based Reinforcement Learning with Stein Soft Actor Critic2 May 2024
- 2022Learning Sampling Distributions for Model Predictive Control5 Dec 2022
- 2022CEIP: Combining Explicit and Implicit Priors for Reinforcement Learning with Demonstrations18 Oct 2022
- 2022Policy Gradient With Serial Markov Chain Reasoning13 Oct 2022
- 2022Entropy Augmented Reinforcement Learning19 Aug 2022
- 2021EnTRPO: Trust Region Policy Optimization Method with Entropy Regularization26 Oct 2021
- 2021Soft Actor-Critic With Integer Actions17 Sep 2021
- 2021Bellman: A Toolbox for Model-Based Reinforcement Learning in TensorFlow26 Mar 2021
- 2021Improving Actor-Critic Reinforcement Learning via Hamiltonian Monte Carlo Method22 Mar 2021