# Comparison of Reinforcement Learning algorithms applied to the Cart Pole problem

arXiv: https://arxiv.org/abs/1810.01940 · HTML: https://mlsanity.com/paper/1810.01940/

## Key facts

- Cited by 13 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 3 Oct 2018.

## Built on by (most cited first, 13 of 13)

- [Functional Bilevel Optimization for Machine Learning](https://mlsanity.com/paper/2403.20233/) (2024)
- [Policy-Based Bayesian Experimental Design for Non-Differentiable Implicit Models](https://mlsanity.com/paper/2203.04272/) (2022)
- [A Search-Based Testing Approach for Deep Reinforcement Learning Agents](https://mlsanity.com/paper/2206.07813/) (2022)
- [Federated Multi-Agent Deep Reinforcement Learning Approach via Physics-Informed Reward for Multi-Microgrid Energy Management](https://mlsanity.com/paper/2301.00641/) (2022)
- [Hyperparameter Tuning for Deep Reinforcement Learning Applications](https://mlsanity.com/paper/2201.11182/) (2022)
- [PatchRefineNet: Improving Binary Segmentation by Incorporating Signals from Optimal Patch-wise Binarization](https://mlsanity.com/paper/2211.06560/) (2022)
- [Estimating Uncertainty in Landslide Segmentation Models](https://mlsanity.com/paper/2311.11138/) (2023)
- [SAMIC: Segment Anything with In-Context Spatial Prompt Engineering](https://mlsanity.com/paper/2412.11998/) (2024)
- [Emotion Recognition from the perspective of Activity Recognition](https://mlsanity.com/paper/2403.16263/) (2024)
- [Towards Automated Semantic Interpretability in Reinforcement Learning via Vision-Language Models](https://mlsanity.com/paper/2503.16724/) (2025)
- [Implementing Online Reinforcement Learning with Clustering Neural Networks](https://mlsanity.com/paper/2402.18472/) (2024)
- [SmartScan: An AI-based Interactive Framework for Automated Region Extraction from Satellite Images](https://mlsanity.com/paper/2504.00200/) (2025)
- [Domain-driven Metrics for Reinforcement Learning: A Case Study on Epidemic Control using Agent-based Simulation](https://mlsanity.com/paper/2508.05154/) (2025)

## Abstract (arXiv)

Designing optimal controllers continues to be challenging as systems are becoming complex and are inherently nonlinear. The principal advantage of reinforcement learning (RL) is its ability to learn from the interaction with the environment and provide optimal control strategy. In this paper, RL is explored in the context of control of the benchmark cartpole dynamical system with no prior knowledge of the dynamics. RL algorithms such as temporal-difference, policy gradient actor-critic, and value function approximation are compared in this context with the standard LQR solution. Further, we propose a novel approach to integrate RL and swing-up controllers.