# Challenging On Car Racing Problem from OpenAI gym

arXiv: https://arxiv.org/abs/1911.04868 · HTML: https://mlsanity.com/paper/1911.04868/

## Key facts

- Cited by 1 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 2 Nov 2019.

## Built on by (most cited first, 1 of 1)

- [MicroRacer: a didactic environment for Deep Reinforcement Learning](https://mlsanity.com/paper/2203.10494/) (2022)

## Abstract (arXiv)

This project challenges the car racing problem from OpenAI gym environment. The problem is very challenging since it requires computer to finish the continuous control task by learning from pixels. To tackle this challenging problem, we explored two approaches including evolutionary algorithm based genetic multi-layer perceptron and double deep Q-learning network. The result shows that the genetic multi-layer perceptron can converge fast but when training many episodes, double deep Q-learning can get better score. We analyze the result and draw a conclusion that for limited hardware resources, using genetic multi-layer perceptron sometimes can be more efficient.