Extending the OpenAI Gym for robotics: a toolkit for reinforcement learning using ROS and Gazebo
Not on the map. Why?
Abstract (arXiv)
This paper presents an extension of the OpenAI Gym for robotics using the Robot Operating System (ROS) and the Gazebo simulator. The content discusses the software architecture proposed and the results obtained by using two Reinforcement Learning techniques: Q-Learning and Sarsa. Ultimately, the output of this work presents a benchmarking system for robotics that allows different techniques and algorithms to be compared using the same virtual conditions.
Key facts. Cited by 18 papers in the map (data through 7 Oct 2026). First posted on arXiv 19 Aug 2016.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 8; 2022: 0; 2023: 2; 2024: 3; 2025: 1; 2026: 4.
18 papers.
Sort:
By area:
- 2024Shield Synthesis for LTL Modulo Theoriescited by 12
- 2024Gaussian Splatting to Real World Flight Navigation Transfer with Liquid Networkscited by 12
- 2023Vision-based Learning for Drones: A Surveycited by 9
- 2021Reinforcement Learning-Based Coverage Path Planning with Implicit Cellular Decompositioncited by 6
- 2021Vision-Based Mobile Robotics Obstacle Avoidance With Deep Reinforcement Learningcited by 4
- 2021MarsExplorer: Exploration of Unknown Terrains via Deep Reinforcement Learning and Procedurally Generated Environmentscited by 4
- 2021ASIST: Annotation-free Synthetic Instance Segmentation and Tracking by Adversarial Simulationscited by 3
- 2021ROS-X-Habitat: Bridging the ROS Ecosystem with Embodied AIcited by 2
- 2021Sim-Env: Decoupling OpenAI Gym Environments from Simulation Modelscited by 1
- 2021A Scalable and Reproducible System-on-Chip Simulation for Reinforcement Learningcited by 1
- 2026A ROS 2 Wrapper for Florence-2: Multi-Mode Local Vision-Language Inference for Robotic Systemscited by 1
- 2021Composable Learning with Sparse Kernel Representationscited by 0
6 more
- 2023Reinforcement Learning With Reward Machines in Stochastic Gamescited by 0
- 2024Autonomous Control of a Novel Closed Chain Five Bar Active Suspension via Deep Reinforcement Learningcited by 0
- 2025RouteFormer: A Transformer-Based Routing Framework for Autonomous Vehiclescited by 0
- 2026CALF: Communication-Aware Learning Framework for Distributed Reinforcement Learningcited by 0
- 2026Architecture for Multi-Unmanned Aerial Vehicles based Autonomous Precision Agriculture Systemscited by 0
- 2026ARMATA: Auto-Regressive Multi-Agent Task Assignmentcited by 0
- 2026ARMATA: Auto-Regressive Multi-Agent Task Assignment5 May 2026
- 2026A ROS 2 Wrapper for Florence-2: Multi-Mode Local Vision-Language Inference for Robotic Systems1 Apr 2026
- 2026Architecture for Multi-Unmanned Aerial Vehicles based Autonomous Precision Agriculture Systems22 Mar 2026
- 2026CALF: Communication-Aware Learning Framework for Distributed Reinforcement Learning13 Mar 2026
- 2025RouteFormer: A Transformer-Based Routing Framework for Autonomous Vehicles7 Apr 2025
- 2024Autonomous Control of a Novel Closed Chain Five Bar Active Suspension via Deep Reinforcement Learning27 Jun 2024
- 2024Gaussian Splatting to Real World Flight Navigation Transfer with Liquid Networks21 Jun 2024
- 2024Shield Synthesis for LTL Modulo Theories6 Jun 2024
- 2023Vision-based Learning for Drones: A Survey8 Dec 2023
- 2023Reinforcement Learning With Reward Machines in Stochastic Games27 May 2023
- 2021Reinforcement Learning-Based Coverage Path Planning with Implicit Cellular Decomposition18 Oct 2021
- 2021ROS-X-Habitat: Bridging the ROS Ecosystem with Embodied AI16 Sep 2021
6 more
- 2021MarsExplorer: Exploration of Unknown Terrains via Deep Reinforcement Learning and Procedurally Generated Environments21 Jul 2021
- 2021A Scalable and Reproducible System-on-Chip Simulation for Reinforcement Learning27 Apr 2021
- 2021Composable Learning with Sparse Kernel Representations26 Mar 2021
- 2021Vision-Based Mobile Robotics Obstacle Avoidance With Deep Reinforcement Learning8 Mar 2021
- 2021Sim-Env: Decoupling OpenAI Gym Environments from Simulation Models19 Feb 2021
- 2021ASIST: Annotation-free Synthetic Instance Segmentation and Tracking by Adversarial Simulations3 Jan 2021
- 2024Shield Synthesis for LTL Modulo Theoriescited by 12
- 2024Gaussian Splatting to Real World Flight Navigation Transfer with Liquid Networkscited by 12
- 2023Vision-based Learning for Drones: A Surveycited by 9
- 2021Reinforcement Learning-Based Coverage Path Planning with Implicit Cellular Decompositioncited by 6
- 2021Vision-Based Mobile Robotics Obstacle Avoidance With Deep Reinforcement Learningcited by 4
- 2021MarsExplorer: Exploration of Unknown Terrains via Deep Reinforcement Learning and Procedurally Generated Environmentscited by 4
- 2021ASIST: Annotation-free Synthetic Instance Segmentation and Tracking by Adversarial Simulationscited by 3
- 2021ROS-X-Habitat: Bridging the ROS Ecosystem with Embodied AIcited by 2
- 2021Sim-Env: Decoupling OpenAI Gym Environments from Simulation Modelscited by 1
- 2021A Scalable and Reproducible System-on-Chip Simulation for Reinforcement Learningcited by 1
- 2021Composable Learning with Sparse Kernel Representationscited by 0
- 2023Reinforcement Learning With Reward Machines in Stochastic Gamescited by 0
12 most cited of 16 All 16 (JSON)
- 2026ARMATA: Auto-Regressive Multi-Agent Task Assignment5 May 2026
- 2026Architecture for Multi-Unmanned Aerial Vehicles based Autonomous Precision Agriculture Systems22 Mar 2026
- 2026CALF: Communication-Aware Learning Framework for Distributed Reinforcement Learning13 Mar 2026
- 2024Autonomous Control of a Novel Closed Chain Five Bar Active Suspension via Deep Reinforcement Learning27 Jun 2024
- 2024Gaussian Splatting to Real World Flight Navigation Transfer with Liquid Networks21 Jun 2024
- 2024Shield Synthesis for LTL Modulo Theories6 Jun 2024
- 2023Vision-based Learning for Drones: A Survey8 Dec 2023
- 2023Reinforcement Learning With Reward Machines in Stochastic Games27 May 2023
- 2021Reinforcement Learning-Based Coverage Path Planning with Implicit Cellular Decomposition18 Oct 2021
- 2021ROS-X-Habitat: Bridging the ROS Ecosystem with Embodied AI16 Sep 2021
- 2021MarsExplorer: Exploration of Unknown Terrains via Deep Reinforcement Learning and Procedurally Generated Environments21 Jul 2021
- 2021A Scalable and Reproducible System-on-Chip Simulation for Reinforcement Learning27 Apr 2021
12 newest of 16 All 16 (JSON)