Reinforcement Learning Agents for Ubisoft's Roller Champions
Not on the map. Why?
Abstract (arXiv)
In recent years, Reinforcement Learning (RL) has seen increasing popularity in research and popular culture. However, skepticism still surrounds the practicality of RL in modern video game development. In this paper, we demonstrate by example that RL can be a great tool for Artificial Intelligence (AI) design in modern, non-trivial video games. We present our RL system for Ubisoft's Roller Champions, a 3v3 Competitive Multiplayer Sports Game played on an oval-shaped skating arena. Our system is designed to keep up with agile, fast-paced development, taking 1--4 days to train a new model following gameplay changes. The AIs are adapted for various game modes, including a 2v2 mode, a Training with Bots mode, in addition to the Classic game mode where they replace players who have disconnected. We observe that the AIs develop sophisticated co-ordinated strategies, and can aid in balancing the game as an added bonus. Please see the accompanying video at https://vimeo.com/466780171 (password: rollerRWRL2020) for examples.
Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). First posted on arXiv 10 Dec 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2023: 2; 2024: 1; 2025: 3.
6 papers.
- 2024A Survey on Game Playing Agents and Large Models: Methods, Applications, and Challengescited by 22
- 2023Technical Challenges of Deploying Reinforcement Learning Agents for Game Testing in AAA Gamescited by 12
- 2025A Comprehensive Review of Multi-Agent Reinforcement Learning in Video Gamescited by 9
- 2025Enhancing the Outcome Reward-based RL Training of MLLMs with Self-Consistency Samplingcited by 4
- 2025The Formalism-Implementation Gap in Reinforcement Learning Researchcited by 3
- 2023PlotMap: Automated Layout Design for Building Game Worldscited by 2
- 2025Enhancing the Outcome Reward-based RL Training of MLLMs with Self-Consistency Sampling13 Nov 2025
- 2025The Formalism-Implementation Gap in Reinforcement Learning Research17 Oct 2025
- 2025A Comprehensive Review of Multi-Agent Reinforcement Learning in Video Games3 Sep 2025
- 2024A Survey on Game Playing Agents and Large Models: Methods, Applications, and Challenges15 Mar 2024
- 2023PlotMap: Automated Layout Design for Building Game Worlds26 Sep 2023
- 2023Technical Challenges of Deploying Reinforcement Learning Agents for Game Testing in AAA Games19 Jul 2023