# A Deep Reinforcement Learning Blind AI in DareFightingICE

arXiv: https://arxiv.org/abs/2205.07444 · HTML: https://mlsanity.com/paper/2205.07444/

## Key facts

- Cited by 4 papers in the map (data through 14 Oct 2026).
- Builds on 13 of its 22 references that are in the map.
- First posted on arXiv 16 May 2022.

## Builds on (most cited first, 13 of 13)

- [Proximal Policy Optimization Algorithms](https://mlsanity.com/paper/1707.06347/) (2017)
- [Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translation](https://mlsanity.com/paper/1406.1078/) (2014)
- [ViZDoom: A Doom-based AI Research Platform for Visual Reinforcement Learning](https://mlsanity.com/paper/1605.02097/) (2016)
- [Self-training and Pre-training are Complementary for Speech Recognition](https://mlsanity.com/paper/2010.11430/) (2020)
- [Semantic Audio-Visual Navigation](https://mlsanity.com/paper/2012.11583/) (2020)
- [PortaSpeech: Portable and High-Quality Generative Text-to-Speech](https://mlsanity.com/paper/2109.15166/) (2021)
- [Advancing RNN Transducer Technology for Speech Recognition](https://mlsanity.com/paper/2103.09935/) (2021)
- [iSTFTNet: Fast and Lightweight Mel-Spectrogram Vocoder Incorporating Inverse Short-Time Fourier Transform](https://mlsanity.com/paper/2203.02395/) (2022)
- [DareFightingICE Competition: A Fighting Game Sound Design and AI Competition](https://mlsanity.com/paper/2203.01556/) (2022)
- [A Deep Reinforcement Learning Approach to Audio-Based Navigation in a Multi-Speaker Environment](https://mlsanity.com/paper/2105.04488/) (2021)
- [Enhanced Rolling Horizon Evolution Algorithm with Opponent Model Learning: Results for the Fighting Game AI Competition](https://mlsanity.com/paper/2003.13949/) (2020)
- [Agents that Listen: High-Throughput Reinforcement Learning with Multiple Sensory Systems](https://mlsanity.com/paper/2107.02195/) (2021)
- ["Did You Hear That?" Learning to Play Video Games from Audio Cues](https://mlsanity.com/paper/1906.04027/) (2019)

## Built on by (most cited first, 4 of 4)

- [Improving Post-Processing of Audio Event Detectors Using Reinforcement Learning](https://mlsanity.com/paper/2208.09201/) (2022)
- [Adaptive Background Music for a Fighting Game: A Multi-Instrument Volume Modulation Approach](https://mlsanity.com/paper/2303.15734/) (2023)
- [Achieving Fairness in DareFightingICE Agents Evaluation Through a Delay Mechanism](https://mlsanity.com/paper/2312.16010/) (2023)
- [Fighting Game Adaptive Background Music for Improved Gameplay](https://mlsanity.com/paper/2403.02701/) (2024)

## Abstract (arXiv)

This paper presents a deep reinforcement learning agent (AI) that uses sound as the input on the DareFightingICE platform at the DareFightingICE Competition in IEEE CoG 2022. In this work, an AI that only uses sound as the input is called blind AI. While state-of-the-art AIs rely mostly on visual or structured observations provided by their environments, learning to play games from only sound is still new and thus challenging. We propose different approaches to process audio data and use the Proximal Policy Optimization algorithm for our blind AI. We also propose to use our blind AI in evaluation of sound designs submitted to the competition and define two metrics for this task. The experimental results show the effectiveness of not only our blind AI but also the proposed two metrics.