A Deep Reinforcement Learning Blind AI in DareFightingICE
Not on the map. Why?
Abstract (arXiv)
This paper presents a deep reinforcement learning agent (AI) that uses sound as the input on the DareFightingICE platform at the DareFightingICE Competition in IEEE CoG 2022. In this work, an AI that only uses sound as the input is called blind AI. While state-of-the-art AIs rely mostly on visual or structured observations provided by their environments, learning to play games from only sound is still new and thus challenging. We propose different approaches to process audio data and use the Proximal Policy Optimization algorithm for our blind AI. We also propose to use our blind AI in evaluation of sound designs submitted to the competition and define two metrics for this task. The experimental results show the effectiveness of not only our blind AI but also the proposed two metrics.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 13 of its 22 references that are in the map. First posted on arXiv 16 May 2022.
Builds on
13 of 22 references.
References · 13
- 2017Proximal Policy Optimization Algorithmscited by 15,215
- 2014Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translationcited by 4,057
- 2016ViZDoom: A Doom-based AI Research Platform for Visual Reinforcement Learningcited by 179
- 2020Self-training and Pre-training are Complementary for Speech Recognitioncited by 99
- 2020Semantic Audio-Visual Navigationcited by 82
- 2021PortaSpeech: Portable and High-Quality Generative Text-to-Speechcited by 47
- 2021Advancing RNN Transducer Technology for Speech Recognitioncited by 44
- 2022iSTFTNet: Fast and Lightweight Mel-Spectrogram Vocoder Incorporating Inverse Short-Time Fourier Transformcited by 32
- 2022DareFightingICE Competition: A Fighting Game Sound Design and AI Competitioncited by 10
- 2021A Deep Reinforcement Learning Approach to Audio-Based Navigation in a Multi-Speaker Environmentcited by 6
- 2020Enhanced Rolling Horizon Evolution Algorithm with Opponent Model Learning: Results for the Fighting Game AI Competitioncited by 4
- 2021Agents that Listen: High-Throughput Reinforcement Learning with Multiple Sensory Systemscited by 4
1 more
Built on by
Citing papers per year: 2022: 1; 2023: 2; 2024: 1.
4 papers.
- 2022Improving Post-Processing of Audio Event Detectors Using Reinforcement Learningcited by 1
- 2023Adaptive Background Music for a Fighting Game: A Multi-Instrument Volume Modulation Approachcited by 0
- 2023Achieving Fairness in DareFightingICE Agents Evaluation Through a Delay Mechanismcited by 0
- 2024Fighting Game Adaptive Background Music for Improved Gameplaycited by 0
- 2024Fighting Game Adaptive Background Music for Improved Gameplay5 Mar 2024
- 2023Achieving Fairness in DareFightingICE Agents Evaluation Through a Delay Mechanism26 Dec 2023
- 2023Adaptive Background Music for a Fighting Game: A Multi-Instrument Volume Modulation Approach28 Mar 2023
- 2022Improving Post-Processing of Audio Event Detectors Using Reinforcement Learning19 Aug 2022