Gym Hero: A Research Environment for Reinforcement Learning Agents in Rhythm Games

XX Brazilian Symposium on Computer Games and Digital Entertainment (SBGames)

Rômulo Freire Férrer Filho¹   Yuri Lenon Barbosa Nogueira²   Creto Augusto Vidal²
Joaquim Bento Cavalcante Neto²   Paulo Bruno de Sousa Serafim³

¹Teleinformatics Engineering Department (DETI), Federal University of Ceara (UFC)
²Department of Computing (DC), Federal University of Ceara (UFC)  ³Instituto Atlântico

---

Paper: [PDF]  Page: [IEEE]

Abstract

This work presents a Reinforcement Learning environment, called Gym Hero, based on the game Guitar Hero. It consists of a similar game implementation, developed using the graphics engine PyGame, with four difficulty levels, and able to randomly generate tracks. On top of the game, we implemented a Gym environment to train and evaluate Reinforcement Learning agents. In order to assess the environment's capacity as a suitable learning tool, we ran a set of experiments to train three autonomous agents using Deep Reinforcement Learning. Each agent was trained on a different level using Deep Q-Networks, a technique that combines Reinforcement Learning with Deep Neural Networks. The input of the network is only the pixels of the screen. We show that the agents were capable of learning the expected behaviors to play the game. The obtained results validate the proposed environment as capable of evaluating autonomous agents on Reinforcement Learning tasks.

Video

Presentation starts at 14:52

BibTeX

Download

@InProceedings{ferrer2021gymhero,
  title = {Gym Hero: A Research Environment for Reinforcement Learning Agents in Rhythm Games},
  author  = {F\'{e}rrer Filho, R\^{o}mulo Freire and Nogueira, Yuri Lenon Barbosa and Vidal, Creto Augusto and Cavalcante-Neto, Joaquim Bento and Serafim, Paulo Bruno Sousa},
  booktitle = {Proceedings of the XX Brazilian Symposium on Computer Games and Digital Entertainment (SBGames)},
  pages = {87--96},
  year = {2021},
  doi = {10.1109/SBGames54170.2021.00020}
}