Evaluating Competition in Training of Deep Reinforcement Learning Agents in First-Person Shooter Games

17th Brazilian Symposium on Computer Games and Digital Entertainment (SBGames)

Paulo Bruno de Sousa Serafim   Yuri Lenon Barbosa Nogueira
Creto Augusto Vidal   Joaquim Bento Cavalcante Neto

Department of Computing (DC), Federal University of Ceara (UFC)

---

Paper: [PDF]  Proceedings: [IEEE]  Code: [GitHub]

Abstract

This work evaluates competition in training of autonomous agents immersed in First-Person Shooter games using Deep Reinforcement Learning. The agents are composed of a Deep Neural Network, which is trained using Deep QLearning. The inputs of the networks are only the pixels of the screen, allowing the creation of general players, capable of handling several environments without the need for further modifications. ViZDoom, an Application Programming Interface based on the game Doom, is used as the testbed because of its appropriate features. Fifteen agents were divided into three groups, two of which were trained by competing with each other, and the third was trained by competing against opponents that act randomly. The developed agents were able to learn adequate behaviors to survive in a custom one-onone scenario. The tests showed that the competitive training of autonomous agents leads to a greater number of wins compared to training against non-intelligent agents.

Videos

BibTeX

Download

@InProceedings{serafim2018evaluating,
  title = {Evaluating competition in training of Deep Reinforcement Learning agents in First-Person Shooter games},
  author  = {Serafim, Paulo Bruno Sousa and Nogueira, Yuri Lenon Barbosa and Vidal, Creto Augusto and Cavalcante-Neto, Joaquim Bento},
  booktitle = {Proceedings of the XVII Brazilian Symposium on Computer Games and Digital Entertainment (SBGames)},
  pages = {468--477},
  year = {2018},
  doi = {10.1109/SBGAMES.2018.00023}
}