Alert button
Picture for Mariana S. Barros

Mariana S. Barros

Alert button

An analysis of Reinforcement Learning applied to Coach task in IEEE Very Small Size Soccer

Add code
Bookmark button
Alert button
Nov 23, 2020
Carlos H. C. Pena, Mateus G. Machado, Mariana S. Barros, José D. P. Silva, Lucas D. Maciel, Tsang Ing Ren, Edna N. S. Barros, Pedro H. M. Braga, Hansenclever F. Bassani

Figure 1 for An analysis of Reinforcement Learning applied to Coach task in IEEE Very Small Size Soccer
Figure 2 for An analysis of Reinforcement Learning applied to Coach task in IEEE Very Small Size Soccer
Figure 3 for An analysis of Reinforcement Learning applied to Coach task in IEEE Very Small Size Soccer
Figure 4 for An analysis of Reinforcement Learning applied to Coach task in IEEE Very Small Size Soccer

The IEEE Very Small Size Soccer (VSSS) is a robot soccer competition in which two teams of three small robots play against each other. Traditionally, a deterministic coach agent will choose the most suitable strategy and formation for each adversary's strategy. Therefore, the role of a coach is of great importance to the game. In this sense, this paper proposes an end-to-end approach for the coaching task based on Reinforcement Learning (RL). The proposed system processes the information during the simulated matches to learn an optimal policy that chooses the current formation, depending on the opponent and game conditions. We trained two RL policies against three different teams (balanced, offensive, and heavily offensive) in a simulated environment. Our results were assessed against one of the top teams of the VSSS league, showing promising results after achieving a win/loss ratio of approximately 2.0.

* 6 pages, 9 figures, to be published in Latin American Robotics Symposium 
Viaarxiv icon
Github IconAccess Paper or Ask Questions
Twitter IconFacebook IconLinkedin IconWhatsapp IconMessenger Icon