Polygames: Improved Zero Learning - Archive ouverte HAL Accéder directement au contenu
Article Dans Une Revue International Computer Games Association Journal Année : 2020

Polygames: Improved Zero Learning

Qucheng Gong
  • Fonction : Auteur
Hengyuan Hu
  • Fonction : Auteur
Vasil Khalidov
  • Fonction : Auteur
Xavier Martinet
  • Fonction : Auteur
Vegard Mella
  • Fonction : Auteur
Jeremy Rapin
  • Fonction : Auteur
Baptiste Roziere
  • Fonction : Auteur
Gabriel Synnaeve
  • Fonction : Auteur
Olivier Teytaud
Shi-Jim Yen
  • Fonction : Auteur
  • PersonId : 1089197
Sergey Zagoruyko
  • Fonction : Auteur

Résumé

Since DeepMind's AlphaZero, Zero learning quickly became the state-of-the-art method for many board games. It can be improved using a fully convolutional structure (no fully connected layer). Using such an architecture plus global pooling, we can create bots independent of the board size. The training can be made more robust by keeping track of the best checkpoints during the training and by training against them. Using these features, we release Polygames, our framework for Zero learning, with its library of games and its checkpoints. We won against strong humans at the game of Hex in 19x19 , including the human player with the best ELO rank on LittleGolem; we incidentally also won against another Zero implementation, which was weaker than humans: in a discussion on LittleGolem, Hex19 was said to be intractable for zero learning. We also won in Havannah with size 8: win against the strongest player, namely Eobllor, with excellent opening moves. We also won several first places at the TAAI 2019 competitions and had positive results against strong bots in various games.
Fichier principal
Vignette du fichier
Polygames.pdf (6 Mo) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-03117499 , version 1 (21-01-2021)

Identifiants

  • HAL Id : hal-03117499 , version 1

Citer

Tristan Cazenave, Yen-Chi Chen, Guan-Wei Chen, Shi-Yu Chen, Xian-Dong Chiu, et al.. Polygames: Improved Zero Learning. International Computer Games Association Journal, 2020, 42 (4), pp.244-256. ⟨hal-03117499⟩
149 Consultations
142 Téléchargements

Partager

Gmail Facebook X LinkedIn More