# Transfer of Fully Convolutional Policy-Value Networks Between Games and Game Variants

arXiv: https://arxiv.org/abs/2102.12375 · HTML: https://mlsanity.com/paper/2102.12375/

## Key facts

- Cited by 6 papers in the map (data through 14 Oct 2026).
- Builds on 17 of its 39 references that are in the map.
- First posted on arXiv 24 Feb 2021.

## Builds on (most cited first, 17 of 17)

- [Deep Residual Learning for Image Recognition](https://mlsanity.com/paper/1512.03385/) (2015)
- [PyTorch: An Imperative Style, High-Performance Deep Learning Library](https://mlsanity.com/paper/1912.01703/) (2019)
- [U-Net: Convolutional Networks for Biomedical Image Segmentation](https://mlsanity.com/paper/1505.04597/) (2015)
- [Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift](https://mlsanity.com/paper/1502.03167/) (2015)
- [Fully Convolutional Networks for Semantic Segmentation](https://mlsanity.com/paper/1411.4038/) (2014)
- [Network In Network](https://mlsanity.com/paper/1312.4400/) (2013)
- [Transfer Learning in Deep Reinforcement Learning: A Survey](https://mlsanity.com/paper/2009.07888/) (2020)
- [Thinking Fast and Slow with Deep Learning and Tree Search](https://mlsanity.com/paper/1705.08439/) (2017)
- [Accelerating Self-Play Learning in Go](https://mlsanity.com/paper/1902.10565/) (2019)
- [Gotta Learn Fast: A New Benchmark for Generalization in RL](https://mlsanity.com/paper/1804.03720/) (2018)
- [ELF OpenGo: An Analysis and Open Reimplementation of AlphaZero](https://mlsanity.com/paper/1902.04522/) (2019)
- [Ludii -- The Ludemic General Game System](https://mlsanity.com/paper/1905.05013/) (2019)
- [Polygames: Improved Zero Learning](https://mlsanity.com/paper/2001.09832/) (2020)
- [Innateness, AlphaZero, and Artificial Intelligence](https://mlsanity.com/paper/1801.05667/) (2018)
- [Deep Learning for General Game Playing with Ludii and Polygames](https://mlsanity.com/paper/2101.09562/) (2021)
- [SAI, a Sensible Artificial Intelligence that plays Go](https://mlsanity.com/paper/1809.03928/) (2018)
- [Mobile Networks for Computer Go](https://mlsanity.com/paper/2008.10080/) (2020)

## Built on by (most cited first, 6 of 6)

- [General Board Game Concepts](https://mlsanity.com/paper/2107.01078/) (2021)
- [Measuring Board Game Distance](https://mlsanity.com/paper/2301.03913/) (2023)
- [Spatial State-Action Features for General Games](https://mlsanity.com/paper/2201.06401/) (2022)
- [Brick Tic-Tac-Toe: Exploring the Generalizability of AlphaZero to Novel Test Environments](https://mlsanity.com/paper/2207.05991/) (2022)
- [Language-Informed Transfer Learning for Embodied Household Activities](https://mlsanity.com/paper/2301.05318/) (2023)
- [AlphaViT: A flexible game-playing AI for multiple games and variable board sizes](https://mlsanity.com/paper/2408.13871/) (2024)

## Abstract (arXiv)

In this paper, we use fully convolutional architectures in AlphaZero-like self-play training setups to facilitate transfer between variants of board games as well as distinct games. We explore how to transfer trained parameters of these architectures based on shared semantics of channels in the state and action representations of the Ludii general game system. We use Ludii's large library of games and game variants for extensive transfer learning evaluations, in zero-shot transfer experiments as well as experiments with additional fine-tuning time.