Vision Transformers for Computer Go
Not on the map. Why?
Abstract (arXiv)
Motivated by the success of transformers in various fields, such as language understanding and image analysis, this investigation explores their application in the context of the game of Go. In particular, our study focuses on the analysis of the Transformer in Vision. Through a detailed analysis of numerous points such as prediction accuracy, win rates, memory, speed, size, or even learning rate, we have been able to highlight the substantial role that transformers can play in the game of Go. This study was carried out by comparing them to the usual Residual Networks.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 21 of its 35 references that are in the map. First posted on arXiv 22 Sep 2023.
Builds on
21 of 35 references.
References · 21
- 2017Attention Is All You Needcited by 60,361
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2020End-to-End Object Detection with Transformerscited by 7,414
- 2017MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applicationscited by 3,845
- 2014Sequence to Sequence Learning with Neural Networkscited by 2,986
- 2020Conformer: Convolution-augmented Transformer for Speech Recognitioncited by 1,863
- 2018Image Transformercited by 772
- 2017Mastering Chess and Shogi by Self-Play with a General Reinforcement Learning Algorithmcited by 734
- 2020Pre-trained Models for Natural Language Processing: A Surveycited by 505
- 2022EfficientFormer: Vision Transformers at MobileNet Speedcited by 241
9 more
- 2018Molecular Transformer - A Model for Uncertainty-Calibrated Chemical Reaction Predictioncited by 229
- 2020Developing Real-time Streaming Transformer Transducer for Speech Recognition on Large-scale Datasetcited by 97
- 2019Accelerating Self-Play Learning in Gocited by 64
- 2020Accelerating and Improving AlphaZero Using Population Based Trainingcited by 12
- 2020Polygames: Improved Zero Learningcited by 11
- 2017Multi-Labelled Value Networks for Computer Gocited by 5
- 2020Mobile Networks for Computer Gocited by 5
- 2021Batch Monte Carlo Tree Searchcited by 5
- 2021Improving Model and Search for Computer Gocited by 3
Built on by
Citing papers per year: 2024: 2.
2 papers.