Can Blockchains Reliably Train Machine Learning Models?
Not on the map. Why?
Abstract (arXiv)
Large proof of work (PoW) networks allow anyone to earn rewards by running computation-intensive hash puzzles for profit, yet they typically consume electricity comparable to that of medium-sized countries. Repurposing computing resources from hash puzzles to machine learning training can benefit the energy sector as a whole, since this computing power is no longer wasted on solving hash puzzles but is instead used to train machine learning models that provide value across different application domains. However, major technical gaps currently prevent this integration. To bridge these gaps, we introduce proof of training (PoT), a protocol that directs mining power toward verifiable training of machine learning models while preserving PoW's incentives for participation and growth. We study PoT by theoretically identifying the blockchain structure that best meets the goals of training reliability, security, and scalability, and we further evaluate it by implementing a decentralized training network. Our results indicate considerable potential, including high task throughput, strong robustness, and improved network security.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 19 of its 78 references that are in the map. First posted on arXiv 13 Jul 2023.
Builds on
19 of 78 references.
References · 19
- 2016Communication-Efficient Learning of Deep Networks from Decentralized Datacited by 7,592
- 2016Deep Learning with Differential Privacycited by 2,682
- 2019Megatron-LM: Training Multi-Billion Parameter Language Models Using Model Parallelismcited by 1,829
- 2019ZeRO: Memory Optimizations Toward Training Trillion Parameter Modelscited by 1,278
- 2021Sustainable AI: Environmental Implications, Challenges and Opportunitiescited by 242
- 2019Analysis of Large-Scale Multi-Tenant GPU Clusters for DNN Training Workloadscited by 79
- 2018Hyperledger Fabric: A Distributed Operating System for Permissioned Blockchainscited by 48
- 2021Characterization and Prediction of Deep Learning Workloads in Large-Scale GPU Datacenterscited by 31
- 2019Proof of Federated Learning: A Novel Energy-recycling Consensus Algorithmcited by 26
- 2018A Survey on Consensus Mechanisms and Mining Strategy Management in Blockchain Networkscited by 11
- 2017Consensus in the Age of Blockchainscited by 10
- 2019Coin.AI: A Proof-of-Useful-Work Scheme for Blockchain-based Distributed Deep Learningcited by 10
7 more
- 2022Anatomy of a Stablecoin's failure: the Terra-Luna casecited by 9
- 2019Energy-recycling Blockchain with Proof-of-Deep-Learningcited by 7
- 2018Decentralization in Bitcoin and Ethereum Networkscited by 5
- 2022A Survey of Layer-Two Blockchain Protocolscited by 3
- 2018Understanding the Motivations, Challenges and Needs of Blockchain Software Developers: A Surveycited by 2
- 2022Analyzing Voting Power in Decentralized Governance: Who controls DAOs?cited by 2
- 2023Understanding Blockchain Governance: Analyzing Decentralized Voting to Amend DeFi Smart Contractscited by 1
Built on by
Citing papers per year: 2023: 1.
1 paper.