Dynamic Large Language Models on Blockchains
Not on the map. Why?
Abstract (arXiv)
Training and deploying the large language models requires a large mount of computational resource because the language models contain billions of parameters and the text has thousands of tokens. Another problem is that the large language models are static. They are fixed after the training process. To tackle these issues, in this paper, we propose to train and deploy the dynamic large language model on blockchains, which have high computation performance and are distributed across a network of computers. A blockchain is a secure, decentralized, and transparent system that allows for the creation of a tamper-proof ledger for transactions without the need for intermediaries. The dynamic large language models can continuously learn from the user input after the training process. Our method provides a new way to develop the large language models and also sheds a light on the next generation artificial intelligence systems.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 12 of its 43 references that are in the map. First posted on arXiv 20 Jul 2023.
Builds on
12 of 43 references.
References · 12
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,874
- 2023A Survey of Large Language Modelscited by 2,537
- 2023LLaMA-Adapter: Efficient Fine-tuning of Language Models with Zero-init Attentioncited by 776
- 2021Dynamic Neural Networks: A Surveycited by 405
- 2023Training Language Models with Language Feedback at Scalecited by 125
- 2019Side Window Filteringcited by 27
- 2021What do Large Language Models Learn about Scripts?cited by 19
- 2019Weighted Mean Curvaturecited by 15
- 2021Fast and High-Quality Blind Multi-Spectral Image Pansharpeningcited by 13
- 2021A Discrete Scheme for Computing Image's Weighted Gaussian Curvaturecited by 10
- 2021Quarter Laplacian Filter for Edge Aware Image Processingcited by 9
Built on by
Citing papers per year: 2023: 3; 2024: 1.
4 papers.
- 2024Blockchain for Large Language Model Security and Safety: A Holistic Surveycited by 8
- 2023Gradient Domain Diffusion Models for Image Synthesiscited by 4
- 2023TSSR: A Truncated and Signed Square Root Activation Function for Neural Networkscited by 1
- 2023STL: A Signed and Truncated Logarithm Activation Function for Neural Networkscited by 0
- 2024Blockchain for Large Language Model Security and Safety: A Holistic Survey26 Jul 2024
- 2023Gradient Domain Diffusion Models for Image Synthesis5 Sep 2023
- 2023TSSR: A Truncated and Signed Square Root Activation Function for Neural Networks9 Aug 2023
- 2023STL: A Signed and Truncated Logarithm Activation Function for Neural Networks31 Jul 2023