FEDSTR: Money-In AI-Out | A Decentralized Marketplace for Federated Learning and LLM Training on the NOSTR Protocol
Not on the map. Why?
Abstract (arXiv)
The NOSTR is a communication protocol for the social web, based on the w3c websockets standard. Although it is still in its infancy, it is well known as a social media protocol, with thousands of trusted users and multiple user interfaces, offering a unique experience and enormous capabilities. To name a few, the NOSTR applications include but are not limited to direct messaging, file sharing, audio/video streaming, collaborative writing, blogging and data processing through distributed AI directories. In this work, we propose an approach that builds upon the existing protocol structure with end goal a decentralized marketplace for federated learning and LLM training. In this proposed design there are two parties: on one side there are customers who provide a dataset that they want to use for training an AI model. On the other side, there are service providers, who receive (parts of) the dataset, train the AI model, and for a payment as an exchange, they return the optimized AI model. To demonstrate viability, we present a proof-of-concept implementation over public NOSTR relays. The decentralized and censorship resistant features of the NOSTR enable the possibility of designing a fair and open marketplace for training AI models and LLMs.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 16 of its 47 references that are in the map. First posted on arXiv 15 Apr 2024.
Builds on
16 of 47 references.
References · 16
- 2016Communication-Efficient Learning of Deep Networks from Decentralized Datacited by 7,592
- 2019ZeRO: Memory Optimizations Toward Training Trillion Parameter Modelscited by 1,278
- 2024Medusa: Simple LLM Inference Acceleration Framework with Multiple Decoding Headscited by 821
- 2018Analyzing Federated Learning through an Adversarial Lenscited by 346
- 2023SARATHI: Efficient LLM Inference by Piggybacking Decodes with Chunked Prefillscited by 187
- 2023Accelerating LLM Inference with Staged Speculative Decodingcited by 151
- 2023DiLoCo: Distributed Low-Communication Training of Language Modelscited by 115
- 2023SkipDecode: Autoregressive Skip Decoding with Batching and Caching for Efficient LLM Inferencecited by 89
- 2023FATE-LLM: A Industrial Grade Federated Learning Framework for Large Language Modelscited by 62
- 2020Faster On-Device Training Using New Federated Momentum Algorithmcited by 25
- 2023Efficient LLM Inference on CPUscited by 24
- 2023FusionAI: Decentralized Training and Deploying LLMs with Massive Consumer-Level GPUscited by 20
4 more
- 2024Bluesky and the AT Protocol: Usable Decentralized Social Mediacited by 9
- 2019BOINC: A Platform for Volunteer Computingcited by 6
- 2020Everything is a Race and Nakamoto Always Winscited by 2
- 2023Exploring the Robustness of Decentralized Training for Large Language Modelscited by 1
Built on by
Citing papers per year: 2025: 1; 2026: 1.
2 papers.