MAGNET: Autonomous Expert Model Generation via Decentralized Autoresearch and BitNet Training
Not on the map. Why?
Abstract (arXiv)
We present MAGNET (Model Autonomously Growing Network), a decentralized system for autonomous generation, training, and serving of domain-expert language models across commodity hardware. MAGNET integrates four components: (1) autoresearch, an autonomous ML research pipeline that automates dataset generation, hyperparameter exploration, evaluation, and error-driven iteration; (2) BitNet b1.58 ternary training, enabling CPU-native inference via bitnet.cpp without GPU hardware; (3) DiLoCo-based distributed merging for communication-efficient aggregation of domain specialists; and (4) on-chain contribution tracking on the HOOTi EVM chain. We validate autoresearch through three case studies: video safety classification (balanced accuracy 0.9287 to 0.9851), cryptocurrency directional prediction (41% to 54.9% hit rate), and BitNet hyperparameter optimization (10-phase sweep, -16.7% validation loss).
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 12 of its 25 references that are in the map. First posted on arXiv 26 Mar 2026.
Builds on
12 of 25 references.
References · 12
- 2016Communication-Efficient Learning of Deep Networks from Decentralized Datacited by 7,592
- 2022Self-Instruct: Aligning Language Models with Self-Generated Instructionscited by 2,674
- 2024ORPO: Monolithic Preference Optimization without Reference Modelcited by 556
- 2024The Era of 1-bit LLMs: All Large Language Models are in 1.58 Bitscited by 289
- 2023BitNet: Scaling 1-bit Transformers for Large Language Modelscited by 175
- 2023DiLoCo: Distributed Low-Communication Training of Language Modelscited by 115
- 2024Spectra: Surprising Effectiveness of Pretraining Ternary Language Models at Scalecited by 20
- 2025Bitnet.cpp: Efficient Edge Inference for Ternary LLMscited by 17
- 2025A Vision for Auto Research with LLM Agentscited by 17
- 2020BitTensor: A Peer-to-Peer Intelligence Marketcited by 15
- 2025Incentivizing Permissionless Distributed Learning of LLMscited by 3
- 2025What happens when nanochat meets DiLoCo?cited by 2
Built on by
Not cited yet.