mlsanityData to 7 Oct 2026

MAGNET: Autonomous Expert Model Generation via Decentralized Autoresearch and BitNet Training

arXiv 2603.25813 ↗First posted 26 Mar 2026cs.LG cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

We present MAGNET (Model Autonomously Growing Network), a decentralized system for autonomous generation, training, and serving of domain-expert language models across commodity hardware. MAGNET integrates four components: (1) autoresearch, an autonomous ML research pipeline that automates dataset generation, hyperparameter exploration, evaluation, and error-driven iteration; (2) BitNet b1.58 ternary training, enabling CPU-native inference via bitnet.cpp without GPU hardware; (3) DiLoCo-based distributed merging for communication-efficient aggregation of domain specialists; and (4) on-chain contribution tracking on the HOOTi EVM chain. We validate autoresearch through three case studies: video safety classification (balanced accuracy 0.9287 to 0.9851), cryptocurrency directional prediction (41% to 54.9% hit rate), and BitNet hyperparameter optimization (10-phase sweep, -16.7% validation loss).

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 12 of its 25 references that are in the map. First posted on arXiv 26 Mar 2026.

Builds on

12 of 25 references.

References · 12

  1. 2016Communication-Efficient Learning of Deep Networks from Decentralized Datacited by 7,592
  2. 2022Self-Instruct: Aligning Language Models with Self-Generated Instructionscited by 2,674
  3. 2024ORPO: Monolithic Preference Optimization without Reference Modelcited by 556
  4. 2024The Era of 1-bit LLMs: All Large Language Models are in 1.58 Bitscited by 289
  5. 2023BitNet: Scaling 1-bit Transformers for Large Language Modelscited by 175
  6. 2023DiLoCo: Distributed Low-Communication Training of Language Modelscited by 115
  7. 2024Spectra: Surprising Effectiveness of Pretraining Ternary Language Models at Scalecited by 20
  8. 2025Bitnet.cpp: Efficient Edge Inference for Ternary LLMscited by 17
  9. 2025A Vision for Auto Research with LLM Agentscited by 17
  10. 2020BitTensor: A Peer-to-Peer Intelligence Marketcited by 15
  11. 2025Incentivizing Permissionless Distributed Learning of LLMscited by 3
  12. 2025What happens when nanochat meets DiLoCo?cited by 2

Built on by

Not cited yet.