SAGE: Optimal-Stopping Peer Selection for Decentralised Federated Learning
Not on the map. Why?
Abstract (arXiv)
Decentralised federated learning replaces server aggregation with peer-to-peer model exchange, making collaborator selection a local decision under uncertainty. Fixed probe budgets waste effort on easy choices yet fall short when peers are hard to distinguish. We propose SAGE (Sequential Anchor-Gated Exchange), an optimal-stopping peer selector under a one-model-bearing-exchange budget. A receiver scores candidate neighbours on receiver-owned anchor evidence and selects once an advantage is certified. It continues probing only while further evidence repays its cost, and otherwise falls back to random gossip. We show that the stopping problem admits an optimal rule attained at a finite stage, and that the anchor schedule is order-optimal in the peer-risk gap and the confidence level. We further show that the selector never returns a peer worse than random gossip with high probability, and prove that no such guarantee holds for selectors that commit without a certificate. A separability threshold follows, below which no probing budget improves on gossip. Experiments span two image benchmarks, two graph families and three heterogeneity levels. Selectors that always act on their evidence lose to gossip in every configuration tested. SAGE-OS matches gossip on 75.5% less evidence than a fixed budget, at half the communication overhead of two published selectors. The operative decision is not which peer to rank first, but whether the evidence justifies ranking at all.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 13 of its 28 references that are in the map. First posted on arXiv 20 Sep 2026.
Builds on
13 of 28 references.
References · 13
- 2016Communication-Efficient Learning of Deep Networks from Decentralized Datacited by 7,669
- 2020Ensemble Distillation for Robust Model Fusion in Federated Learningcited by 682
- 2021Exploiting Shared Representations for Personalized Federated Learningcited by 541
- 2017Can Decentralized Algorithms Outperform Centralized Algorithms? A Case Study for Decentralized Parallel Stochastic Gradient Descentcited by 502
- 2014On the Complexity of Best Arm Identification in Multi-Armed Bandit Modelscited by 286
- 2019Decentralized Stochastic Optimization and Gossip Algorithms with Compressed Communicationcited by 221
- 2023Decentralized Federated Learning: A Survey and Perspectivecited by 86
- 2021Decentralized federated learning of deep neural networks on non-iid datacited by 25
- 2022Find Your Friends: Personalized Federated Learning with the Right Collaboratorscited by 10
- 2024Decentralized Directed Collaboration for Personalized Federated Learningcited by 9
- 2025PFedDST: Personalized Federated Learning with Decentralized Selection Trainingcited by 4
- 2024Decentralized Personalized Federated Learning based on a Conditional Sparse-to-Sparser Schemecited by 3
Built on by
Not cited yet.