CurvFed: Curvature-Aligned Federated Learning for Fairness without Demographics
Not on the map. Why?
Abstract (arXiv)
Modern human sensing applications often rely on data distributed across users and devices, where privacy concerns prevent centralized training. Federated Learning (FL) addresses this challenge by enabling collaborative model training without exposing raw data or attributes. However, achieving fairness in such settings remains difficult, as most human sensing datasets lack demographic labels, and FL's privacy guarantees limit the use of sensitive attributes. This paper introduces CurvFed: Curvature Aligned Federated Learning for Fairness without Demographics, a theoretically grounded framework that promotes fairness in FL without requiring any demographic or sensitive attribute information, a concept termed Fairness without Demographics (FWD), by optimizing the underlying loss landscape curvature. Building on the theory that equivalent loss landscape curvature corresponds to consistent model efficacy across sensitive attribute groups, CurvFed regularizes the top eigenvalue of the Fisher Information Matrix (FIM) as an efficient proxy for loss landscape curvature, both within and across clients. This alignment promotes uniform model behavior across diverse bias inducing factors, offering an attribute agnostic route to algorithmic fairness. CurvFed is especially suitable for real world human sensing FL scenarios involving single or multi user edge devices with unknown or multiple bias factors. We validated CurvFed through theoretical and empirical justifications, as well as comprehensive evaluations using three real world datasets and a deployment on a heterogeneous testbed of resource constrained devices. Additionally, we conduct sensitivity analyses on local training data volume, client sampling, communication overhead, resource costs, and runtime performance to demonstrate its feasibility for practical FL edge device deployment.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 58 of its 115 references that are in the map. First posted on arXiv 30 Apr 2024.
Builds on
58 of 115 references.
References · 58
- 2016Communication-Efficient Learning of Deep Networks from Decentralized Datacited by 7,669
- 2021Convex optimizationcited by 2,515
- 2019Optuna: A Next-generation Hyperparameter Optimization Frameworkcited by 2,501
- 2019A Survey on Bias and Fairness in Machine Learningcited by 1,917
- 2020Sharpness-Aware Minimization for Efficiently Improving Generalizationcited by 1,417
- 2016On Large-Batch Training for Deep Learning: Generalization Gap and Sharp Minimacited by 1,352
- 2018Averaging Weights Leads to Wider Optima and Better Generalizationcited by 1,209
- 2017Visualizing the Loss Landscape of Neural Netscited by 1,130
- 2018Federated Learning with Non-IID Datacited by 1,108
- 2020The Future of Digital Health with Federated Learningcited by 633
- 2019Agnostic Federated Learningcited by 456
- 2019Federated Learning in Mobile Edge Networks: A Comprehensive Surveycited by 408
38 more
- 2018Fairness Without Demographics in Repeated Loss Minimizationcited by 364
- 2020Fairness without Demographics through Adversarially Reweighted Learningcited by 251
- 2019Edge Intelligence: Paving the Last Mile of Artificial Intelligence with Edge Computingcited by 228
- 2017Learning to Prune Deep Neural Networks via Layer-wise Optimal Brain Surgeoncited by 221
- 2022Generalized Federated Learning via Sharpness Aware Minimizationcited by 144
- 2021FairFed: Enabling Group Fairness in Federated Learningcited by 118
- 2017Fisher-Rao Metric, Geometry, and Complexity of Neural Networkscited by 100
- 2021A Clarification of the Nuances in the Fairness Metrics Landscapecited by 98
- 2022Improving Generalization in Federated Learning by Seeking Flat Minimacited by 98
- 2018Universal Statistics of Fisher Information in Deep Neural Networks: Mean Field Approachcited by 91
- 2018On the Relation Between the Sharpest Directions of DNN Loss and the SGD Step Lengthcited by 88
- 2020Fairness-aware Agnostic Federated Learningcited by 87
- 2019FAHT: An Adaptive Fairness-aware Decision Tree Classifiercited by 63
- 2020Mitigating Bias in Federated Learningcited by 56
- 2021Addressing Algorithmic Disparity and Performance Inconsistency in Federated Learningcited by 50
- 2019On the interplay between noise and curvature and its effect on optimization and generalizationcited by 44
- 2020A Deeper Look at the Hessian Eigenspectrum of Deep Neural Networks and its Applications to Regularizationcited by 44
- 2022Pruning has a disparate impact on model accuracycited by 44
- 2021Improving Fairness via Federated Learningcited by 39
- 2022SenseFi: A Library and Benchmark on Deep-Learning-Empowered WiFi Human Sensingcited by 34
- 2023TimelyFL: Heterogeneity-aware Asynchronous Federated Learning with Adaptive Partial Trainingcited by 27
- 2023Privacy and Fairness in Federated Learning: on the Perspective of Trade-offcited by 26
- 2018SmoothOut: Smoothing Out Sharp Minima to Improve Generalization in Deep Learningcited by 25
- 2022Minimax Demographic Group Fairness in Federated Learningcited by 24
- 2020Addressing Fairness in Classification with a Model-Agnostic Multi-Objective Algorithmcited by 23
- 2021Towards Federated Learning on Time-Evolving Heterogeneous Datacited by 23
- 2022Masking Adversarial Damage: Finding Adversarial Saliency for Robust and Sparse Networkcited by 21
- 2023FairAdaBN: Mitigating unfairness with adaptive batch normalization and its application to dermatological disease classificationcited by 19
- 2017HuGaDB: Human Gait Database for Activity Recognition from Wearable Inertial Sensor Networkscited by 16
- 2023Unraveling Privacy Risks of Individual Fairness in Graph Neural Networkscited by 16
- 2022FedStack: Personalized activity monitoring using stacked federated learningcited by 15
- 2022Generalizable machine learning for stress monitoring from wearable devices: A systematic literature reviewcited by 12
- 2024Neglected Hessian component explains mysteries in Sharpness regularizationcited by 12
- 2023Demystifying Local and Global Fairness Trade-offs in Federated Learning Using Partial Information Decompositioncited by 10
- 2024Achieve Fairness without Demographics for Dermatological Disease Diagnosiscited by 10
- 2024Personalized Federated Learning for Spatio-Temporal Forecasting: A Dual Semantic Alignment-Based Contrastive Approachcited by 8
- 2023Optimal preprocessing of WiFi CSI for sensing applicationscited by 7
- 2022Psychophysiological Arousal in Young Children Who Stutter: An Interpretable AI Approachcited by 5
50 most cited of 58 All 58 (JSON)
Built on by
Citing papers per year: 2024: 1.
1 paper.