The Devil is in the Data: Learning Fair Graph Neural Networks via Partial Knowledge Distillation
On the map: Knowledge distillation → Graph neural network distillation
Abstract (arXiv)
Graph neural networks (GNNs) are being increasingly used in many high-stakes tasks, and as a result, there is growing attention on their fairness recently. GNNs have been shown to be unfair as they tend to make discriminatory decisions toward certain demographic groups, divided by sensitive attributes such as gender and race. While recent works have been devoted to improving their fairness performance, they often require accessible demographic information. This greatly limits their applicability in real-world scenarios due to legal restrictions. To address this problem, we present a demographic-agnostic method to learn fair GNNs via knowledge distillation, namely FairGKD. Our work is motivated by the empirical observation that training GNNs on partial data (i.e., only node attributes or topology data) can improve their fairness, albeit at the cost of utility. To make a balanced trade-off between fairness and utility performance, we employ a set of fairness experts (i.e., GNNs trained on different partial data) to construct the synthetic teacher, which distills fairer and informative knowledge to guide the learning of the GNN student. Experiments on several benchmark datasets demonstrate that FairGKD, which does not require access to demographic information, significantly improves the fairness of GNNs by a large margin while maintaining their utility.
Key facts. Cited by 16 papers in the map (data through 14 Oct 2026). Placed in Graph neural network distillation, one of 12 directions in Knowledge distillation. Builds on 29 of its 42 references that are in the map. First posted on arXiv 29 Nov 2023.
Builds on
29 of 42 references.
References · 29
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,361
- 2015Distilling the Knowledge in a Neural Networkcited by 10,324
- 2017Inductive Representation Learning on Large Graphscited by 6,320
- 2018How Powerful are Graph Neural Networks?cited by 4,393
- 2016Equality of Opportunity in Supervised Learningcited by 2,007
- 2019A Survey on Bias and Fairness in Machine Learningcited by 1,917
- 2014FitNets: Hints for Thin Deep Netscited by 1,653
- 2019Graph Neural Networks for Social Recommendationcited by 714
- 2020Deep Graph Contrastive Representation Learningcited by 539
- 2018Fairness Without Demographics in Repeated Loss Minimizationcited by 364
- 2021Graph Neural Network for Traffic Forecasting: A Surveycited by 261
17 more
- 2020Fairness without Demographics through Adversarially Reweighted Learningcited by 251
- 2020Say No to the Discrimination: Learning Fair Graph Neural Networks with Limited Sensitive Attribute Informationcited by 168
- 2017Data Decisions and Theoretical Implications when Adversarially Learning Fair Representationscited by 165
- 2021Graph-less Neural Networks: Teaching Old MLPs New Tricks via Distillationcited by 152
- 2019Identifying and Correcting Label Bias in Machine Learningcited by 146
- 2019Compositional Fairness Constraints for Graph Embeddingscited by 126
- 2021EDITS: Modeling and Mitigating Data Bias for Graph Neural Networkscited by 92
- 2020Alleviating the Inconsistency Problem of Applying Graph Neural Network to Fraud Detectioncited by 82
- 2022Fairness in Graph Mining: A Surveycited by 76
- 2021FairDrop: Biased Edge Dropout for Enhancing Fairness in Graph Representation Learningcited by 68
- 2022Improving Fairness in Graph Neural Networks via Mitigating Sensitive Attribute Leakagecited by 61
- 2022Learning Fair Node Representations with Graph Counterfactual Fairnesscited by 58
- 2021Towards Fair Classifiers Without Sensitive Attributes: Exploring Biases in Related Featurescited by 45
- 2020All of the Fairness for Edge Prediction with Optimal Transportcited by 36
- 2022FMP: Toward Fair Graph Message Passing against Topology Biascited by 35
- 2022FairEGM: Fair Link Prediction and Recommendation via Emulated Graph Modificationcited by 15
- 2022Learning Fair Models without Sensitive Attributes: A Generative Approachcited by 6
Built on by
Citing papers per year: 2024: 7; 2025: 6; 2026: 3.
16 papers.
Sort:
By area:
- 2024One Fits All: Learning Fair Graph Neural Networks for Various Sensitive Attributescited by 9
- 2024Enhancing Fairness in Unsupervised Graph Anomaly Detection through Disentanglementcited by 3
- 2024Are Your Models Still Fair? Fairness Attacks on Graph Neural Networks via Node Injectionscited by 2
- 2024Towards Fair Graph Neural Networks via Graph Counterfactual without Sensitive Attributescited by 2
- 2025Fairness in Augmented Graph Learning: A Surveycited by 2
- 2025Breaking the Dyadic Barrier: Rethinking Fairness in Link Prediction Beyond Demographic Paritycited by 2
- 2024Generating Synthetic Fair Syntax-agnostic Data by Learning and Distilling Fair Representationcited by 1
- 2024Toward Fair Graph Neural Networks Via Dual-Teacher Knowledge Distillationcited by 1
- 2025Preference-driven Knowledge Distillation for Few-shot Node Classificationcited by 1
- 2025Fairness-Aware Graph Representation Learning with Limited Demographic Informationcited by 1
- 2024Fair4Free: Generating High-fidelity Fair Synthetic Samples using Data Free Distillationcited by 0
- 2025Toward Data-centric Directed Graph Learning: An Entropy-driven Approachcited by 0
4 more
- 2025FairExpand: Individual Fairness on Graphs with Partial Similarity Informationcited by 0
- 2026FairGC: Fairness-aware Graph Condensationcited by 0
- 2026Grad2Fair: A Gradient-driven Approach for Graph Fairness without Demographicscited by 0
- 2026Fairness-Aware Network Embeddings: Methods, Applications, and Challengescited by 0
- 2026Fairness-Aware Network Embeddings: Methods, Applications, and Challenges19 Aug 2026
- 2026Grad2Fair: A Gradient-driven Approach for Graph Fairness without Demographics16 Jul 2026
- 2026FairGC: Fairness-aware Graph Condensation30 Mar 2026
- 2025FairExpand: Individual Fairness on Graphs with Partial Similarity Information20 Dec 2025
- 2025Fairness-Aware Graph Representation Learning with Limited Demographic Information17 Nov 2025
- 2025Breaking the Dyadic Barrier: Rethinking Fairness in Link Prediction Beyond Demographic Parity9 Nov 2025
- 2025Preference-driven Knowledge Distillation for Few-shot Node Classification11 Oct 2025
- 2025Toward Data-centric Directed Graph Learning: An Entropy-driven Approach2 May 2025
- 2025Fairness in Augmented Graph Learning: A Survey30 Apr 2025
- 2024Towards Fair Graph Neural Networks via Graph Counterfactual without Sensitive Attributes13 Dec 2024
- 2024Toward Fair Graph Neural Networks Via Dual-Teacher Knowledge Distillation30 Nov 2024
- 2024Fair4Free: Generating High-fidelity Fair Synthetic Samples using Data Free Distillation2 Oct 2024
4 more
- 2024Generating Synthetic Fair Syntax-agnostic Data by Learning and Distilling Fair Representation20 Aug 2024
- 2024One Fits All: Learning Fair Graph Neural Networks for Various Sensitive Attributes19 Jun 2024
- 2024Are Your Models Still Fair? Fairness Attacks on Graph Neural Networks via Node Injections5 Jun 2024
- 2024Enhancing Fairness in Unsupervised Graph Anomaly Detection through Disentanglement3 Jun 2024
- 2024One Fits All: Learning Fair Graph Neural Networks for Various Sensitive Attributescited by 9
- 2024Enhancing Fairness in Unsupervised Graph Anomaly Detection through Disentanglementcited by 3
- 2024Are Your Models Still Fair? Fairness Attacks on Graph Neural Networks via Node Injectionscited by 2
- 2024Towards Fair Graph Neural Networks via Graph Counterfactual without Sensitive Attributescited by 2
- 2025Fairness in Augmented Graph Learning: A Surveycited by 2
- 2025Breaking the Dyadic Barrier: Rethinking Fairness in Link Prediction Beyond Demographic Paritycited by 2
- 2024Generating Synthetic Fair Syntax-agnostic Data by Learning and Distilling Fair Representationcited by 1
- 2025Fairness-Aware Graph Representation Learning with Limited Demographic Informationcited by 1
- 2024Fair4Free: Generating High-fidelity Fair Synthetic Samples using Data Free Distillationcited by 0
- 2025Toward Data-centric Directed Graph Learning: An Entropy-driven Approachcited by 0
- 2025FairExpand: Individual Fairness on Graphs with Partial Similarity Informationcited by 0
- 2026FairGC: Fairness-aware Graph Condensationcited by 0
12 most cited of 14 All 14 (JSON)
- 2026Fairness-Aware Network Embeddings: Methods, Applications, and Challenges19 Aug 2026
- 2026Grad2Fair: A Gradient-driven Approach for Graph Fairness without Demographics16 Jul 2026
- 2026FairGC: Fairness-aware Graph Condensation30 Mar 2026
- 2025FairExpand: Individual Fairness on Graphs with Partial Similarity Information20 Dec 2025
- 2025Fairness-Aware Graph Representation Learning with Limited Demographic Information17 Nov 2025
- 2025Breaking the Dyadic Barrier: Rethinking Fairness in Link Prediction Beyond Demographic Parity9 Nov 2025
- 2025Toward Data-centric Directed Graph Learning: An Entropy-driven Approach2 May 2025
- 2025Fairness in Augmented Graph Learning: A Survey30 Apr 2025
- 2024Towards Fair Graph Neural Networks via Graph Counterfactual without Sensitive Attributes13 Dec 2024
- 2024Fair4Free: Generating High-fidelity Fair Synthetic Samples using Data Free Distillation2 Oct 2024
- 2024Generating Synthetic Fair Syntax-agnostic Data by Learning and Distilling Fair Representation20 Aug 2024
- 2024One Fits All: Learning Fair Graph Neural Networks for Various Sensitive Attributes19 Jun 2024
12 newest of 14 All 14 (JSON)
Similar, not cited
Close in wording, no citation either way
- 2023RELIANT: Fair Knowledge Distillation for Graph Neural Networks
- 2024Unbiased GNN Learning via Fairness-Aware Subgraph Diffusion
- 2024FairSample: Training Fair and Accurate Graph Convolutional Neural Networks Efficiently
- 2026FairGU: Fairness-aware Graph Unlearning in Social Networks
- 2025Improving Group Fairness in Knowledge Distillation via Laplace Approximation of Early Exits
- 2025FROG: Fair Removal on Graphs
- 2023Knowledge Distillation on Graphs: A Survey
- 2024What is Left After Distillation? How Knowledge Transfer Impacts Fairness and Bias