mlsanityData to 7 Oct 2026

FairNorm: Fair and Fast Graph Neural Network Training

arXiv 2205.09977 ↗First posted 20 May 2022cs.LGcited by 4

Not on the map. Why?

Abstract (arXiv)

Graph neural networks (GNNs) have been demonstrated to achieve state-of-the-art for a number of graph-based learning tasks, which leads to a rise in their employment in various domains. However, it has been shown that GNNs may inherit and even amplify bias within training data, which leads to unfair results towards certain sensitive groups. Meanwhile, training of GNNs introduces additional challenges, such as slow convergence and possible instability. Faced with these limitations, this work proposes FairNorm, a unified normalization framework that reduces the bias in GNN-based learning while also providing provably faster convergence. Specifically, FairNorm employs fairness-aware normalization operators over different sensitive groups with learnable parameters to reduce the bias in GNNs. The design of FairNorm is built upon analyses that illuminate the sources of bias in graph-based learning. Experiments on node classification over real-world networks demonstrate the efficiency of the proposed scheme in improving fairness in terms of statistical parity and equal opportunity compared to fairness-aware baselines. In addition, it is empirically shown that the proposed framework leads to faster convergence compared to the naive baseline where no normalization is employed.

Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 36 of its 56 references that are in the map. First posted on arXiv 20 May 2022.

Builds on

36 of 56 references.

References · 36

  1. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  2. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
  3. 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
  4. 2017Graph Attention Networkscited by 8,854
  5. 2015Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shiftcited by 6,979
  6. 2017Inductive Representation Learning on Large Graphscited by 6,284
  7. 2016Layer Normalizationcited by 5,579
  8. 2018How Powerful are Graph Neural Networks?cited by 4,355
  9. 2018Spectral Normalization for Generative Adversarial Networkscited by 1,618
  10. 2018Group Normalizationcited by 1,514
  11. 2016Instance Normalization: The Missing Ingredient for Fast Stylizationcited by 1,187
  12. 2018Graph Convolutional Neural Networks for Web-Scale Recommender Systemscited by 1,133
24 more
  1. 2020On Layer Normalization in the Transformer Architecturecited by 906
  2. 2018Representation Learning on Graphs with Jumping Knowledge Networkscited by 875
  3. 2020Benchmarking Graph Neural Networkscited by 672
  4. 2016Weight Normalization: A Simple Reparameterization to Accelerate Training of Deep Neural Networkscited by 541
  5. 2018How Does Batch Normalization Help Optimization?cited by 355
  6. 2021Do Transformers Really Perform Bad for Graph Representation?cited by 318
  7. 2017Learning to Find Good Correspondencescited by 176
  8. 2020Say No to the Discrimination: Learning Fair Graph Neural Networks with Limited Sensitive Attribute Informationcited by 168
  9. 2017Data Decisions and Theoretical Implications when Adversarially Learning Fair Representationscited by 165
  10. 2019What Can Neural Networks Reason About?cited by 155
  11. 2021Towards a Unified Framework for Fair and Stable Graph Representation Learningcited by 128
  12. 2019Compositional Fairness Constraints for Graph Embeddingscited by 126
  13. 2020GraphNorm: A Principled Approach to Accelerating Graph Neural Network Trainingcited by 116
  14. 2021Subgroup Generalization and Fairness of Graph Neural Networkscited by 69
  15. 2021FairDrop: Biased Edge Dropout for Enhancing Fairness in Graph Representation Learningcited by 68
  16. 2020DeBayes: a Bayesian Method for Debiasing Network Embeddingscited by 55
  17. 2021Fair Normalizing Flowscited by 38
  18. 2020All of the Fairness for Edge Prediction with Optimal Transportcited by 36
  19. 2021Fair Representation Learning for Heterogeneous Information Networkscited by 28
  20. 2022Fair Node Representation Learning via Adaptive Data Augmentationcited by 27
  21. 2020Addressing Fairness in Classification with a Model-Agnostic Multi-Objective Algorithmcited by 23
  22. 2019Spatio-Temporal Deep Graph Infomaxcited by 21
  23. 2021The KL-Divergence between a Graph Model and its Fair I-Projection as a Fairness Regularizercited by 17
  24. 2021Fairness-Aware Node Representation Learningcited by 14

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 3; 2024: 0; 2025: 0; 2026: 1.

4 papers.