Latent Space Smoothing for Individually Fair Representations
Not on the map. Why?
Abstract (arXiv)
Fair representation learning transforms user data into a representation that ensures fairness and utility regardless of the downstream application. However, learning individually fair representations, i.e., guaranteeing that similar individuals are treated similarly, remains challenging in high-dimensional settings such as computer vision. In this work, we introduce LASSI, the first representation learning method for certifying individual fairness of high-dimensional data. Our key insight is to leverage recent advances in generative modeling to capture the set of similar individuals in the generative latent space. This enables us to learn individually fair representations that map similar individuals close together by using adversarial training to minimize the distance between their representations. Finally, we employ randomized smoothing to provably map similar individuals close together, in turn ensuring that local robustness verification of the downstream application results in end-to-end fairness certification. Our experimental evaluation on challenging real-world image data demonstrates that our method increases certified individual fairness by up to 90% without significantly affecting task utility.
Key facts. Cited by 18 papers in the map (data through 14 Oct 2026). Builds on 63 of its 96 references that are in the map. First posted on arXiv 26 Nov 2021.
Builds on
63 of 96 references.
References · 63
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
- 2014Explaining and Harnessing Adversarial Examplescited by 7,364
- 2017Towards Deep Learning Models Resistant to Adversarial Attackscited by 6,415
- 2013Auto-Encoding Variational Bayescited by 4,053
- 2014Deep Learning Face Attributes in the Wildcited by 3,693
- 2017Progressive Growing of GANs for Improved Quality, Stability, and Variationcited by 2,988
- 2016Equality of Opportunity in Supervised Learningcited by 2,007
- 2018Glow: Generative Flow with Invertible 1x1 Convolutionscited by 1,545
- 2019Certified Adversarial Robustness via Randomized Smoothingcited by 1,340
- 2017Interpretability Beyond Feature Attribution: Quantitative Testing with Concept Activation Vectors (TCAV)cited by 1,319
- 2016Man is to Computer Programmer as Woman is to Homemaker? Debiasing Word Embeddingscited by 1,312
38 more
- 2017Men Also Like Shopping: Reducing Gender Bias Amplification using Corpus-level Constraintscited by 420
- 2017Preventing Fairness Gerrymandering: Auditing and Learning for Subgroup Fairnesscited by 384
- 2018Learning Adversarially Fair and Transferable Representationscited by 353
- 2021Towards Understanding and Mitigating Social Biases in Language Modelscited by 296
- 2019Towards Fairness in Visual Recognition: Effective Strategies for Bias Mitigationcited by 252
- 2017Formal Verification of Piece-Wise Linear Feed-Forward Neural Networkscited by 242
- 2018Women also Snowboard: Overcoming Bias in Captioning Modelscited by 236
- 2019Pareto Multi-Task Learningcited by 224
- 2015The Variational Fair Autoencodercited by 223
- 2019Flexibly Fair Representation Learning by Disentanglementcited by 196
- 2015Censoring Representations with an Adversarycited by 192
- 2020Minimax Pareto Fairness: A Multi Objective Perspectivecited by 153
- 2018Reducing Gender Bias in Abusive Language Detectioncited by 152
- 2019On the Fairness of Disentangled Representationscited by 144
- 2020Fair Attribute Classification through Latent Space De-biasingcited by 125
- 2021Explaining in Style: Training a GAN to explain a classifier in StyleSpacecited by 122
- 2018Learning Controllable Fair Representationscited by 83
- 2019Conditional Learning of Fair Representationscited by 78
- 2019Predictive Inequity in Object Detectioncited by 77
- 2020Fairness by Learning Orthogonal Disentangled Representationscited by 76
- 2019Image Counterfactual Sensitivity Analysis for Detecting Unintended Biascited by 74
- 2019Training individually fair ML models with Sensitive Subspace Robustnesscited by 73
- 2020Learning Certified Individually Fair Representationscited by 69
- 2018iFair: Learning Individually Fair Data Representations for Algorithmic Decision Makingcited by 64
- 2019Operationalizing Individual Fairness with Pairwise Fair Representationscited by 64
- 2020Towards causal benchmarking of bias in face analysis algorithmscited by 64
- 2020Two Simple Ways to Learn Individual Fairness Metrics from Datacited by 54
- 2019Metric Learning for Individual Fairnesscited by 52
- 2020Verifying Individual Fairness in Machine Learning Modelscited by 49
- 2020Learning perturbation sets for robust machine learningcited by 48
- 2021Discover the Unknown Biased Attribute of an Image Classifiercited by 46
- 2018Probabilistic Verification of Fairness Properties via Concentrationcited by 45
- 2020Counterfactual Fairness with Disentangled Causal Effect Variational Autoencodercited by 45
- 2019Perfectly Parallel Fairness Certification of Neural Networkscited by 42
- 2021Fair Normalizing Flowscited by 38
- 2020Gender Slopes: Counterfactual Fairness for Computer Vision Models by Attribute Manipulationcited by 37
- 2020SenSeI: Sensitive Set Invariance for Enforcing Individual Fairnesscited by 37
- 2019Learning Fair Representations via an Adversarial Frameworkcited by 29
50 most cited of 63 All 63 (JSON)
Built on by
Citing papers per year: 2022: 5; 2023: 2; 2024: 3; 2025: 5; 2026: 3.
18 papers.
Sort:
By area:
- 2022FARE: Provably Fair Representation Learning with Practical Certificatescited by 21
- 2022Certifying Some Distributional Fairness with Subpopulation Decompositioncited by 11
- 2024Distributionally Generative Augmentation for Fair Facial Attribute Classificationcited by 8
- 2022Private and Reliable Neural Network Inferencecited by 7
- 2022Human-Guided Fair Classification for Natural Language Processingcited by 5
- 2024Path-GPTOmic: A Balanced Multi-modal Learning Framework for Survival Outcome Predictioncited by 5
- 2025AIM-Fair: Advancing Algorithmic Fairness via Selectively Fine-Tuning Biased Models with Contextual Synthetic Datacited by 5
- 2024KS-Lottery: Finding Certified Lottery Tickets for Multilingual Language Modelscited by 3
- 2022Robustness of Unsupervised Representation Learning without Labelscited by 2
- 2023Certification of Distributional Individual Fairnesscited by 2
- 2023Learning Fair Representations with High-Confidence Guaranteescited by 1
- 2025pFedFair: Towards Optimal Group Fairness-Accuracy Trade-off in Heterogeneous Federated Learningcited by 1
6 more
- 2025Correct-By-Construction: Certified Individual Fairness through Neural Network Trainingcited by 1
- 2026SHaSaM: Submodular Hard Sample Mining for Fair Facial Attribute Recognitioncited by 1
- 2026Do Counterfactually Fair Image Classifiers Satisfy Group Fairness? -- A Theoretical and Empirical Studycited by 1
- 2025Fair Representation Learning with Controllable High Confidence Guarantees via Adversarial Inferencecited by 0
- 2025FairExpand: Individual Fairness on Graphs with Partial Similarity Informationcited by 0
- 2026FairNVT: Fair Classification via Noise Injection in Vision Transformerscited by 0
- 2026Do Counterfactually Fair Image Classifiers Satisfy Group Fairness? -- A Theoretical and Empirical Study7 Jul 2026
- 2026FairNVT: Fair Classification via Noise Injection in Vision Transformers18 Apr 2026
- 2026SHaSaM: Submodular Hard Sample Mining for Fair Facial Attribute Recognition5 Feb 2026
- 2025FairExpand: Individual Fairness on Graphs with Partial Similarity Information20 Dec 2025
- 2025Fair Representation Learning with Controllable High Confidence Guarantees via Adversarial Inference23 Oct 2025
- 2025Correct-By-Construction: Certified Individual Fairness through Neural Network Training21 Aug 2025
- 2025pFedFair: Towards Optimal Group Fairness-Accuracy Trade-off in Heterogeneous Federated Learning19 Mar 2025
- 2025AIM-Fair: Advancing Algorithmic Fairness via Selectively Fine-Tuning Biased Models with Contextual Synthetic Data7 Mar 2025
- 2024Path-GPTOmic: A Balanced Multi-modal Learning Framework for Survival Outcome Prediction18 Mar 2024
- 2024Distributionally Generative Augmentation for Fair Facial Attribute Classification11 Mar 2024
- 2024KS-Lottery: Finding Certified Lottery Tickets for Multilingual Language Models5 Feb 2024
- 2023Certification of Distributional Individual Fairness20 Nov 2023
6 more
- 2023Learning Fair Representations with High-Confidence Guarantees23 Oct 2023
- 2022Human-Guided Fair Classification for Natural Language Processing20 Dec 2022
- 2022Private and Reliable Neural Network Inference27 Oct 2022
- 2022FARE: Provably Fair Representation Learning with Practical Certificates13 Oct 2022
- 2022Robustness of Unsupervised Representation Learning without Labels8 Oct 2022
- 2022Certifying Some Distributional Fairness with Subpopulation Decomposition31 May 2022
- 2022FARE: Provably Fair Representation Learning with Practical Certificatescited by 21
- 2022Certifying Some Distributional Fairness with Subpopulation Decompositioncited by 11
- 2024Distributionally Generative Augmentation for Fair Facial Attribute Classificationcited by 8
- 2022Private and Reliable Neural Network Inferencecited by 7
- 2022Human-Guided Fair Classification for Natural Language Processingcited by 5
- 2024Path-GPTOmic: A Balanced Multi-modal Learning Framework for Survival Outcome Predictioncited by 5
- 2024KS-Lottery: Finding Certified Lottery Tickets for Multilingual Language Modelscited by 3
- 2022Robustness of Unsupervised Representation Learning without Labelscited by 2
- 2023Certification of Distributional Individual Fairnesscited by 2
- 2023Learning Fair Representations with High-Confidence Guaranteescited by 1
- 2025pFedFair: Towards Optimal Group Fairness-Accuracy Trade-off in Heterogeneous Federated Learningcited by 1
- 2025Correct-By-Construction: Certified Individual Fairness through Neural Network Trainingcited by 1
12 most cited of 17 All 17 (JSON)
- 2026Do Counterfactually Fair Image Classifiers Satisfy Group Fairness? -- A Theoretical and Empirical Study7 Jul 2026
- 2026FairNVT: Fair Classification via Noise Injection in Vision Transformers18 Apr 2026
- 2026SHaSaM: Submodular Hard Sample Mining for Fair Facial Attribute Recognition5 Feb 2026
- 2025FairExpand: Individual Fairness on Graphs with Partial Similarity Information20 Dec 2025
- 2025Fair Representation Learning with Controllable High Confidence Guarantees via Adversarial Inference23 Oct 2025
- 2025Correct-By-Construction: Certified Individual Fairness through Neural Network Training21 Aug 2025
- 2025pFedFair: Towards Optimal Group Fairness-Accuracy Trade-off in Heterogeneous Federated Learning19 Mar 2025
- 2024Path-GPTOmic: A Balanced Multi-modal Learning Framework for Survival Outcome Prediction18 Mar 2024
- 2024Distributionally Generative Augmentation for Fair Facial Attribute Classification11 Mar 2024
- 2024KS-Lottery: Finding Certified Lottery Tickets for Multilingual Language Models5 Feb 2024
- 2023Certification of Distributional Individual Fairness20 Nov 2023
- 2023Learning Fair Representations with High-Confidence Guarantees23 Oct 2023
12 newest of 17 All 17 (JSON)