FairSeg: A Large-Scale Medical Image Segmentation Dataset for Fairness Learning Using Segment Anything Model with Fair Error-Bound Scaling
Not on the map. Why?
Abstract (arXiv)
Fairness in artificial intelligence models has gained significantly more attention in recent years, especially in the area of medicine, as fairness in medical models is critical to people's well-being and lives. High-quality medical fairness datasets are needed to promote fairness learning research. Existing medical fairness datasets are all for classification tasks, and no fairness datasets are available for medical segmentation, while medical segmentation is an equally important clinical task as classifications, which can provide detailed spatial information on organ abnormalities ready to be assessed by clinicians. In this paper, we propose the first fairness dataset for medical segmentation named Harvard-FairSeg with 10,000 subject samples. In addition, we propose a fair error-bound scaling approach to reweight the loss function with the upper error-bound in each identity group, using the segment anything model (SAM). We anticipate that the segmentation performance equity can be improved by explicitly tackling the hard cases with high training errors in each identity group. To facilitate fair comparisons, we utilize a novel equity-scaled segmentation performance metric to compare segmentation metrics in the context of fairness, such as the equity-scaled Dice coefficient. Through comprehensive experiments, we demonstrate that our fair error-bound scaling approach either has superior or comparable fairness performance to the state-of-the-art fairness learning models. The dataset and code are publicly accessible via https://ophai.hms.harvard.edu/datasets/harvard-fairseg10k.
Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Builds on 30 of its 53 references that are in the map. First posted on arXiv 3 Nov 2023.
Builds on
30 of 53 references.
References · 30
- 2023Segment Anythingcited by 8,234
- 2016Equality of Opportunity in Supervised Learningcited by 2,007
- 2021TransUNet: Transformers Make Strong Encoders for Medical Image Segmentationcited by 1,558
- 2018UNet++: A Nested U-Net Architecture for Medical Image Segmentationcited by 1,525
- 2019CheXpert: A Large Chest Radiograph Dataset with Uncertainty Labels and Expert Comparisoncited by 1,423
- 2019Distributionally Robust Neural Networks for Group Shifts: On the Importance of Regularization for Worst-Case Generalizationcited by 1,247
- 2018Mitigating Unwanted Biases with Adversarial Learningcited by 663
- 2019MIMIC-CXR-JPG, a large publicly available database of labeled chest radiographscited by 597
- 2018A Reductions Approach to Fair Classificationcited by 587
- 2017Age Progression/Regression by Conditional Adversarial Autoencodercited by 429
- 2018Learning Adversarially Fair and Transferable Representationscited by 353
- 2023Customized Segment Anything Model for Medical Image Segmentationcited by 280
18 more
- 2018Multiaccuracy: Black-Box Post-Processing for Fairness in Classificationcited by 222
- 2021Evaluating Deep Neural Networks Trained on Clinical Images in Dermatology with the Fitzpatrick 17k Datasetcited by 185
- 2019Fair Regression: Quantitative Definitions and Reduction-based Algorithmscited by 168
- 2017Data Decisions and Theoretical Implications when Adversarially Learning Fair Representationscited by 165
- 2020Medical Image Segmentation Using Deep Learning: A Surveycited by 164
- 2020Fair Attribute Classification through Latent Space De-biasingcited by 125
- 2020Fairness by Learning Orthogonal Disentangled Representationscited by 76
- 2018Bias Mitigation Post-processing for Individual and Group Fairnesscited by 72
- 2022Fair Contrastive Learning for Facial Attribute Classificationcited by 71
- 2022MEDFAIR: Benchmarking Fairness for Medical Imagingcited by 68
- 2020FR-Train: A Mutual Information-Based Approach to Fair and Robust Trainingcited by 52
- 2022Fairness-aware Adversarial Perturbation Towards Bias Mitigation for Deployed Deep Modelscited by 47
- 2020Towards Accuracy-Fairness Paradox: Adversarial Example-based Data Augmentation for Visual Debiasingcited by 32
- 2023Harvard Glaucoma Fairness: A Retinal Nerve Disease Dataset for Fairness Learning and Fair Identity Normalizationcited by 31
- 2021Self-supervised Pseudo Multi-class Pre-training for Unsupervised Anomaly Detection and Segmentation in Medical Imagescited by 23
- 2023Harvard Glaucoma Detection and Progression: A Multimodal Multitask Dataset and Generalization-Reinforced Semi-Supervised Learningcited by 17
- 2022Unsupervised Anomaly Detection in Medical Images with a Memory-augmented Multi-level Cross-attentional Masked Autoencodercited by 15
- 2022Translation Consistent Semi-supervised Segmentation for 3D Medical Imagescited by 13
Built on by
Citing papers per year: 2023: 1; 2024: 3; 2025: 0; 2026: 1.
5 papers.
- 2024FairCLIP: Harnessing Fairness in Vision-Language Learningcited by 69
- 2024Touchstone Benchmark: Are We on the Right Way for Evaluating AI Algorithms for Medical Segmentation?cited by 31
- 2024FairDiffusion: Enhancing Equity in Latent Diffusion Models via Fair Bayesian Perturbationcited by 4
- 2026BenchX: Benchmarking AI Models for Cancer Detection and Localization with Demographic and Protocol Biasescited by 1
- 2023Inspecting Model Fairness in Ultrasound Segmentation Taskscited by 0
- 2026BenchX: Benchmarking AI Models for Cancer Detection and Localization with Demographic and Protocol Biases23 Jun 2026
- 2024FairDiffusion: Enhancing Equity in Latent Diffusion Models via Fair Bayesian Perturbation29 Dec 2024
- 2024Touchstone Benchmark: Are We on the Right Way for Evaluating AI Algorithms for Medical Segmentation?6 Nov 2024
- 2024FairCLIP: Harnessing Fairness in Vision-Language Learning29 Mar 2024
- 2023Inspecting Model Fairness in Ultrasound Segmentation Tasks5 Dec 2023