Robust Learning from Untrusted Sources
Not on the map. Why?
Abstract (arXiv)
Modern machine learning methods often require more data for training than a single expert can provide. Therefore, it has become a standard procedure to collect data from external sources, e.g. via crowdsourcing. Unfortunately, the quality of these sources is not always guaranteed. As additional complications, the data might be stored in a distributed way, or might even have to remain private. In this work, we address the question of how to learn robustly in such scenarios. Studying the problem through the lens of statistical learning theory, we derive a procedure that allows for learning from all available sources, yet automatically suppresses irrelevant or corrupted data. We show by extensive experiments that our method provides significant improvements over alternative approaches from robust statistics and distributed optimization.
Key facts. Cited by 27 papers in the map (data through 7 Oct 2026). First posted on arXiv 29 Jan 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 7; 2022: 6; 2023: 8; 2024: 3; 2025: 2; 2026: 1.
27 papers.
Sort:
- 2022Self-Guided Noise-Free Data Generation for Efficient Zero-Shot Learningcited by 49
- 2023An Experimental Study of Byzantine-Robust Aggregation Schemes in Federated Learningcited by 32
- 2022Uncertainty-Aware Learning Against Label Noise on Imbalanced Datasetscited by 28
- 2021Aggregating From Multiple Target-Shifted Sourcescited by 24
- 2022Jigsaw-ViT: Learning Jigsaw Puzzles in Vision Transformercited by 21
- 2021Fairness-Aware PAC Learning from Corrupted Datacited by 18
- 2022Centrality and Consistency: Two-Stage Clean Samples Identification for Learning with Instance-Dependent Noisy Labelscited by 16
- 2021Auto-weighted Robust Federated Learning with Corrupted Data Sourcescited by 12
- 2021Multitask Learning and Bandits via Robust Statisticscited by 11
- 2023Algorithm-Dependent Bounds for Representation Learning of Multi-Source Domain Adaptationcited by 7
- 2023Best-Effort Adaptationcited by 7
- 2022Revisiting the Adversarial Robustness-Accuracy Tradeoff in Robot Learningcited by 6
15 more
- 2023Distributed Personalized Empirical Risk Minimizationcited by 6
- 2023Rank-Aware Negative Training for Semi-Supervised Text Classificationcited by 3
- 2021DistFL: Distribution-aware Federated Learning for Mobile Scenarioscited by 2
- 2024Collaborative Learning with Different Labeling Functionscited by 2
- 2024AdaTrans: Feature-wise and Sample-wise Adaptive Transfer Learning for High-dimensional Regressioncited by 2
- 2025Federated Adapter on Foundation Models: An Out-Of-Distribution Approachcited by 2
- 2022Gray Learning from Non-IID Data with Out-of-distribution Samplescited by 1
- 2023Mixture Weight Estimation and Model Prediction in Multi-source Multi-target Domain Adaptationcited by 1
- 2023Robust and Actively Secure Serverless Collaborative Learningcited by 1
- 2021Probabilistic Inference for Learning from Untrusted Sourcescited by 0
- 2021FLEA: Provably Robust Fair Multisource Learning from Unreliable Training Datacited by 0
- 2023R-divergence for Estimating Model-oriented Distribution Discrepancycited by 0
- 2024SAFLEX: Self-Adaptive Augmentation via Feature Label Extrapolationcited by 0
- 2025Bringing Balance to Hand Shape Classification: Mitigating Data Imbalance Through Generative Modelscited by 0
- 2026Inference-Time Consensus for Mitigating Hidden Behaviors from LLM Fine-Tuningcited by 0
- 2026Inference-Time Consensus for Mitigating Hidden Behaviors from LLM Fine-Tuning25 Jul 2026
- 2025Bringing Balance to Hand Shape Classification: Mitigating Data Imbalance Through Generative Models22 Jul 2025
- 2025Federated Adapter on Foundation Models: An Out-Of-Distribution Approach2 May 2025
- 2024SAFLEX: Self-Adaptive Augmentation via Feature Label Extrapolation3 Oct 2024
- 2024AdaTrans: Feature-wise and Sample-wise Adaptive Transfer Learning for High-dimensional Regression20 Mar 2024
- 2024Collaborative Learning with Different Labeling Functions16 Feb 2024
- 2023Distributed Personalized Empirical Risk Minimization26 Oct 2023
- 2023Robust and Actively Secure Serverless Collaborative Learning25 Oct 2023
- 2023R-divergence for Estimating Model-oriented Distribution Discrepancy2 Oct 2023
- 2023Mixture Weight Estimation and Model Prediction in Multi-source Multi-target Domain Adaptation19 Sep 2023
- 2023Rank-Aware Negative Training for Semi-Supervised Text Classification13 Jun 2023
- 2023Best-Effort Adaptation10 May 2023
15 more
- 2023Algorithm-Dependent Bounds for Representation Learning of Multi-Source Domain Adaptation4 Apr 2023
- 2023An Experimental Study of Byzantine-Robust Aggregation Schemes in Federated Learning14 Feb 2023
- 2022Centrality and Consistency: Two-Stage Clean Samples Identification for Learning with Instance-Dependent Noisy Labels29 Jul 2022
- 2022Jigsaw-ViT: Learning Jigsaw Puzzles in Vision Transformer25 Jul 2022
- 2022Uncertainty-Aware Learning Against Label Noise on Imbalanced Datasets12 Jul 2022
- 2022Gray Learning from Non-IID Data with Out-of-distribution Samples19 Jun 2022
- 2022Self-Guided Noise-Free Data Generation for Efficient Zero-Shot Learning25 May 2022
- 2022Revisiting the Adversarial Robustness-Accuracy Tradeoff in Robot Learning15 Apr 2022
- 2021Multitask Learning and Bandits via Robust Statistics28 Dec 2021
- 2021DistFL: Distribution-aware Federated Learning for Mobile Scenarios22 Oct 2021
- 2021FLEA: Provably Robust Fair Multisource Learning from Unreliable Training Data22 Jun 2021
- 2021Aggregating From Multiple Target-Shifted Sources9 May 2021
- 2021Fairness-Aware PAC Learning from Corrupted Data11 Feb 2021
- 2021Probabilistic Inference for Learning from Untrusted Sources15 Jan 2021
- 2021Auto-weighted Robust Federated Learning with Corrupted Data Sources14 Jan 2021
- 2022Self-Guided Noise-Free Data Generation for Efficient Zero-Shot Learningcited by 49
- 2023An Experimental Study of Byzantine-Robust Aggregation Schemes in Federated Learningcited by 32
- 2022Uncertainty-Aware Learning Against Label Noise on Imbalanced Datasetscited by 28
- 2021Aggregating From Multiple Target-Shifted Sourcescited by 24
- 2022Jigsaw-ViT: Learning Jigsaw Puzzles in Vision Transformercited by 21
- 2021Fairness-Aware PAC Learning from Corrupted Datacited by 18
- 2022Centrality and Consistency: Two-Stage Clean Samples Identification for Learning with Instance-Dependent Noisy Labelscited by 16
- 2021Auto-weighted Robust Federated Learning with Corrupted Data Sourcescited by 12
- 2021Multitask Learning and Bandits via Robust Statisticscited by 11
- 2023Algorithm-Dependent Bounds for Representation Learning of Multi-Source Domain Adaptationcited by 7
- 2023Best-Effort Adaptationcited by 7
- 2022Revisiting the Adversarial Robustness-Accuracy Tradeoff in Robot Learningcited by 6
12 most cited of 27 All 27 (JSON)
- 2026Inference-Time Consensus for Mitigating Hidden Behaviors from LLM Fine-Tuning25 Jul 2026
- 2025Bringing Balance to Hand Shape Classification: Mitigating Data Imbalance Through Generative Models22 Jul 2025
- 2025Federated Adapter on Foundation Models: An Out-Of-Distribution Approach2 May 2025
- 2024SAFLEX: Self-Adaptive Augmentation via Feature Label Extrapolation3 Oct 2024
- 2024AdaTrans: Feature-wise and Sample-wise Adaptive Transfer Learning for High-dimensional Regression20 Mar 2024
- 2024Collaborative Learning with Different Labeling Functions16 Feb 2024
- 2023Distributed Personalized Empirical Risk Minimization26 Oct 2023
- 2023Robust and Actively Secure Serverless Collaborative Learning25 Oct 2023
- 2023R-divergence for Estimating Model-oriented Distribution Discrepancy2 Oct 2023
- 2023Mixture Weight Estimation and Model Prediction in Multi-source Multi-target Domain Adaptation19 Sep 2023
- 2023Rank-Aware Negative Training for Semi-Supervised Text Classification13 Jun 2023
- 2023Best-Effort Adaptation10 May 2023
12 newest of 27 All 27 (JSON)