Machine Learning under Imperfect Data: Challenges and Methods
Not on the map. Why?
Abstract (arXiv)
Machine-learning models are commonly developed under an assumption that training and test data are sufficiently complete, balanced, labelled, and drawn from compatible distributions. In practice, one or more of these conditions is often violated. Measurements may be missing or corrupted, rare classes may be poorly represented, supervision may be weak, and the deployment environment may differ from the training environment. These imperfections are usually treated as separate technical problems, although they alter learning through a small number of shared mechanisms: loss of information, biased empirical risk, ambiguous supervision, and unstable representations. This short survey organises representative methods around these mechanisms. It reviews reconstruction and generation, rebalancing and representation calibration, learning with limited supervision, adaptation across domains and modalities, and reliability under distribution change. The discussion highlights the limits of plausible reconstruction, benchmark-specific correction, and adaptation without trustworthy feedback. It concludes with directions for evidence-aware learning, uncertainty-preserving prediction, and evaluation that separates visual plausibility from decision utility.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 16 of its 26 references that are in the map. First posted on arXiv 12 Sep 2026.
Builds on
16 of 26 references.
References · 16
- 2017Attention Is All You Needcited by 60,361
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2015Domain-Adversarial Training of Neural Networkscited by 3,044
- 2015Learning Deep Features for Discriminative Localizationcited by 2,436
- 2016A Baseline for Detecting Misclassified and Out-of-Distribution Examples in Neural Networkscited by 2,385
- 2020FixMatch: Simplifying Semi-Supervised Learning with Consistency and Confidencecited by 2,085
- 2016Context Encoders: Feature Learning by Inpaintingcited by 1,428
- 2020WILDS: A Benchmark of in-the-Wild Distribution Shiftscited by 1,375
4 more
- 2019Can You Trust Your Model's Uncertainty? Evaluating Predictive Uncertainty Under Dataset Shiftcited by 1,287
- 2023VTAE: Variational Transformer Autoencoder with Manifolds Learningcited by 10
- 2023Efficient Object Detection in Optical Remote Sensing Imagery via Attention-based Feature Distillationcited by 6
- 2025From Missing Pieces to Masterpieces: Image Completion with Context-Adaptive Diffusioncited by 2
Built on by
Not cited yet.