mlsanityData to 14 Oct 2026

From Human Corrections to Learned Segmentations: A Critical Mathematical Review of Information, Learning, and Human Effort

arXiv 2610.20396 ↗First posted 14 Oct 2026cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

When does a human correction become useful learning, and what establishes better segmentation at matched human effort? This critical narrative review follows feedback through its selection, learner update, and evaluation. It compares active learning, machine teaching, interactive segmentation, and sequential predictive evaluation using a common mathematical account of target information, predictive error, response predictability, and human work. An exact Bayesian update converts evaluation-label information into expected log-loss improvement; an excess-risk decomposition explains what an approximate learner can lose. Conditional information decompositions separate the roles of selected locations, labels, and displayed context. Empirical comparisons show why response protocols, update mechanisms, and effort denominators matter, distinguishing current-mask refinement from reusable learning and simulated interaction from human evidence. We identify what logs can reveal, what requires independent evaluation, and what remains model-dependent. The resulting research priorities are to test what selection reveals, whether using it improves assimilation, and whether the resulting interaction policy benefits segmentation at matched effort. These are distinct claims: predicting a teacher's responses need not identify human intentions or establish better learning. No new acquisition algorithm or empirical superiority is claimed.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 34 of its 78 references that are in the map. First posted on arXiv 14 Oct 2026.

Builds on

34 of 78 references.

References · 34

  1. 2023Segment Anythingcited by 8,234
  2. 2017What Uncertainties Do We Need in Bayesian Deep Learning for Computer Vision?cited by 2,352
  3. 2020A Survey of Deep Active Learningcited by 554
  4. 2019BatchBALD: Efficient and Diverse Batch Acquisition for Deep Bayesian Active Learningcited by 432
  5. 2020Performative Predictioncited by 327
  6. 2018A Probabilistic U-Net for Segmentation of Ambiguous Imagescited by 283
  7. 2018Time-uniform, nonparametric, nonasymptotic confidence sequencescited by 229
  8. 2018Learning from positive and unlabeled data: a surveycited by 219
  9. 2021A Survey of Human-in-the-loop for Machine Learningcited by 215
  10. 2017Interactive Learning from Policy-Dependent Human Feedbackcited by 158
  11. 2017Interactive Medical Image Segmentation using Deep Learning with Image-specific Fine-tuningcited by 111
  12. 2022SimpleClick: Interactive Image Segmentation with Simple Vision Transformerscited by 111
22 more
  1. 2019Large-scale interactive object segmentation with human annotatorscited by 110
  2. 2022FocalClick: Towards Practical Interactive Image Segmentationcited by 102
  3. 2020Stochastic Segmentation Networks: Modelling Spatially Correlated Aleatoric Uncertaintycited by 101
  4. 2021On Statistical Bias In Active Learning: How and When To Fix Itcited by 75
  5. 2018The Description Length of Deep Learning Modelscited by 72
  6. 2018CEREALS - Cost-Effective REgion-based Active Learning for Semantic Segmentationcited by 49
  7. 2017Iterative Machine Teachingcited by 41
  8. 2022MONAI Label: A framework for AI-assisted Interactive Labeling of 3D Medical Imagescited by 39
  9. 2019Minimum Description Length Revisitedcited by 37
  10. 2025SegAgent: Exploring Pixel Understanding Capabilities in MLLMs by Imitating Human Annotator Trajectoriescited by 30
  11. 2023Deep Interactive Segmentation of Medical Images: A Systematic Review and Taxonomycited by 27
  12. 2017Towards Black-box Iterative Machine Teachingcited by 20
  13. 2024PRISM: A Promptable and Robust Interactive Segmentation Model with Visual Promptscited by 15
  14. 2024MultiverSeg: Scalable Interactive Segmentation of Biomedical Imaging Datasets with In-Context Guidancecited by 13
  15. 2021Iterative Teacher-Aware Learningcited by 7
  16. 2024Towards Clinician-Preferred Segmentation: Leveraging Human-in-the-Loop for Test Time Adaptation in Medical Image Segmentationcited by 4
  17. 2024RClicks: Realistic Click Simulation for Benchmarking Interactive Segmentationcited by 4
  18. 2024SPA: Efficient User-Preference Alignment against Uncertainty in Medical Image Segmentationcited by 2
  19. 2025RAIL: Region-Aware Instructive Learning for Semi-Supervised Tooth Segmentation in CBCTcited by 1
  20. 2025Explainable Human-in-the-Loop Segmentation via Critic Feedback Signalscited by 1
  21. 2026Active Learning for Efficient Annotation of Surgical Videos with Weak Supervisioncited by 1
  22. 2026Expert-like Bone Ultrasound Segmentation through Expert-in-the-loop Mask-conditioned Progressive Learningcited by 1

Built on by

Not cited yet.