Evaluating Interactive 2D Visualization as a Sample Selection Strategy for Biomedical Time-Series Data Annotation
Not on the map. Why?
Abstract (arXiv)
Reliable machine-learning models in biomedical settings depend on accurate labels, yet annotating biomedical time-series data remains challenging. Algorithmic sample selection may support annotation, but evidence from studies involving real human annotators is scarce. Consequently, we compare three sample selection methods for annotation: random sampling (RND), farthest-first traversal (FAFT), and a graphical user interface-based method enabling exploration of complementary 2D visualizations (2DVs) of high-dimensional data. We evaluated the methods across four classification tasks in infant motility assessment (IMA) and speech emotion recognition (SER). Twelve annotators, categorized as experts or non-experts, performed data annotation under a limited annotation budget, and post-annotation experiments were conducted to evaluate the sampling methods. Across all classification tasks, 2DV performed best when aggregating labels across annotators. In IMA, 2DV most effectively captured rare classes, but also exhibited greater annotator-to-annotator label distribution variability resulting from the limited annotation budget, decreasing classification performance when models were trained on individual annotators' labels; in these cases, FAFT excelled. For SER, 2DV outperformed the other methods among expert annotators and matched their performance for non-experts in the individual-annotator setting. A failure risk analysis revealed that RND was the safest choice when annotator count or annotator expertise was uncertain, whereas 2DV had the highest risk due to its greater label distribution variability. Furthermore, post-experiment interviews indicated that 2DV made the annotation task more interesting and enjoyable. Overall, 2DV-based sampling appears promising for biomedical time-series data annotation, particularly when the annotation budget is not highly constrained.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 15 of its 78 references that are in the map. First posted on arXiv 27 Mar 2026.
Builds on
15 of 78 references.
References · 15
- 2018UMAP: Uniform Manifold Approximation and Projection for Dimension Reductioncited by 2,841
- 2019Clustering without Over-Representationcited by 50
- 2020t-viSNE: Interactive Assessment and Interpretation of t-SNE Projectionscited by 43
- 2021RobustSleepNet: Transfer learning for automated sleep staging at scalecited by 24
- 2021Interpretability-Driven Sample Selection Using Self Supervised Learning For Disease Classification And Segmentationcited by 22
- 2020Active Learning for Sound Event Detectioncited by 14
- 2024Deep learning with noisy labels in medical prediction problems: a scoping reviewcited by 10
- 2021Annotation Curricula to Implicitly Train Non-Expert Annotatorscited by 8
- 2025Benchmarking Real-World Medical Image Classification with Noisy Labels: Challenges, Practice, and Outlookcited by 3
- 2022Analysis of Self-Supervised Learning and Dimensionality Reduction Methods in Clustering-Based Active Learning for Speech Emotion Recognitioncited by 2
- 2023ActiveSelfHAR: Incorporating Self Training into Active Learning to Improve Cross-Subject Human Activity Recognitioncited by 2
- 2024Deep Self-Cleansing for Medical Image Segmentation with Noisy Labelscited by 2
3 more
- 2024PFML: Self-Supervised Learning of Time-Series Data Without Representation Collapsecited by 1
- 2025Vision6D: 3D-to-2D Interactive Visualization and Annotation Tool for 6D Pose Estimationcited by 1
- 2025Investigating Affect Mining Techniques for Annotation Sample Selection in the Creation of Finnish Affective Speech Corpuscited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.